mpostma
3b60432687
Use update_id in UpdateBuilder
...
Add `the update_id` to the to the updates. The rationale is the
following:
- It allows for better tracability of the update events, thus improved
debugging and logging.
- The enigne is now aware of what he's already processed, and can return
it if asked. It may not make sense now, but in the future, the update
store may not work the same way, and this information about the state
of the engine will be desirable (distributed environement).
2021-02-01 19:46:34 +01:00
mpostma
d487791b03
derive serde for method and format
...
This is nicer when working with UpdateMeta struct
2021-02-01 19:46:34 +01:00
mpostma
91d8198d17
return documents number on addition
2021-02-01 19:42:10 +01:00
mpostma
87a56d2bc9
Fix settings bug
...
replace ids with str in settings
This allows for better maintainability of the settings code, since
updating the searchable attributes is now straightforward.
criterion use string
fix reindexing fieldid remaping
add tests for primary_key compute
fix tests
fix http-ui
fixup! add tests for primary_key compute
code improvements settings
update deps
fixup! code improvements settings
fixup! refactor settings updates and fix bug
fixup! Fix settings bug
fixup! Fix settings bug
fixup! Fix settings bug
Update src/update/index_documents/transform.rs
Co-authored-by: Clément Renault <clement@meilisearch.com>
fixup! Fix settings bug
2021-01-26 13:53:08 +01:00
mpostma
1ae761311e
integrate with meilisearch tokenizer
2021-01-07 16:14:27 +01:00
Clément Renault
3cdf14d4c5
Introduce the field-id-docid-facet-values database
2020-12-04 12:03:20 +01:00
Kerollmops
d0240bd9d0
Done a big clippy pass
2020-12-01 14:45:19 +01:00
Clément Renault
ba4ba685f9
Make the facet levels maps to previous level groups and don't split them
2020-11-28 12:43:43 +01:00
Clément Renault
fc686aaca7
Use the De Morgan law to simplify the NOT operation
2020-11-23 16:43:56 +01:00
Clément Renault
59ca4b9fe4
Introduce a little bit of debug when deleting documents
2020-11-23 16:43:53 +01:00
Clément Renault
67d4a1b3fc
Introduce a new update for the facet levels
2020-11-23 16:43:51 +01:00
Clément Renault
9ec95679e1
Introduce a function to retrieve the facet level range docids
2020-11-23 16:43:50 +01:00
Clément Renault
eded5558b2
Rename the users ids documents ids into external documents ids
2020-11-22 17:17:47 +01:00
Clément Renault
a18d9a1f87
Parse and store the faceted fields
2020-11-13 16:13:51 +01:00
Clément Renault
466fb601d6
Faceted fields settings must specify the facet type
2020-11-13 11:46:48 +01:00
Clément Renault
ea43080548
Make the indexing process send the new progress step events
2020-11-11 13:13:08 +01:00
Clément Renault
535f8088d7
Write the words pairs proximities directly into LMDB to speedup indexing
2020-11-11 11:25:31 +01:00
Clément Renault
4fb138c42e
Make sure we index all kind of JSON types
2020-11-06 16:35:07 +01:00
Clément Renault
649fb6e401
Make sure that the indexing Store only index searchable fields
2020-11-03 18:58:19 +01:00
Clément Renault
e48630da72
Introduce the searchable parameter settings to the Settings update
2020-11-03 18:58:19 +01:00
Clément Renault
7e120fc441
Allow library users to specify the rayon ThreadPool for UpdateBuilder
2020-11-02 19:11:22 +01:00
Clément Renault
3abfe8aa22
Validate documents ids before accepting them
2020-11-01 20:55:21 +01:00
Clément Renault
0ccf4cf785
Simplify the IndexDocuments builder creation from the UpdateBuilder
2020-11-01 17:31:20 +01:00
Clément Renault
600aa223c2
Fix a bug where generated docids were not saved when indexing JSON docs
2020-11-01 12:19:07 +01:00
Clément Renault
f0e63025b0
Update the Transform struct to support JSON stream updates
2020-11-01 12:19:06 +01:00
Kerollmops
6d52c5b2f0
Introduce a parameter to disable the engine to autogenerate docids
2020-10-31 21:46:55 +01:00
Clément Renault
a4f8be7811
Support numbers and boolean when indexing JSON
2020-10-31 20:52:49 +01:00
Clément Renault
f0d028d3a4
Update the Transform struct to support JSON updates
2020-10-31 20:52:49 +01:00
Clément Renault
9d47ee52b4
Generate a uuid v4 based document id when missing
2020-10-31 15:11:06 +01:00
Clément Renault
0d01e4854b
Add a test to check that merging works correctly with CSVs
2020-10-30 13:46:56 +01:00
Clément Renault
7cc1a358f5
Fix a documents indexing bug and add a test
2020-10-30 12:14:25 +01:00
Clément Renault
085d3b9d94
Update heed to 0.10.0
2020-10-30 11:42:00 +01:00
Clément Renault
a30206a665
Prefer using iterator put_current instead of a get put method
2020-10-30 11:13:45 +01:00
Clément Renault
855a251489
Enable the clear documents optimization that wasn't working due to a bug
2020-10-29 13:52:48 +01:00
Clément Renault
1228c2948d
Add a comment about the ClearDocuments operation in the DeleteDocuments
2020-10-28 11:17:36 +01:00
Clément Renault
3889d956d9
Introduce the UpdateBuilder and use it in the HTTP routes
2020-10-27 18:47:58 +01:00
Clément Renault
5c62fbb6a8
Move the IndexDocuments update into its own module
2020-10-26 12:21:13 +01:00