Commit Graph

69 Commits

Author SHA1 Message Date
mpostma
d487791b03
derive serde for method and format
This is nicer when working with UpdateMeta struct
2021-02-01 19:46:34 +01:00
mpostma
91d8198d17
return documents number on addition 2021-02-01 19:42:10 +01:00
mpostma
87a56d2bc9
Fix settings bug
replace ids with str in settings

This allows for better maintainability of the settings code, since
updating the searchable attributes is now straightforward.

criterion use string

fix reindexing fieldid remaping

add tests for primary_key compute

fix tests

fix http-ui

fixup! add tests for primary_key compute

code improvements settings

update deps

fixup! code improvements settings

fixup! refactor settings updates and fix bug

fixup! Fix settings bug

fixup! Fix settings bug

fixup! Fix settings bug

Update src/update/index_documents/transform.rs

Co-authored-by: Clément Renault <clement@meilisearch.com>

fixup! Fix settings bug
2021-01-26 13:53:08 +01:00
mpostma
4f7f7538f7
highlight with new tokenizer 2021-01-11 21:59:37 +01:00
mpostma
1ae761311e
integrate with meilisearch tokenizer 2021-01-07 16:14:27 +01:00
Clément Renault
3cdf14d4c5
Introduce the field-id-docid-facet-values database 2020-12-04 12:03:20 +01:00
Clément Renault
61b383f422
Introduce the criteria update setting 2020-12-04 12:02:22 +01:00
Clément Renault
ecc8bc8910
Introduce the FieldId u8 alias type 2020-12-02 11:19:45 +01:00
Clément Renault
96f64c629e
Move the UpdateStore out of the update module 2020-12-01 14:51:05 +01:00
Clément Renault
58a1f9081c
Allow users to abort pending updates, one by one or all at once 2020-12-01 14:51:05 +01:00
Kerollmops
d0240bd9d0
Done a big clippy pass 2020-12-01 14:45:19 +01:00
Clément Renault
ba4ba685f9
Make the facet levels maps to previous level groups and don't split them 2020-11-28 12:43:43 +01:00
Clément Renault
54d5cec582
Transform numbers into strings when faceted and necessary 2020-11-23 16:43:56 +01:00
Clément Renault
fc686aaca7
Use the De Morgan law to simplify the NOT operation 2020-11-23 16:43:56 +01:00
Clément Renault
c52d09d5b1
Support a basic version of the string facet query system 2020-11-23 16:43:55 +01:00
Clément Renault
59ca4b9fe4
Introduce a little bit of debug when deleting documents 2020-11-23 16:43:53 +01:00
Clément Renault
0694cc4916
Drastically speed up documents deletion updates 2020-11-23 16:43:53 +01:00
Clément Renault
38c76754ef
Make the facet level search system generic on f64 and i64 2020-11-23 16:43:52 +01:00
Clément Renault
67d4a1b3fc
Introduce a new update for the facet levels 2020-11-23 16:43:51 +01:00
Clément Renault
9ec95679e1
Introduce a function to retrieve the facet level range docids 2020-11-23 16:43:50 +01:00
Clément Renault
fd8360deb1
Update the facet indexing facet test 2020-11-23 16:43:50 +01:00
Clément Renault
9b7e516a56
Fix the indexing process going back in time 2020-11-23 16:43:49 +01:00
Clément Renault
27f3ef5f7a
Use the new ExternalDocumentsIds struct in the engine 2020-11-22 19:27:34 +01:00
Clément Renault
eded5558b2
Rename the users ids documents ids into external documents ids 2020-11-22 17:17:47 +01:00
Clément Renault
f06355b0bb
Display the time it takes to merge user documents ids 2020-11-22 11:28:35 +01:00
Clément Renault
e76558b0cc
Change the settings update system to reindex only one time 2020-11-14 11:17:49 +01:00
Clément Renault
f9cc12ae0f
Do not try to parse empty faceted strings 2020-11-13 18:35:47 +01:00
Clément Renault
a18d9a1f87
Parse and store the faceted fields 2020-11-13 16:13:51 +01:00
Clément Renault
4e5e55c21a
Simplify the merge functions 2020-11-13 14:50:30 +01:00
Clément Renault
466fb601d6
Faceted fields settings must specify the facet type 2020-11-13 11:46:48 +01:00
Clément Renault
ebe7087bff
Introduce the faceted fields setting 2020-11-11 17:08:18 +01:00
Clément Renault
92ec908303
Introduce the facet field id values engine database 2020-11-11 16:06:33 +01:00
Clément Renault
ea43080548
Make the indexing process send the new progress step events 2020-11-11 13:13:08 +01:00
Clément Renault
e78b96a657
Introduce a more detailed progress status enum 2020-11-11 12:31:59 +01:00
Clément Renault
535f8088d7
Write the words pairs proximities directly into LMDB to speedup indexing 2020-11-11 11:25:31 +01:00
Clément Renault
45ae086974
Make sure pending updates are process when restarting the UpdateStore 2020-11-09 17:33:07 +01:00
Clément Renault
4fb138c42e
Make sure we index all kind of JSON types 2020-11-06 16:35:07 +01:00
Clément Renault
a31db33e93
Introduce an optimization when the searchable attributes are ordered 2020-11-03 19:59:09 +01:00
Clément Renault
63f65bac3e
Ignore the long running UpdateStore test 2020-11-03 19:12:00 +01:00
Clément Renault
a20c871ece
Add more tests to the Settings searchable attributes operation 2020-11-03 18:58:19 +01:00
Clément Renault
649fb6e401
Make sure that the indexing Store only index searchable fields 2020-11-03 18:58:19 +01:00
Clément Renault
e48630da72
Introduce the searchable parameter settings to the Settings update 2020-11-03 18:58:19 +01:00
Clément Renault
7e120fc441
Allow library users to specify the rayon ThreadPool for UpdateBuilder 2020-11-02 19:11:22 +01:00
Clément Renault
995d72b8c1
Introduce the Settings update operation 2020-11-02 15:31:20 +01:00
Clément Renault
3abfe8aa22
Validate documents ids before accepting them 2020-11-01 20:55:21 +01:00
Clément Renault
0ccf4cf785
Simplify the IndexDocuments builder creation from the UpdateBuilder 2020-11-01 17:31:20 +01:00
Clément Renault
600aa223c2
Fix a bug where generated docids were not saved when indexing JSON docs 2020-11-01 12:19:07 +01:00
Clément Renault
f0e63025b0
Update the Transform struct to support JSON stream updates 2020-11-01 12:19:06 +01:00
Kerollmops
6d52c5b2f0
Introduce a parameter to disable the engine to autogenerate docids 2020-10-31 21:46:55 +01:00
Clément Renault
21b4d60101
Add replace/update csv/json from the HTTP server 2020-10-31 20:52:49 +01:00