Commit Graph

36 Commits

Author SHA1 Message Date
mpostma
d487791b03
derive serde for method and format
This is nicer when working with UpdateMeta struct
2021-02-01 19:46:34 +01:00
mpostma
91d8198d17
return documents number on addition 2021-02-01 19:42:10 +01:00
mpostma
87a56d2bc9
Fix settings bug
replace ids with str in settings

This allows for better maintainability of the settings code, since
updating the searchable attributes is now straightforward.

criterion use string

fix reindexing fieldid remaping

add tests for primary_key compute

fix tests

fix http-ui

fixup! add tests for primary_key compute

code improvements settings

update deps

fixup! code improvements settings

fixup! refactor settings updates and fix bug

fixup! Fix settings bug

fixup! Fix settings bug

fixup! Fix settings bug

Update src/update/index_documents/transform.rs

Co-authored-by: Clément Renault <clement@meilisearch.com>

fixup! Fix settings bug
2021-01-26 13:53:08 +01:00
mpostma
1ae761311e
integrate with meilisearch tokenizer 2021-01-07 16:14:27 +01:00
Clément Renault
3cdf14d4c5
Introduce the field-id-docid-facet-values database 2020-12-04 12:03:20 +01:00
Kerollmops
d0240bd9d0
Done a big clippy pass 2020-12-01 14:45:19 +01:00
Clément Renault
ba4ba685f9
Make the facet levels maps to previous level groups and don't split them 2020-11-28 12:43:43 +01:00
Clément Renault
fc686aaca7
Use the De Morgan law to simplify the NOT operation 2020-11-23 16:43:56 +01:00
Clément Renault
59ca4b9fe4
Introduce a little bit of debug when deleting documents 2020-11-23 16:43:53 +01:00
Clément Renault
67d4a1b3fc
Introduce a new update for the facet levels 2020-11-23 16:43:51 +01:00
Clément Renault
9ec95679e1
Introduce a function to retrieve the facet level range docids 2020-11-23 16:43:50 +01:00
Clément Renault
eded5558b2
Rename the users ids documents ids into external documents ids 2020-11-22 17:17:47 +01:00
Clément Renault
a18d9a1f87
Parse and store the faceted fields 2020-11-13 16:13:51 +01:00
Clément Renault
466fb601d6
Faceted fields settings must specify the facet type 2020-11-13 11:46:48 +01:00
Clément Renault
ea43080548
Make the indexing process send the new progress step events 2020-11-11 13:13:08 +01:00
Clément Renault
535f8088d7
Write the words pairs proximities directly into LMDB to speedup indexing 2020-11-11 11:25:31 +01:00
Clément Renault
4fb138c42e
Make sure we index all kind of JSON types 2020-11-06 16:35:07 +01:00
Clément Renault
649fb6e401
Make sure that the indexing Store only index searchable fields 2020-11-03 18:58:19 +01:00
Clément Renault
e48630da72
Introduce the searchable parameter settings to the Settings update 2020-11-03 18:58:19 +01:00
Clément Renault
7e120fc441
Allow library users to specify the rayon ThreadPool for UpdateBuilder 2020-11-02 19:11:22 +01:00
Clément Renault
3abfe8aa22
Validate documents ids before accepting them 2020-11-01 20:55:21 +01:00
Clément Renault
0ccf4cf785
Simplify the IndexDocuments builder creation from the UpdateBuilder 2020-11-01 17:31:20 +01:00
Clément Renault
600aa223c2
Fix a bug where generated docids were not saved when indexing JSON docs 2020-11-01 12:19:07 +01:00
Clément Renault
f0e63025b0
Update the Transform struct to support JSON stream updates 2020-11-01 12:19:06 +01:00
Kerollmops
6d52c5b2f0
Introduce a parameter to disable the engine to autogenerate docids 2020-10-31 21:46:55 +01:00
Clément Renault
a4f8be7811
Support numbers and boolean when indexing JSON 2020-10-31 20:52:49 +01:00
Clément Renault
f0d028d3a4
Update the Transform struct to support JSON updates 2020-10-31 20:52:49 +01:00
Clément Renault
9d47ee52b4
Generate a uuid v4 based document id when missing 2020-10-31 15:11:06 +01:00
Clément Renault
0d01e4854b
Add a test to check that merging works correctly with CSVs 2020-10-30 13:46:56 +01:00
Clément Renault
7cc1a358f5
Fix a documents indexing bug and add a test 2020-10-30 12:14:25 +01:00
Clément Renault
085d3b9d94
Update heed to 0.10.0 2020-10-30 11:42:00 +01:00
Clément Renault
a30206a665
Prefer using iterator put_current instead of a get put method 2020-10-30 11:13:45 +01:00
Clément Renault
855a251489
Enable the clear documents optimization that wasn't working due to a bug 2020-10-29 13:52:48 +01:00
Clément Renault
1228c2948d
Add a comment about the ClearDocuments operation in the DeleteDocuments 2020-10-28 11:17:36 +01:00
Clément Renault
3889d956d9
Introduce the UpdateBuilder and use it in the HTTP routes 2020-10-27 18:47:58 +01:00
Clément Renault
5c62fbb6a8
Move the IndexDocuments update into its own module 2020-10-26 12:21:13 +01:00