326 Commits

Author SHA1 Message Date
Clément Renault
0694cc4916
Drastically speed up documents deletion updates 2020-11-23 16:43:53 +01:00
Clément Renault
38c76754ef
Make the facet level search system generic on f64 and i64 2020-11-23 16:43:52 +01:00
Clément Renault
9e2cbe3362
Improve the FacetLevelF64 serialization 2020-11-23 16:43:52 +01:00
Clément Renault
ced0c29c56
Simplify getting the biggest level of a facet field 2020-11-23 16:43:52 +01:00
Kerollmops
7d67c9e2e7
Improve the facet search algorithm performances 2020-11-23 16:43:52 +01:00
Clément Renault
67d4a1b3fc
Introduce a new update for the facet levels 2020-11-23 16:43:51 +01:00
Clément Renault
45e0feab4e
Speed up the facets stats infos subcommand 2020-11-23 16:43:51 +01:00
Kerollmops
7a6e6eb5e2
Introduce a facets stats infos subcommand 2020-11-23 16:43:51 +01:00
Clément Renault
9ec95679e1
Introduce a function to retrieve the facet level range docids 2020-11-23 16:43:50 +01:00
Clément Renault
57d253aeda
Improve the infos biggest-value subcommand to support facets 2020-11-23 16:43:50 +01:00
Clément Renault
fd8360deb1
Update the facet indexing facet test 2020-11-23 16:43:50 +01:00
Clément Renault
9b7e516a56
Fix the indexing process going back in time 2020-11-23 16:43:49 +01:00
Clément Renault
2341b99379
Support a basic facet based query system 2020-11-23 16:43:49 +01:00
Clément Renault
05c95dfdc6
Introduce an infos subcommand that patches the external documents ids 2020-11-22 19:27:34 +01:00
Clément Renault
27f3ef5f7a
Use the new ExternalDocumentsIds struct in the engine 2020-11-22 19:27:34 +01:00
Clément Renault
fe82516f9f
Use the ExternalDocumentsIds in the Index struct 2020-11-22 19:27:34 +01:00
Clément Renault
415c0b86ba
Introduce the ExternalDocumentsIds struct 2020-11-22 19:27:33 +01:00
Clément Renault
eded5558b2
Rename the users ids documents ids into external documents ids 2020-11-22 17:17:47 +01:00
Clément Renault
f06355b0bb
Display the time it takes to merge user documents ids 2020-11-22 11:28:35 +01:00
Clément Renault
e76558b0cc
Change the settings update system to reindex only one time 2020-11-14 11:17:49 +01:00
Clément Renault
f9cc12ae0f
Do not try to parse empty faceted strings 2020-11-13 18:35:47 +01:00
Clément Renault
8e6efe4d87
Introduce an infos subcommand to display the facet values 2020-11-13 18:35:47 +01:00
Clément Renault
a18d9a1f87
Parse and store the faceted fields 2020-11-13 16:13:51 +01:00
Clément Renault
4e5e55c21a
Simplify the merge functions 2020-11-13 14:50:30 +01:00
Clément Renault
8ae9888959
Store the field id instead of the field name in the facets database 2020-11-13 14:50:30 +01:00
Clément Renault
cf9ddd293d
Simplify the the facet types 2020-11-13 11:46:48 +01:00
Clément Renault
466fb601d6
Faceted fields settings must specify the facet type 2020-11-13 11:46:48 +01:00
Clément Renault
ebe7087bff
Introduce the faceted fields setting 2020-11-11 17:08:18 +01:00
Clément Renault
72f18759ba
Introduce getters and setters for the facet fields ids facet types 2020-11-11 16:26:22 +01:00
Clément Renault
92ec908303
Introduce the facet field id values engine database 2020-11-11 16:06:33 +01:00
Clément Renault
e0058c1125
Introduce codecs for facet types (string, f64, u64, i64) 2020-11-11 15:48:24 +01:00
Clément Renault
ea43080548
Make the indexing process send the new progress step events 2020-11-11 13:13:08 +01:00
Clément Renault
e78b96a657
Introduce a more detailed progress status enum 2020-11-11 12:31:59 +01:00
Clément Renault
535f8088d7
Write the words pairs proximities directly into LMDB to speedup indexing 2020-11-11 11:25:31 +01:00
Clément Renault
45ae086974
Make sure pending updates are process when restarting the UpdateStore 2020-11-09 17:33:07 +01:00
Clément Renault
4fb138c42e
Make sure we index all kind of JSON types 2020-11-06 16:35:07 +01:00
Clément Renault
c94bc59d7e
Introduce a function to transform an obk into a JSON 2020-11-05 13:57:29 +01:00
Clément Renault
0408c9d66a
Move the http server into its own sub-module 2020-11-05 11:16:39 +01:00
Clément Renault
a31db33e93
Introduce an optimization when the searchable attributes are ordered 2020-11-03 19:59:09 +01:00
Clément Renault
01c4f5abcd
Introduce the searchable attributes setting to the settings route 2020-11-03 19:35:55 +01:00
Clément Renault
63f65bac3e
Ignore the long running UpdateStore test 2020-11-03 19:12:00 +01:00
Clément Renault
a20c871ece
Add more tests to the Settings searchable attributes operation 2020-11-03 18:58:19 +01:00
Clément Renault
649fb6e401
Make sure that the indexing Store only index searchable fields 2020-11-03 18:58:19 +01:00
Clément Renault
e48630da72
Introduce the searchable parameter settings to the Settings update 2020-11-03 18:58:19 +01:00
Clément Renault
68d783145b
Introduce searchable fields methods on the index 2020-11-03 18:58:19 +01:00
Clément Renault
7e120fc441
Allow library users to specify the rayon ThreadPool for UpdateBuilder 2020-11-02 19:11:22 +01:00
Clément Renault
3d1854ab95
Introduce an HTTP route to accept settings changes 2020-11-02 15:47:21 +01:00
Clément Renault
995d72b8c1
Introduce the Settings update operation 2020-11-02 15:31:20 +01:00
Clément Renault
0c612f08c7
Rename the indexing warp routes 2020-11-02 15:30:29 +01:00
Clément Renault
9b08f48dbd
Construct the documents based on the displayed fields or fields ids order 2020-11-02 13:01:32 +01:00