35 Commits

Author	SHA1	Message	Date
Clément Renault	c52d09d5b1	Support a basic version of the string facet query system	2020-11-23 16:43:55 +01:00
Clément Renault	59ca4b9fe4	Introduce a little bit of debug when deleting documents	2020-11-23 16:43:53 +01:00
Clément Renault	67d4a1b3fc	Introduce a new update for the facet levels	2020-11-23 16:43:51 +01:00
Clément Renault	9ec95679e1	Introduce a function to retrieve the facet level range docids	2020-11-23 16:43:50 +01:00
Clément Renault	9b7e516a56	Fix the indexing process going back in time	2020-11-23 16:43:49 +01:00
Clément Renault	27f3ef5f7a	Use the new ExternalDocumentsIds struct in the engine	2020-11-22 19:27:34 +01:00
Clément Renault	eded5558b2	Rename the users ids documents ids into external documents ids	2020-11-22 17:17:47 +01:00
Clément Renault	f06355b0bb	Display the time it takes to merge user documents ids	2020-11-22 11:28:35 +01:00
Clément Renault	f9cc12ae0f	Do not try to parse empty faceted strings	2020-11-13 18:35:47 +01:00
Clément Renault	a18d9a1f87	Parse and store the faceted fields	2020-11-13 16:13:51 +01:00
Clément Renault	4e5e55c21a	Simplify the merge functions	2020-11-13 14:50:30 +01:00
Clément Renault	466fb601d6	Faceted fields settings must specify the facet type	2020-11-13 11:46:48 +01:00
Clément Renault	ea43080548	Make the indexing process send the new progress step events	2020-11-11 13:13:08 +01:00
Clément Renault	535f8088d7	Write the words pairs proximities directly into LMDB to speedup indexing	2020-11-11 11:25:31 +01:00
Clément Renault	4fb138c42e	Make sure we index all kind of JSON types	2020-11-06 16:35:07 +01:00
Clément Renault	649fb6e401	Make sure that the indexing Store only index searchable fields	2020-11-03 18:58:19 +01:00
Clément Renault	e48630da72	Introduce the searchable parameter settings to the Settings update	2020-11-03 18:58:19 +01:00
Clément Renault	7e120fc441	Allow library users to specify the rayon ThreadPool for UpdateBuilder	2020-11-02 19:11:22 +01:00
Clément Renault	3abfe8aa22	Validate documents ids before accepting them	2020-11-01 20:55:21 +01:00
Clément Renault	0ccf4cf785	Simplify the IndexDocuments builder creation from the UpdateBuilder	2020-11-01 17:31:20 +01:00
Clément Renault	600aa223c2	Fix a bug where generated docids were not saved when indexing JSON docs	2020-11-01 12:19:07 +01:00
Clément Renault	f0e63025b0	Update the Transform struct to support JSON stream updates	2020-11-01 12:19:06 +01:00
Kerollmops	6d52c5b2f0	Introduce a parameter to disable the engine to autogenerate docids	2020-10-31 21:46:55 +01:00
Clément Renault	a4f8be7811	Support numbers and boolean when indexing JSON	2020-10-31 20:52:49 +01:00
Clément Renault	f0d028d3a4	Update the Transform struct to support JSON updates	2020-10-31 20:52:49 +01:00
Clément Renault	9d47ee52b4	Generate a uuid v4 based document id when missing	2020-10-31 15:11:06 +01:00
Clément Renault	0d01e4854b	Add a test to check that merging works correctly with CSVs	2020-10-30 13:46:56 +01:00
Clément Renault	7cc1a358f5	Fix a documents indexing bug and add a test	2020-10-30 12:14:25 +01:00
Clément Renault	085d3b9d94	Update heed to 0.10.0	2020-10-30 11:42:00 +01:00
Clément Renault	a30206a665	Prefer using iterator put_current instead of a get put method	2020-10-30 11:13:45 +01:00
Clément Renault	40993a0d25	Fix an indexing process bug, where documents were not written in order	2020-10-29 14:20:03 +01:00
Clément Renault	855a251489	Enable the clear documents optimization that wasn't working due to a bug	2020-10-29 13:52:48 +01:00
Clément Renault	1228c2948d	Add a comment about the ClearDocuments operation in the DeleteDocuments	2020-10-28 11:17:36 +01:00
Clément Renault	3889d956d9	Introduce the UpdateBuilder and use it in the HTTP routes	2020-10-27 18:47:58 +01:00
Clément Renault	5c62fbb6a8	Move the IndexDocuments update into its own module	2020-10-26 12:21:13 +01:00