7978 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Clément Renault	0c612f08c7	Rename the indexing warp routes	2020-11-02 15:30:29 +01:00
mpostma	a8ab15d65d	Revert "Merge #1001" ... This reverts commit 690eab4a25, reversing changes made to 086020e543. update changelog	2020-11-02 15:10:09 +01:00
Clément Renault	9b08f48dbd	Construct the documents based on the displayed fields or fields ids order	2020-11-02 13:01:32 +01:00
Clément Renault	303c3ce89e	Clean up the heed imports in the index module	2020-11-02 12:49:54 +01:00
Clément Renault	8f56753a2f	Introduce displayed fields methods on the index	2020-11-02 12:49:54 +01:00
Clément Renault	4fded5bd0e	Bump heed to be able to reference a RoTxn from multiple threads	2020-11-02 12:49:23 +01:00
Clément Renault	3abfe8aa22	Validate documents ids before accepting them	2020-11-01 20:55:21 +01:00
Clément Renault	0ccf4cf785	Simplify the IndexDocuments builder creation from the UpdateBuilder	2020-11-01 17:31:20 +01:00
Clément Renault	d8ff939409	Introduce bors to the project	2020-11-01 14:49:07 +01:00
Clément Renault	9047dc8163	Add a Github actions workflows	2020-11-01 14:47:44 +01:00
Clément Renault	600aa223c2	Fix a bug where generated docids were not saved when indexing JSON docs	2020-11-01 12:19:07 +01:00
Clément Renault	f0e63025b0	Update the Transform struct to support JSON stream updates	2020-11-01 12:19:06 +01:00
dependabot[bot]	93953103ad	Bump serde from 1.0.116 to 1.0.117 ... Bumps [serde](https://github.com/serde-rs/serde) from 1.0.116 to 1.0.117. - [Release notes](https://github.com/serde-rs/serde/releases) - [Commits](https://github.com/serde-rs/serde/compare/v1.0.116...v1.0.117) Signed-off-by: dependabot[bot] <support@github.com>	2020-11-01 05:40:44 +00:00
Kerollmops	082ad84914	Fix the benchmarks	2020-10-31 22:18:29 +01:00
Kerollmops	6d52c5b2f0	Introduce a parameter to disable the engine to autogenerate docids	2020-10-31 21:46:55 +01:00
Clément Renault	21b4d60101	Add replace/update csv/json from the HTTP server	2020-10-31 20:52:49 +01:00
Clément Renault	a4f8be7811	Support numbers and boolean when indexing JSON	2020-10-31 20:52:49 +01:00
Clément Renault	f0d028d3a4	Update the Transform struct to support JSON updates	2020-10-31 20:52:49 +01:00
Clément Renault	9d47ee52b4	Generate a uuid v4 based document id when missing	2020-10-31 15:11:06 +01:00
Clément Renault	ddbd336387	Introduce primary key methods on the index	2020-10-31 11:50:59 +01:00
Juan Eugenio Abadie	f25890c140	Make small improvements	2020-10-30 23:48:23 -03:00
Clément Renault	0d01e4854b	Add a test to check that merging works correctly with CSVs	2020-10-30 13:46:56 +01:00
Clément Renault	955302fd95	Introduce an HTTP route to clear the documents	2020-10-30 13:12:55 +01:00
Clément Renault	7cc1a358f5	Fix a documents indexing bug and add a test	2020-10-30 12:14:25 +01:00
Clément Renault	99da69c85f	Introduce the prepare_for_closing Index method	2020-10-30 11:46:14 +01:00
Clément Renault	222063b19d	Introduce the Index path method	2020-10-30 11:46:00 +01:00
Clément Renault	085d3b9d94	Update heed to 0.10.0	2020-10-30 11:42:00 +01:00
Clément Renault	a30206a665	Prefer using iterator put_current instead of a get put method	2020-10-30 11:13:45 +01:00
Clément Renault	e63fdf2b22	Move the heed env into the index itself to ease the usage of the library	2020-10-30 10:56:35 +01:00
Clément Renault	b5d52b6b45	Prefer using a smallstr instead of a real String to reduce allocations	2020-10-29 14:32:32 +01:00
Clément Renault	40993a0d25	Fix an indexing process bug, where documents were not written in order	2020-10-29 14:20:03 +01:00
Clément Renault	855a251489	Enable the clear documents optimization that wasn't working due to a bug	2020-10-29 13:52:48 +01:00
bors[bot]	39cf1931ae	Merge #1047 ... 1047: bump meilisearch r=Kerollmops a=MarinPostma Co-authored-by: mpostma <postma.marin@protonmail.com>	2020-10-28 11:42:24 +00:00
mpostma	bbb6771625	bump meilisearch	2020-10-28 12:36:52 +01:00
Clément Renault	1228c2948d	Add a comment about the ClearDocuments operation in the DeleteDocuments	2020-10-28 11:17:36 +01:00
Clément Renault	98fc24cbdf	Bump heed to fix a prefix iter bug	2020-10-28 10:55:21 +01:00
Kerollmops	d6338af766	Improve documents deletion by iterating over all the word pair positions	2020-10-27 18:50:09 +01:00
Clément Renault	3889d956d9	Introduce the UpdateBuilder and use it in the HTTP routes	2020-10-27 18:47:58 +01:00
bors[bot]	e9f9f270e1	Merge #1045 ... 1045: Revert "Merge #1037" r=MarinPostma a=MarinPostma This reverts commit 257f9fb2b2, reversing changes made to 9bae7a35bf. The reason fo this is that de-unicoding is not always desirable (for example is the case of CJK documents). This cannot be handled correctly for now, and will necessitate work on the tokenizer. Co-authored-by: mpostma <postma.marin@protonmail.com>	2020-10-27 17:16:27 +00:00
mpostma	190b78b7be	Revert "Merge #1037" ... This reverts commit 257f9fb2b2, reversing changes made to 9bae7a35bf.	2020-10-27 17:27:47 +01:00
bors[bot]	257f9fb2b2	Merge #1037 ... 1037: Synonym unidecode r=Kerollmops a=MarinPostma fix #964 - unidecodes all synonyms before adding them to the synonyms fst - stores a copy of the original synonyms (unicoded) for later retrieve Co-authored-by: mpostma <postma.marin@protonmail.com>	2020-10-27 10:57:40 +00:00
mpostma	d35a104ad3	requested changes	2020-10-27 11:53:24 +01:00
bors[bot]	9bae7a35bf	Merge #1032 ... 1032: Remove not maintained csv movies dataset r=MarinPostma a=bidoubiwa Remove `movies.csv` from the dataset folder as it is not updated and not usable with MeiliSearch without converting it to json. Co-authored-by: Charlotte Vermandel <charlottevermandel@gmail.com>	2020-10-27 08:18:20 +00:00
mpostma	33c7c5a7e3	remove del_synonyms function	2020-10-26 21:33:39 +01:00
mpostma	91363daeaa	add tests	2020-10-26 17:48:13 +01:00
mpostma	f9ab85adbe	deunicase synonyms	2020-10-26 17:47:55 +01:00
Clément Renault	5c62fbb6a8	Move the IndexDocuments update into its own module	2020-10-26 12:21:13 +01:00
Clément Renault	8f76ec97c0	Move the DeleteDocuments update into its own module	2020-10-26 11:01:00 +01:00
Clément Renault	92ef1faa97	Move the ClearDocuments update into its own module	2020-10-26 10:58:17 +01:00
Clément Renault	1e1821f002	Introduce the merge_two_obkv function to merge documents on update	2020-10-26 10:55:07 +01:00