106 Commits

Author	SHA1	Message	Date
Tamo	2f1eb78b1d	refactor the Task a little bit	2022-10-27 11:34:02 +02:00
Tamo	510ce9fc51	start moving a lot of task types to meilisearch_types	2022-10-27 11:34:01 +02:00
Tamo	0af00f6b32	fix all the import and comment most of the dump v6	2022-10-27 11:34:01 +02:00
Tamo	667c282e19	get rids of the index crate + the document_types crate	2022-10-27 11:34:00 +02:00
Loïc Lecrenier	9a74ea0943	Fix compiler errors related autobatching option of the index scheduler	2022-10-27 11:34:00 +02:00
Loïc Lecrenier	eabac9676b	Fix typo and remove useless code in tests	2022-10-27 11:34:00 +02:00
Loïc Lecrenier	ab4e649221	Apply suggestions from code review ... Co-authored-by: Tamo <tamo@meilisearch.com>	2022-10-27 11:34:00 +02:00
Loïc Lecrenier	568199fc0d	Add more task deletion tests	2022-10-27 11:33:59 +02:00
Loïc Lecrenier	13a72f8757	Use more complete snapshot tests for the index scheduler	2022-10-27 11:33:59 +02:00
Loïc Lecrenier	4c55c30027	Add a DetailsView type and improve index scheduler snapshots ... The DetailsView type is necessary because serde incorrectly deserialises the `Details` type, so the database fails to correctly decode Tasks	2022-10-27 11:33:59 +02:00
Loïc Lecrenier	dc81992eb2	Implement TaskDeletion in the index scheduler	2022-10-27 11:33:59 +02:00
Kerollmops	fe84f2648b	Allow a user to disable the auto batching system	2022-10-27 11:33:59 +02:00
Kerollmops	e2a766acb5	Add a test to check that it works without autobatching	2022-10-27 11:33:58 +02:00
Kerollmops	db9d1b18ca	Remove the IndexScheduler::notify method	2022-10-27 11:33:58 +02:00
Kerollmops	19c6f8303f	Make sure that the index-scheduler tick loop is rerun after processing	2022-10-27 11:33:58 +02:00
Kerollmops	b311eb3bed	Add a test that verifies that sending multiple tasks works	2022-10-27 11:33:58 +02:00
Tamo	0972587cfc	start writting the compat layer between v5 and v6	2022-10-27 11:33:52 +02:00
Tamo	e845cc2b6f	fix the tests	2022-10-27 11:33:51 +02:00
Clément Renault	123f47dbc4	Create the index only if the task has the rights to do so	2022-10-27 11:33:50 +02:00
Clément Renault	068a4b2884	Correctly batch tasks with different index creation rights	2022-10-27 11:33:50 +02:00
Clément Renault	87212cfd20	Use a ControlFlow in the autobatcher function	2022-10-27 11:33:50 +02:00
Kerollmops	f1b1cfdbcc	IndexDeletion operation have ClearAll details	2022-10-27 11:33:50 +02:00
Kerollmops	a083c9e452	Only mark the first clear document with the amount of cleared documents	2022-10-27 11:33:50 +02:00
Kerollmops	b24b13b036	Let the tick function set the Failed status itself	2022-10-27 11:33:50 +02:00
Kerollmops	566c15fb74	Fill an IndexDeletion task with the number of documents removed	2022-10-27 11:33:49 +02:00
Kerollmops	6b3b05fb73	Panic if we encountered a wring KindWithContent type	2022-10-27 11:33:49 +02:00
Kerollmops	36e5efde0d	Update the tasks statuses	2022-10-27 11:33:49 +02:00
Kerollmops	2fbdd104b8	Implement the IndexDeletion batch operation	2022-10-27 11:33:49 +02:00
Kerollmops	da363a92ac	Implement the IndexUpdate batch operation	2022-10-27 11:33:49 +02:00
Kerollmops	0543cba6eb	Implement the IndexCreate batch operation	2022-10-27 11:33:48 +02:00
Kerollmops	cf6084151b	Make sure that meilisearch-http works without index wrapper	2022-10-27 11:33:48 +02:00
Kerollmops	d76634a36c	Remove the Index wrapper and use milli::Index directly	2022-10-27 11:33:48 +02:00
Kerollmops	9e8242c57d	Remove the IndexRename operation	2022-10-27 11:33:48 +02:00
Kerollmops	5fa214abb1	Move the IndexScheduler to the root of the index-scheduler crate	2022-10-27 11:33:47 +02:00
Kerollmops	9a9e98fb77	Add a TODO about the index creation	2022-10-27 11:33:47 +02:00
Kerollmops	5d21c790ef	Make clippy happy	2022-10-27 11:33:47 +02:00
Kerollmops	31de33d5ee	Implement a recursive indexation for the index-related operations	2022-10-27 11:33:47 +02:00
Kerollmops	07286fcc79	Implement the SettingsAndDocumentImport batch operation	2022-10-27 11:33:47 +02:00
Kerollmops	f68906f5dc	Merge both DocumentAddition/Update into one DocumentImport variant	2022-10-27 11:33:46 +02:00
Kerollmops	5174c78f87	Implement the DocumentClear batch operation	2022-10-27 11:33:46 +02:00
Kerollmops	025bb5f616	Implement the DocumentClearAndSettings batch operation	2022-10-27 11:33:46 +02:00
Kerollmops	41ec737e73	Implement the Settings batch operation	2022-10-27 11:33:46 +02:00
Kerollmops	7b4a913704	Implement the DocumentUpdate batch operation	2022-10-27 11:33:46 +02:00
Kerollmops	a6a1043abb	Implement the DocumentDeletion batch operation	2022-10-27 11:33:46 +02:00
Tamo	7a0f17c912	remove an old unworking part of the batch execution	2022-10-27 11:33:45 +02:00
Tamo	c2899fe9b2	bring back the IndexMeta and IndexStats in meilisearch-http	2022-10-27 11:33:45 +02:00
Tamo	2c8f1a43e9	get rids of meilisearch-lib	2022-10-27 11:33:44 +02:00
Tamo	0ba1c46e19	fix a deadlock	2022-10-27 11:33:44 +02:00
Tamo	22bfb5a7a0	remove Clone from the IndexScheduler	2022-10-27 11:33:44 +02:00
Tamo	d8d3499aec	remove a bunch of comments	2022-10-27 11:33:44 +02:00