65 commits

Author	SHA1	Message	Date
Tamo	cac924b663	first mostly working version	2022-10-20 16:13:16 +02:00
Tamo	6fae317277	update the API a little bit	2022-10-20 16:12:26 +02:00
Tamo	9323f9f1c4	write the dump export	2022-10-20 16:12:25 +02:00
Loïc Lecrenier	7ce336306d	Fix number of deleted tasks details after duplicate task deletion	2022-10-20 16:09:33 +02:00
Loïc Lecrenier	d49d7e9c2d	Add task deletion tests where the same task is deleted twice	2022-10-20 16:09:33 +02:00
Loïc Lecrenier	dabc30d3d6	Return an error when calling DELETE /tasks with an empty query	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	4bd8607cf9	Avoid creating two read txn at the same time	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	4c6145f782	Update snapshot tests following git rebase that fixes a bug	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	012c3e986c	Finish first draft of the DELETE /tasks route	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	ef3e9e87f5	Continue implementation of task deletion ... 1. Matched tasks are a roaring bitmap 2. Start implementation in meilisearch-http 3. Snapshots use meili-snap 4. Rename to TaskDeletion	2022-10-20 16:08:16 +02:00
Kerollmops	7d4527728e	Make sure that we do not batch tasks from different indexes	2022-10-20 16:00:58 +02:00
Kerollmops	1c697edb95	Add a test to check different indexes autobatching	2022-10-20 16:00:58 +02:00
Tamo	c9050759f5	remove an unused file	2022-10-20 15:59:53 +02:00
Tamo	e533e740d4	refactor the Task a little bit	2022-10-20 15:59:52 +02:00
Tamo	e6c033bd6b	start moving a lot of task types to meilisearch_types	2022-10-20 15:59:52 +02:00
Tamo	f456fb5e0b	get rids of the index crate + the document_types crate	2022-10-20 15:57:52 +02:00
Loïc Lecrenier	f3ec39a769	Fix compiler errors related autobatching option of the index scheduler	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	8d0ebbc9fa	Fix typo and remove useless code in tests	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	ccfe1babdc	Add more task deletion tests	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	570ae05833	Use more complete snapshot tests for the index scheduler	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	fd73e65165	Add a DetailsView type and improve index scheduler snapshots ... The DetailsView type is necessary because serde incorrectly deserialises the `Details` type, so the database fails to correctly decode Tasks	2022-10-20 15:45:57 +02:00
Loïc Lecrenier	05753c663f	Implement TaskDeletion in the index scheduler	2022-10-20 15:44:58 +02:00
Kerollmops	21d6c03bb4	Add a test to check that it works without autobatching	2022-10-20 15:44:58 +02:00
Kerollmops	12c374e475	Remove the IndexScheduler::notify method	2022-10-20 15:44:58 +02:00
Kerollmops	fc148212aa	Make sure that the index-scheduler tick loop is rerun after processing	2022-10-20 15:44:58 +02:00
Kerollmops	67e8ee6ef7	Add a test that verifies that sending multiple tasks works	2022-10-20 15:44:57 +02:00
Tamo	4958bf3a55	start writting the compat layer between v5 and v6	2022-10-20 15:44:52 +02:00
Clément Renault	134634d99a	Correctly batch tasks with different index creation rights	2022-10-20 15:44:35 +02:00
Kerollmops	99d1e9a870	Let the tick function set the Failed status itself	2022-10-20 15:44:34 +02:00
Kerollmops	f3f6bbf624	Update the tasks statuses	2022-10-20 15:44:33 +02:00
Kerollmops	4871509507	Make sure that meilisearch-http works without index wrapper	2022-10-20 15:44:33 +02:00
Kerollmops	478e3f0f6b	Remove the Index wrapper and use milli::Index directly	2022-10-20 15:43:03 +02:00
Kerollmops	257651c615	Move the IndexScheduler to the root of the index-scheduler crate	2022-10-20 15:43:02 +02:00
Tamo	2d31cff082	get rids of meilisearch-lib	2022-10-20 15:42:44 +02:00
Tamo	03de8669a2	start implementing some logic to test the internal states of the scheduler	2022-10-20 15:36:09 +02:00
Irevoire	60ee1f5e64	wip integrating the scheduler in meilisearch-http	2022-10-20 15:34:55 +02:00
Irevoire	acc6d3a82b	start integrating the index-scheduler in meilisearch-lib	2022-10-20 15:30:31 +02:00
Irevoire	16eab7b337	I can index documents without meilisearch	2022-10-20 15:30:20 +02:00
Tamo	cfc01e4372	test the register tasks	2022-10-20 15:28:50 +02:00
Tamo	f84ced7e38	start integrating the index-scheduler in the meilisearch codebase	2022-10-20 15:28:50 +02:00
Tamo	9882b7fa57	greatly reduce the number of warnings	2022-10-20 15:26:57 +02:00
Tamo	ce0ebf9381	get rids of the horrendous spinlock in favor of synchronoise	2022-10-20 15:26:57 +02:00
Tamo	c326613e06	move the index mapping logic in another structure	2022-10-20 15:26:45 +02:00
Tamo	48e10176b2	migrate the index handling code in a different file + implements the create index	2022-10-20 15:26:45 +02:00
Tamo	f7357fc504	reintroduce the uuid mapping for the indexes	2022-10-20 15:26:45 +02:00
Tamo	cf8c4310ab	extract the index abstraction out of the index-scheduler in its own module	2022-10-20 15:26:32 +02:00
Tamo	5abb79f149	rename the update-file-store to file-store since it can store any kind of file	2022-10-20 15:26:22 +02:00
Tamo	5dcd67c597	import the update_file_store in the index-scheduler	2022-10-20 15:26:22 +02:00
Tamo	1efccb1bc4	polish the global structure of the batch creation	2022-10-20 15:26:06 +02:00
Irevoire	78ca4bf608	move the autobatcher logic to another file	2022-10-20 15:26:06 +02:00