97 commits

Author	SHA1	Message	Date
Kerollmops	5151bde209	Declare the auth path in the index scheduler	2022-10-26 11:33:27 +02:00
Kerollmops	67566af599	Implement a first version of the snapshots	2022-10-26 11:33:27 +02:00
Kerollmops	e65f82bc86	Rename the Snapshot task into SnapshotCreation	2022-10-26 11:33:27 +02:00
Loïc Lecrenier	513544c1f3	Add index scheduler tests for task cancelation	2022-10-25 12:35:11 +02:00
Clément Renault	0218d94054	Merge pull request #2956 from meilisearch/index-swap-empty-crash ... Fix crash when batching an index swap task containing 0 swaps	2022-10-25 11:12:35 +02:00
Irevoire	d0c93e3573	rename received_document_ids to matched_documents in the DocumentDeletion task type (reimplementation of #2826)	2022-10-25 11:02:26 +02:00
Loïc Lecrenier	8d5d92f927	Fix crash when batching an index swap task containing 0 swaps	2022-10-25 10:57:03 +02:00
Loïc Lecrenier	dd7d758a6f	Start testing unexpected errors and panics in index scheduler	2022-10-25 10:47:36 +02:00
Irevoire	3e45fdf7c5	rename the dumpExport to dumpCreation	2022-10-24 19:08:15 +02:00
Irevoire	3283bb0454	fix clippy	2022-10-22 17:04:47 +02:00
Irevoire	8bda5e0787	fix the autobatched document deletion	2022-10-22 16:07:55 +02:00
Irevoire	2387db8ab7	fix the index creation in case an index already exists	2022-10-22 16:07:55 +02:00
Irevoire	9219bec053	fix the failed document addition with a primary key	2022-10-22 16:07:55 +02:00
Irevoire	d065a3e4f0	fix the import of the dumpv4&v5 when there is no instance-uid + rename the Kind+KindWithContent+Details variant for the DocumentImport and the Setting	2022-10-22 16:07:55 +02:00
Clément Renault	3f6bd7fb11	Introduce a rustfmt file	2022-10-20 18:00:07 +02:00
Clément Renault	2a51161258	Fix allow_index_creation useless field	2022-10-20 16:39:25 +02:00
Irevoire	f1acafcf1c	fix the index deletion when the index doesn’t exists but would be created by one of the autobatched tasks	2022-10-20 16:39:24 +02:00
Irevoire	3357c439e3	it probably works but it's also horrendous	2022-10-20 16:39:23 +02:00
Loïc Lecrenier	8514c1c12b	Apply review suggestions and stop using rtxn.commit	2022-10-20 16:39:23 +02:00
Loïc Lecrenier	14a44776f6	Implement POST /indexes-swap	2022-10-20 16:39:23 +02:00
Loïc Lecrenier	835745ac22	Add some documentation to the index scheduler	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	1eeef1c1c8	Implement task date filters ... before/after enqueued/started/finished at	2022-10-20 16:39:21 +02:00
Irevoire	f3c2be1eb5	fix the auto-generated details	2022-10-20 16:37:29 +02:00
Tamo	aa13fc448d	remove the unused variants from the autobatcher	2022-10-20 16:37:29 +02:00
Kerollmops	188e95d00f	Delete the tasks content file once the transaction has been successfully committed	2022-10-20 16:37:28 +02:00
Kerollmops	fd73306793	Extract the must_stop flag out of the RwLock	2022-10-20 16:37:27 +02:00
Kerollmops	07db4cfab0	Prefer using an u64 instead of a usize in some places	2022-10-20 16:37:27 +02:00
Kerollmops	cc6e2fd1e8	Delete the persisted data when we cancel a task	2022-10-20 16:37:27 +02:00
Kerollmops	afafe8d207	Put the original URL query in the tasks details	2022-10-20 16:37:26 +02:00
Kerollmops	01ed1fb128	Update the canceledBy and finishedAt fields	2022-10-20 16:37:26 +02:00
Kerollmops	74657bba2c	Introduce the core algorithm of task cancelation	2022-10-20 16:37:26 +02:00
Kerollmops	bcb7d1744a	Introduce the task cancelation task type	2022-10-20 16:35:06 +02:00
Kerollmops	b8803781dc	Introduce the ProcessingTasks struct	2022-10-20 16:35:05 +02:00
Loïc Lecrenier	baeb168b6e	Delete a task's persisted data when appropriate	2022-10-20 16:34:32 +02:00
Tamo	0bde0abd74	share the rtxn between the access to the tasks and to the indexes	2022-10-20 16:14:37 +02:00
Tamo	8e469d8d1d	flush the dump-writer only once everything has been inserted	2022-10-20 16:14:36 +02:00
Tamo	b87b071718	apply most style comments of the review	2022-10-20 16:14:36 +02:00
Tamo	8c9b758fa8	stop dumping the current dumping task as enqueued so it's not looping for ever	2022-10-20 16:13:17 +02:00
Tamo	cac924b663	first mostly working version	2022-10-20 16:13:16 +02:00
Tamo	6fae317277	update the API a little bit	2022-10-20 16:12:26 +02:00
Tamo	1a3fea4d8c	fix the tests	2022-10-20 16:12:26 +02:00
Tamo	9323f9f1c4	write the dump export	2022-10-20 16:12:25 +02:00
Loïc Lecrenier	7ce336306d	Fix number of deleted tasks details after duplicate task deletion	2022-10-20 16:09:33 +02:00
Loïc Lecrenier	d49d7e9c2d	Add task deletion tests where the same task is deleted twice	2022-10-20 16:09:33 +02:00
Loïc Lecrenier	9067148270	Apply suggested changes from PR review	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	012c3e986c	Finish first draft of the DELETE /tasks route	2022-10-20 16:09:32 +02:00
Loïc Lecrenier	ef3e9e87f5	Continue implementation of task deletion ... 1. Matched tasks are a roaring bitmap 2. Start implementation in meilisearch-http 3. Snapshots use meili-snap 4. Rename to TaskDeletion	2022-10-20 16:08:16 +02:00
Kerollmops	7d4527728e	Make sure that we do not batch tasks from different indexes	2022-10-20 16:00:58 +02:00
Tamo	e533e740d4	refactor the Task a little bit	2022-10-20 15:59:52 +02:00
Tamo	e6c033bd6b	start moving a lot of task types to meilisearch_types	2022-10-20 15:59:52 +02:00