115 commits

Author	SHA1	Message	Date
Kerollmops	e65f82bc86	Rename the Snapshot task into SnapshotCreation	2022-10-26 11:33:27 +02:00
Kerollmops	c2842ad25f	Rename the index-scheduler module into insta_snapshot	2022-10-26 11:33:27 +02:00
Loïc Lecrenier	7b3f156d03	Make sure that we don't delete or cancel future tasks ... This should already have been the case before, but there is no harm in adding another check.	2022-10-25 16:32:43 +02:00
Irevoire	73b2f25f55	fix an issue with the dates	2022-10-25 15:46:36 +02:00
Irevoire	56fbe147ac	add more naive tests around the document addition + remove the old unused snapshot files	2022-10-25 15:46:36 +02:00
Irevoire	b08cd4bd0c	add some naive document addition tests	2022-10-25 15:46:36 +02:00
Loïc Lecrenier	513544c1f3	Add index scheduler tests for task cancelation	2022-10-25 12:35:11 +02:00
Clément Renault	0218d94054	Merge pull request #2956 from meilisearch/index-swap-empty-crash ... Fix crash when batching an index swap task containing 0 swaps	2022-10-25 11:12:35 +02:00
Irevoire	37119d1295	reformat	2022-10-25 10:59:06 +02:00
Loïc Lecrenier	8d5d92f927	Fix crash when batching an index swap task containing 0 swaps	2022-10-25 10:57:03 +02:00
Irevoire	2a1f4ac4d9	remove a lot of unecessary clone and ref	2022-10-25 10:53:29 +02:00
Loïc Lecrenier	6f418e73d0	Apply code review suggestions	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	c0a58f9141	Pause the index scheduler for one second when a fatal error occurs	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	44b8c8b713	Fix (hopefully) queries that include processing tasks	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	c562e380a0	Adjust task details correctly following index swap	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	dd7d758a6f	Start testing unexpected errors and panics in index scheduler	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	6d9140115f	Add assert method to verify validity of index scheduler state	2022-10-25 10:47:36 +02:00
Irevoire	3e45fdf7c5	rename the dumpExport to dumpCreation	2022-10-24 19:08:15 +02:00
Irevoire	3f5622f749	fix the task view and forward the task db size	2022-10-23 11:23:24 +02:00
Irevoire	3a95e6291e	remove ununsed function	2022-10-22 17:05:33 +02:00
Irevoire	3283bb0454	fix clippy	2022-10-22 17:04:47 +02:00
Irevoire	d065a3e4f0	fix the import of the dumpv4&v5 when there is no instance-uid + rename the Kind+KindWithContent+Details variant for the DocumentImport and the Setting	2022-10-22 16:07:55 +02:00
Clément Renault	3f6bd7fb11	Introduce a rustfmt file	2022-10-20 18:00:07 +02:00
Irevoire	f1acafcf1c	fix the index deletion when the index doesn’t exists but would be created by one of the autobatched tasks	2022-10-20 16:39:24 +02:00
Loïc Lecrenier	8514c1c12b	Apply review suggestions and stop using rtxn.commit	2022-10-20 16:39:23 +02:00
Loïc Lecrenier	14a44776f6	Implement POST /indexes-swap	2022-10-20 16:39:23 +02:00
Loïc Lecrenier	835745ac22	Add some documentation to the index scheduler	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	5205c7dcc7	Fix date parsing for task queries ... Use rfc3339 or YYYY-MM-DD. Add a day to the parsed date when it is an excluded lower bound and the YYYY-MM-DD was used. Also the Query type does not need to be serialisable anymore	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	1eeef1c1c8	Implement task date filters ... before/after enqueued/started/finished at	2022-10-20 16:39:21 +02:00
Irevoire	f3c2be1eb5	fix the auto-generated details	2022-10-20 16:37:29 +02:00
Kerollmops	ea0dcf2c7c	Clean up the delete_persisted_task_data function	2022-10-20 16:37:28 +02:00
Kerollmops	0bbda61169	Throw the error if we can't register the tasks in the store	2022-10-20 16:37:28 +02:00
Kerollmops	9945f984db	Introduce a ProcessingTasks constructor	2022-10-20 16:37:27 +02:00
Kerollmops	fd73306793	Extract the must_stop flag out of the RwLock	2022-10-20 16:37:27 +02:00
Kerollmops	973e2f71eb	Add the tasks cancel route to cancel tasks	2022-10-20 16:37:26 +02:00
Kerollmops	01ed1fb128	Update the canceledBy and finishedAt fields	2022-10-20 16:37:26 +02:00
Kerollmops	6276b2a382	Add more enum-iterator related stuff	2022-10-20 16:37:26 +02:00
Kerollmops	607a0600e5	Prefer using TaskDeletion in the dumps	2022-10-20 16:35:06 +02:00
Kerollmops	bcb7d1744a	Introduce the task cancelation task type	2022-10-20 16:35:06 +02:00
Kerollmops	b8803781dc	Introduce the ProcessingTasks struct	2022-10-20 16:35:05 +02:00
Loïc Lecrenier	baeb168b6e	Delete a task's persisted data when appropriate	2022-10-20 16:34:32 +02:00
Tamo	99f1d5df20	fix the tests	2022-10-20 16:14:37 +02:00
Tamo	dbcc3456c6	dump the content of the dump tasks instead of recreating at import time with wrong API keys	2022-10-20 16:14:36 +02:00
Tamo	09a0569228	remove useless todo	2022-10-20 16:14:36 +02:00
Tamo	b87b071718	apply most style comments of the review	2022-10-20 16:14:36 +02:00
Tamo	458a531547	rebase on index-scheduler	2022-10-20 16:14:35 +02:00
Tamo	6987bc185e	fix a synchronization bug while importing tasks	2022-10-20 16:13:18 +02:00
Tamo	748249578d	commit after creating an index	2022-10-20 16:13:17 +02:00
Tamo	9b96085327	the index-scheduler needs to wake-up after importing a dump	2022-10-20 16:13:17 +02:00
Tamo	c82bd429db	fix the content_file import	2022-10-20 16:13:17 +02:00