125 commits

Author	SHA1	Message	Date
Loïc Lecrenier	9207ba68db	Fix a few index swap bugs. ... 1. Details of the indexSwap task 2. Query tasks with type=indexUid 3. Synchronous error message for multiple index not found	2022-10-26 13:00:27 +02:00
Irevoire	cf7b82497c	Fix the last regression	2022-10-26 12:56:59 +02:00
Kerollmops	b2ae44c46c	Patch the IndexScheduler in meilisearch-http to use the options struct	2022-10-26 11:48:10 +02:00
Kerollmops	6167baa9eb	Introduce an options struct to create the IndexScheduler	2022-10-26 11:45:04 +02:00
Kerollmops	9d673f849e	Fix some bugs with files	2022-10-26 11:33:27 +02:00
Kerollmops	90f1334757	Compress the snapshot in a tarball	2022-10-26 11:33:27 +02:00
Kerollmops	19910f912d	Reintroduce the versioning functions	2022-10-26 11:33:27 +02:00
Kerollmops	5151bde209	Declare the auth path in the index scheduler	2022-10-26 11:33:27 +02:00
Kerollmops	67566af599	Implement a first version of the snapshots	2022-10-26 11:33:27 +02:00
Kerollmops	43aa3ce1c7	Add the snapshots directory path to the IndexScheduler	2022-10-26 11:33:27 +02:00
Kerollmops	e65f82bc86	Rename the Snapshot task into SnapshotCreation	2022-10-26 11:33:27 +02:00
Kerollmops	c2842ad25f	Rename the index-scheduler module into insta_snapshot	2022-10-26 11:33:27 +02:00
Loïc Lecrenier	7b3f156d03	Make sure that we don't delete or cancel future tasks ... This should already have been the case before, but there is no harm in adding another check.	2022-10-25 16:32:43 +02:00
Irevoire	73b2f25f55	fix an issue with the dates	2022-10-25 15:46:36 +02:00
Irevoire	56fbe147ac	add more naive tests around the document addition + remove the old unused snapshot files	2022-10-25 15:46:36 +02:00
Irevoire	b08cd4bd0c	add some naive document addition tests	2022-10-25 15:46:36 +02:00
Loïc Lecrenier	513544c1f3	Add index scheduler tests for task cancelation	2022-10-25 12:35:11 +02:00
Clément Renault	0218d94054	Merge pull request #2956 from meilisearch/index-swap-empty-crash ... Fix crash when batching an index swap task containing 0 swaps	2022-10-25 11:12:35 +02:00
Irevoire	37119d1295	reformat	2022-10-25 10:59:06 +02:00
Loïc Lecrenier	8d5d92f927	Fix crash when batching an index swap task containing 0 swaps	2022-10-25 10:57:03 +02:00
Irevoire	2a1f4ac4d9	remove a lot of unecessary clone and ref	2022-10-25 10:53:29 +02:00
Loïc Lecrenier	6f418e73d0	Apply code review suggestions	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	c0a58f9141	Pause the index scheduler for one second when a fatal error occurs	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	44b8c8b713	Fix (hopefully) queries that include processing tasks	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	c562e380a0	Adjust task details correctly following index swap	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	dd7d758a6f	Start testing unexpected errors and panics in index scheduler	2022-10-25 10:47:36 +02:00
Loïc Lecrenier	6d9140115f	Add assert method to verify validity of index scheduler state	2022-10-25 10:47:36 +02:00
Irevoire	3e45fdf7c5	rename the dumpExport to dumpCreation	2022-10-24 19:08:15 +02:00
Irevoire	3f5622f749	fix the task view and forward the task db size	2022-10-23 11:23:24 +02:00
Irevoire	3a95e6291e	remove ununsed function	2022-10-22 17:05:33 +02:00
Irevoire	3283bb0454	fix clippy	2022-10-22 17:04:47 +02:00
Irevoire	d065a3e4f0	fix the import of the dumpv4&v5 when there is no instance-uid + rename the Kind+KindWithContent+Details variant for the DocumentImport and the Setting	2022-10-22 16:07:55 +02:00
Clément Renault	3f6bd7fb11	Introduce a rustfmt file	2022-10-20 18:00:07 +02:00
Irevoire	f1acafcf1c	fix the index deletion when the index doesn’t exists but would be created by one of the autobatched tasks	2022-10-20 16:39:24 +02:00
Loïc Lecrenier	8514c1c12b	Apply review suggestions and stop using rtxn.commit	2022-10-20 16:39:23 +02:00
Loïc Lecrenier	14a44776f6	Implement POST /indexes-swap	2022-10-20 16:39:23 +02:00
Loïc Lecrenier	835745ac22	Add some documentation to the index scheduler	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	5205c7dcc7	Fix date parsing for task queries ... Use rfc3339 or YYYY-MM-DD. Add a day to the parsed date when it is an excluded lower bound and the YYYY-MM-DD was used. Also the Query type does not need to be serialisable anymore	2022-10-20 16:39:22 +02:00
Loïc Lecrenier	1eeef1c1c8	Implement task date filters ... before/after enqueued/started/finished at	2022-10-20 16:39:21 +02:00
Irevoire	f3c2be1eb5	fix the auto-generated details	2022-10-20 16:37:29 +02:00
Kerollmops	ea0dcf2c7c	Clean up the delete_persisted_task_data function	2022-10-20 16:37:28 +02:00
Kerollmops	0bbda61169	Throw the error if we can't register the tasks in the store	2022-10-20 16:37:28 +02:00
Kerollmops	9945f984db	Introduce a ProcessingTasks constructor	2022-10-20 16:37:27 +02:00
Kerollmops	fd73306793	Extract the must_stop flag out of the RwLock	2022-10-20 16:37:27 +02:00
Kerollmops	973e2f71eb	Add the tasks cancel route to cancel tasks	2022-10-20 16:37:26 +02:00
Kerollmops	01ed1fb128	Update the canceledBy and finishedAt fields	2022-10-20 16:37:26 +02:00
Kerollmops	6276b2a382	Add more enum-iterator related stuff	2022-10-20 16:37:26 +02:00
Kerollmops	607a0600e5	Prefer using TaskDeletion in the dumps	2022-10-20 16:35:06 +02:00
Kerollmops	bcb7d1744a	Introduce the task cancelation task type	2022-10-20 16:35:06 +02:00
Kerollmops	b8803781dc	Introduce the ProcessingTasks struct	2022-10-20 16:35:05 +02:00