17 Commits

Author	SHA1	Message	Date
meili-bors[bot]	b005eb3289	Merge #4435 ... 4435: Make update file deletion atomic r=Kerollmops a=irevoire # Pull Request ## Related issue Fixes https://github.com/meilisearch/meilisearch/issues/4432 Fixes https://github.com/meilisearch/meilisearch/issues/4438 by adding the logs the user asked ## What does this PR do? - Adds a bunch of logs to help debug this kind of issue in the future - Delete the update files AFTER committing the update in the `index-scheduler` (thus, if a restart happens, we are able to re-process the batch successfully) - Multi-thread the deletion of all update files. Co-authored-by: Tamo <tamo@meilisearch.com>	2024-02-26 17:54:40 +00:00
Tamo	0562818c2a	fix and remove the file-store hack of /dev/null	2024-02-26 13:59:41 +01:00
Tamo	36c27a18a1	implement the dry run ha parameter	2024-02-26 13:58:04 +01:00
Tamo	91cdd502f8	When processing tasks, make the update file deletion atomic	2024-02-22 14:56:22 +01:00
Tamo	66b5e4b548	fix a bug where the filestore could try to parse its own tmp file and fail	2023-02-23 16:52:41 +01:00
Tamo	a858531574	apply review comments	2023-01-25 14:51:36 +01:00
Tamo	c92948b143	Compute the size of the auth-controller, index-scheduler and all update files in the global stats	2023-01-25 11:25:02 +01:00
Kerollmops	eec43ec953	Implement a first version of the snapshots	2022-10-27 11:35:14 +02:00
Loïc Lecrenier	ea60d35c71	Delete a task's persisted data when appropriate	2022-10-27 11:34:10 +02:00
Loïc Lecrenier	eabac9676b	Fix typo and remove useless code in tests	2022-10-27 11:34:00 +02:00
Loïc Lecrenier	ab4e649221	Apply suggestions from code review ... Co-authored-by: Tamo <tamo@meilisearch.com>	2022-10-27 11:34:00 +02:00
Loïc Lecrenier	13a72f8757	Use more complete snapshot tests for the index scheduler	2022-10-27 11:33:59 +02:00
Irevoire	8770e07397	I can index documents without meilisearch	2022-10-27 11:33:42 +02:00
Tamo	4846a7c501	use faux in the file-store	2022-10-27 11:33:41 +02:00
Tamo	48138c21a9	rename the update-file-store to file-store since it can store any kind of file	2022-10-27 11:33:38 +02:00
Tamo	2afb381f95	get rids of nelson	2022-10-27 11:33:37 +02:00
Tamo	a9844bd4f6	move the update file store to another crate with as little dependencies as possible	2022-10-27 11:33:37 +02:00