Commit Graph

24 Commits

Author SHA1 Message Date
meili-bors[bot] b005eb3289
Merge #4435
4435: Make update file deletion atomic r=Kerollmops a=irevoire

# Pull Request

## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4432
Fixes https://github.com/meilisearch/meilisearch/issues/4438 by adding the logs the user asked

## What does this PR do?
- Adds a bunch of logs to help debug this kind of issue in the future
- Delete the update files AFTER committing the update in the `index-scheduler` (thus, if a restart happens, we are able to re-process the batch successfully)
- Multi-thread the deletion of all update files.


Co-authored-by: Tamo <tamo@meilisearch.com>
2024-02-26 17:54:40 +00:00
Tamo 0562818c2a fix and remove the file-store hack of /dev/null 2024-02-26 13:59:41 +01:00
Tamo 36c27a18a1 implement the dry run ha parameter 2024-02-26 13:58:04 +01:00
Tamo 91cdd502f8 When processing tasks, make the update file deletion atomic 2024-02-22 14:56:22 +01:00
Clément Renault 5869ca7716
Upgrade all compatible dependencies 2024-01-16 15:05:03 +01:00
Kerollmops 47b66e49b8
Upgrade the compatible versions of the dependencies 2023-04-24 17:50:52 +02:00
Tamo 66b5e4b548 fix a bug where the filestore could try to parse its own tmp file and fail 2023-02-23 16:52:41 +01:00
Tamo 74d1a67a99 Use the workspace inheritance feature of rust 1.64 2023-02-15 13:51:07 +01:00
Tamo a858531574 apply review comments 2023-01-25 14:51:36 +01:00
Tamo c92948b143 Compute the size of the auth-controller, index-scheduler and all update files in the global stats 2023-01-25 11:25:02 +01:00
curquiza 026cf223b3 Update version for the next release (v1.0.0) in Cargo.toml files 2022-12-08 12:20:17 +00:00
curquiza 5db7c4057c Update version for the next release (v0.30.1) in Cargo.toml files 2022-12-06 20:05:46 +01:00
curquiza 68f80dbacf Update version for the next release (v0.30.0) in Cargo.toml files 2022-10-27 11:35:44 +00:00
Kerollmops eec43ec953
Implement a first version of the snapshots 2022-10-27 11:35:14 +02:00
Clément Renault 32cfac0cfd
Sort the TOML dependencies 2022-10-27 11:35:05 +02:00
Loïc Lecrenier ea60d35c71
Delete a task's persisted data when appropriate 2022-10-27 11:34:10 +02:00
Loïc Lecrenier eabac9676b
Fix typo and remove useless code in tests 2022-10-27 11:34:00 +02:00
Loïc Lecrenier ab4e649221
Apply suggestions from code review
Co-authored-by: Tamo <tamo@meilisearch.com>
2022-10-27 11:34:00 +02:00
Loïc Lecrenier 13a72f8757
Use more complete snapshot tests for the index scheduler 2022-10-27 11:33:59 +02:00
Irevoire 8770e07397
I can index documents without meilisearch 2022-10-27 11:33:42 +02:00
Tamo 4846a7c501
use faux in the file-store 2022-10-27 11:33:41 +02:00
Tamo 48138c21a9
rename the update-file-store to file-store since it can store any kind of file 2022-10-27 11:33:38 +02:00
Tamo 2afb381f95
get rids of nelson 2022-10-27 11:33:37 +02:00
Tamo a9844bd4f6
move the update file store to another crate with as little dependencies as possible 2022-10-27 11:33:37 +02:00