Commit Graph

4219 Commits

Author SHA1 Message Date
Loïc Lecrenier
ab4e649221
Apply suggestions from code review
Co-authored-by: Tamo <tamo@meilisearch.com>
2022-10-27 11:34:00 +02:00
Loïc Lecrenier
568199fc0d
Add more task deletion tests 2022-10-27 11:33:59 +02:00
Loïc Lecrenier
13a72f8757
Use more complete snapshot tests for the index scheduler 2022-10-27 11:33:59 +02:00
Loïc Lecrenier
4c55c30027
Add a DetailsView type and improve index scheduler snapshots
The DetailsView type is necessary because serde incorrectly
deserialises the `Details` type, so the database fails to correctly
decode Tasks
2022-10-27 11:33:59 +02:00
Loïc Lecrenier
dc81992eb2
Implement TaskDeletion in the index scheduler 2022-10-27 11:33:59 +02:00
Kerollmops
fe84f2648b
Allow a user to disable the auto batching system 2022-10-27 11:33:59 +02:00
Kerollmops
e2a766acb5
Add a test to check that it works without autobatching 2022-10-27 11:33:58 +02:00
Kerollmops
db9d1b18ca
Remove the IndexScheduler::notify method 2022-10-27 11:33:58 +02:00
Kerollmops
19c6f8303f
Make sure that the index-scheduler tick loop is rerun after processing 2022-10-27 11:33:58 +02:00
Kerollmops
b311eb3bed
Add a test that verifies that sending multiple tasks works 2022-10-27 11:33:58 +02:00
Tamo
f026ac3115
remove unused files 2022-10-27 11:33:58 +02:00
Tamo
f176382b34
fix the tests 2022-10-27 11:33:57 +02:00
Tamo
4bd9e4d723
write a bunch of tests that goes through the whole compat layers 2022-10-27 11:33:57 +02:00
Tamo
c6f4fb5f7d
remove the warnings 2022-10-27 11:33:57 +02:00
Tamo
2ae0806773
rewrite the update file API 2022-10-27 11:33:57 +02:00
Tamo
7579a363ab
finish the dump reader API, the dump Writer API now needs to be updated 2022-10-27 11:33:57 +02:00
Tamo
0284764b5e
start dumping the update files to a known format 2022-10-27 11:33:56 +02:00
Tamo
9117fde712
fix the compat between v3 and v4 2022-10-27 11:33:56 +02:00
Tamo
f622ef9836
remove the ununsed snapshot files 2022-10-27 11:33:56 +02:00
Tamo
dc0f307d61
remove all warnings 2022-10-27 11:33:56 +02:00
Tamo
06fadb3004
write the compat layer from v2 to v3 2022-10-27 11:33:55 +02:00
Tamo
6107540ad4
remove old compat files 2022-10-27 11:33:55 +02:00
Tamo
7e18f92635
write the dump v2 import 2022-10-27 11:33:55 +02:00
Tamo
43496b97bd
make the open function public 2022-10-27 11:33:55 +02:00
Tamo
6f327a00c7
fix some warnings 2022-10-27 11:33:55 +02:00
Tamo
58ef80a2a7
rebase on main 2022-10-27 11:33:54 +02:00
Tamo
22ffbf3676
write and test the compat layer from v3 to v4 2022-10-27 11:33:54 +02:00
Tamo
089106a970
write and test the dump v3 import 2022-10-27 11:33:54 +02:00
Tamo
026f6fb06a
fix the test once again 2022-10-27 11:33:54 +02:00
Tamo
efe0a5f422
finish the test for the compatibility between v4 and v5 2022-10-27 11:33:53 +02:00
Tamo
47e0288747
rewrite the compat API to something more generic 2022-10-27 11:33:53 +02:00
Tamo
2f47443458
rename a few things for consistency 2022-10-27 11:33:53 +02:00
Tamo
a8128678a4
implement the dump v4 import 2022-10-27 11:33:53 +02:00
Tamo
c50b44039e
add the compat layer between v5 and v6 2022-10-27 11:33:53 +02:00
Tamo
6dcc5851b5
get rids of the trait in most places 2022-10-27 11:33:52 +02:00
Tamo
0972587cfc
start writting the compat layer between v5 and v6 2022-10-27 11:33:52 +02:00
Tamo
afd5fe0783
test the dump v5 2022-10-27 11:33:52 +02:00
Tamo
1473a71e33
write the v5 dump import 2022-10-27 11:33:52 +02:00
Tamo
101f55ce8b
introduce the index metadata 2022-10-27 11:33:52 +02:00
Tamo
e845cc2b6f
fix the tests 2022-10-27 11:33:51 +02:00
Tamo
7bd6f63001
implement the dump reader v6 2022-10-27 11:33:51 +02:00
Tamo
699ae1b190
start implementing a skeleton of the v1 dump reader 2022-10-27 11:33:51 +02:00
Tamo
f041d474a5
move the DumpWriter and Error to their own module 2022-10-27 11:33:51 +02:00
Tamo
ece6c3f6e7
fix the dump export 2022-10-27 11:33:51 +02:00
Tamo
87a6a337aa
write a dump exporter 2022-10-27 11:33:51 +02:00
Clément Renault
123f47dbc4
Create the index only if the task has the rights to do so 2022-10-27 11:33:50 +02:00
Clément Renault
068a4b2884
Correctly batch tasks with different index creation rights 2022-10-27 11:33:50 +02:00
Clément Renault
87212cfd20
Use a ControlFlow in the autobatcher function 2022-10-27 11:33:50 +02:00
Kerollmops
f1b1cfdbcc
IndexDeletion operation have ClearAll details 2022-10-27 11:33:50 +02:00
Kerollmops
a083c9e452
Only mark the first clear document with the amount of cleared documents 2022-10-27 11:33:50 +02:00