meili-bors[bot]
fe46855462
Merge #5235
...
5235: Introduce a compaction subcommand in meilitool r=dureuill a=Kerollmops
This PR proposes a change to the meilitool helper, introducing the `compact-index` subcommand to reduce the size of the indexes.
While working on this tool, I discovered that the current heed `Env::copy_to_file` API is not very temp file friendly and [could be improved](https://github.com/meilisearch/heed/issues/306 ).
Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: Clément Renault <clement@meilisearch.com>
2025-02-03 10:11:01 +00:00
Kerollmops
8e7d2d25f2
Only open indexes, do not create them
2025-02-03 10:50:38 +01:00
Kerollmops
2385842537
Fix the imports
2025-02-03 10:29:09 +01:00
Kerollmops
62ced0e3f1
Make cargo fmt happy
2025-01-30 11:09:54 +01:00
Clément Renault
71bb24f17e
Throw and error when the index is not found
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-30 11:07:43 +01:00
Clément Renault
c72f114b33
Fix english in the comments
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-30 11:07:09 +01:00
Louis Dureuil
50280bf02b
Support offline upgrade up to v1.12.7
2025-01-24 12:25:33 +01:00
Louis Dureuil
86bf231d29
Change to meilitool after rebase
2025-01-23 16:59:32 +01:00
Tamo
7197ced673
fix the bad index version on opening
2025-01-23 16:51:24 +01:00
Tamo
102681e384
starts adding tests and fix the starts of meilisearch
2025-01-23 16:51:18 +01:00
Kerollmops
e6295c9c5f
Introduce a meilitool subcommand to compact an index
2025-01-22 16:37:00 +01:00
Louis Dureuil
2e04ab4737
Replace guards by OR patterns
...
Co-authored-by: Tamo <tamo@meilisearch.com>
2025-01-22 15:50:42 +01:00
Louis Dureuil
d95384a636
Remove batch ids on export
2025-01-22 15:50:42 +01:00
Louis Dureuil
c0690f5b9e
Make offline upgrade more flexible
2025-01-22 15:50:42 +01:00
Louis Dureuil
909d84447d
meilitool dumps old-style dump for older DBs, otherwise new-style
2025-01-22 15:50:42 +01:00
ManyTheFish
a8006a3750
Change format of update file when importing dump
2025-01-22 15:50:41 +01:00
Louis Dureuil
0e0e462f5b
Also fix dump import from meilitool
2025-01-22 15:50:41 +01:00
Louis Dureuil
72ded27e98
Update after review
2025-01-14 10:24:50 +01:00
Louis Dureuil
c25781f720
Skip rebuilding field distribution if not coming from v1.12
2025-01-14 10:24:28 +01:00
Louis Dureuil
c3b18fede9
write stats after rebuilding facet distribution
2025-01-14 10:24:27 +01:00
Louis Dureuil
4070895a21
Add support to upgrade to v1.12.3 in meilitool
2025-01-14 10:24:27 +01:00
Tamo
8cd3a1aa57
fmt
2024-12-11 18:18:40 +01:00
Many the fish
5c492031d9
Update crates/meilitool/src/upgrade/v1_12.rs
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-12-11 14:34:18 +01:00
ManyTheFish
c614d0dd35
Add context when returning an error
2024-12-11 10:55:39 +01:00
ManyTheFish
479607e5dd
Convert update files from OBKV to ndjson
2024-12-11 10:55:39 +01:00
Louis Dureuil
6e6acfcf1b
Merge branch 'main' into indexer-edition-2024
2024-11-20 16:59:58 +01:00
Tamo
7e379b3d14
remove useless prints
2024-11-20 12:27:12 +01:00
Louis Dureuil
10f49f0d75
Post processing of the merge
2024-11-06 17:50:12 +01:00
Tamo
7415ef7ff5
Update crates/meilitool/src/upgrade/v1_11.rs
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-11-05 15:37:59 +01:00
Tamo
0f74a93346
Update crates/meilitool/src/upgrade/v1_11.rs
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-11-05 15:14:02 +01:00
Tamo
e4993aa705
Update crates/meilitool/src/upgrade/mod.rs
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-11-05 15:13:50 +01:00
Tamo
66b7e0824e
Update crates/meilitool/src/upgrade/mod.rs
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-11-05 15:13:40 +01:00
Tamo
f193c3a67c
Update crates/meilitool/src/main.rs
...
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-11-05 15:13:32 +01:00
Tamo
48ab898ca2
fix the datetime of v1.9
2024-11-05 10:30:53 +01:00
Tamo
99a9fde37f
push back the removed files
2024-11-04 17:55:55 +01:00
Tamo
362836efb7
make an upgrade module where we'll be able to shove each version instead of putting everything in the same file
2024-11-04 17:47:10 +01:00
Clément Renault
9c1e54a2c8
Move crates under a sub folder to clean up the code
2024-10-21 08:18:43 +02:00
