544 Commits

Author SHA1 Message Date
Tamo
787472453d
write the version of the index while upgrading it 2025-01-23 16:51:24 +01:00
Tamo
8f65f35de9
rewrite part of the index-scheduler upgrade test 2025-01-23 16:51:23 +01:00
Tamo
c27c923439
introduce a trait to upgrade the indexes 2025-01-23 16:51:23 +01:00
Tamo
fd5649091d
add the upgradeTo field in the details 2025-01-23 16:51:23 +01:00
Tamo
9a57736773
fix the early exit when rewriting a batch 2025-01-23 16:51:23 +01:00
Tamo
7740997ea8
reintroduce the unrecoverable error and use it where its supposed to be used 2025-01-23 16:51:22 +01:00
Tamo
7eb23f73ba
add the version to the index-scheduler snapshots + fix a bug when opening an index scheduler for the first time 2025-01-23 16:51:22 +01:00
Tamo
b9e9fc376a
add the version in the index-scheduler 2025-01-23 16:51:22 +01:00
Tamo
27bf2f1298
remove the empty progress made for the upgrade database 2025-01-23 16:51:22 +01:00
Tamo
d4d82fbd0c
commit the index wtxn before the index-scheduler wtxn 2025-01-23 16:51:21 +01:00
Tamo
eda09a54da
improve the index-scheduler tests 2025-01-23 16:51:21 +01:00
Tamo
b132d70413
fix the details in all cases 2025-01-23 16:51:21 +01:00
Tamo
e41ebd3047
expose the number of database in the index-scheduler and rewrite the lib.rs to use the value provided in the options instead of a magic number 2025-01-23 16:51:21 +01:00
Tamo
705d31e8bd
apply all the comments changes 2025-01-23 16:51:21 +01:00
Tamo
7d95950ce6
fix warning 2025-01-23 16:51:21 +01:00
Tamo
c6b4c21c23
update the snapshots after the rebase 2025-01-23 16:51:20 +01:00
Tamo
bf96fdb858
update the cli url 2025-01-23 16:51:20 +01:00
Tamo
41eeffd88d
fmt 2025-01-23 16:51:20 +01:00
Tamo
1eb9fe8562
remove warnings 2025-01-23 16:51:20 +01:00
Tamo
bac7a1623a
fix the upgrade test 2025-01-23 16:51:19 +01:00
Tamo
5458850d21
write a test ensuring the index-scheduler is effectively down when the upgrade task fail and try to process it when it restarts. There is a bug when deleting this task 2025-01-23 16:51:19 +01:00
Tamo
20ac59c946
fix the field distribution when upgrading from the v1_12 2025-01-23 16:51:19 +01:00
Tamo
cfc1e193b6
update the test with the stats 2025-01-23 16:51:19 +01:00
Tamo
0cc25c7e4c
add a large test importing a data.ms from the v1.12.0 2025-01-23 16:51:18 +01:00
Tamo
102681e384
starts adding tests and fix the starts of meilisearch 2025-01-23 16:51:18 +01:00
Tamo
3ef7a478cd
move the version check to the task queue 2025-01-23 16:48:32 +01:00
Tamo
e70ac35e02
fix bugs after rebase 2025-01-23 16:48:32 +01:00
Tamo
d3654906bf
Add the new tasks with most of the job done 2025-01-23 16:48:32 +01:00
meili-bors[bot]
b15de68831
Merge #5257
5257: Fix ollama r=Kerollmops a=dureuill

Fix oversight in ollama embedder 

WIP Integration tests are on branch `ollama-integration-test` and will be added as a future PR.

Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-22 15:36:15 +00:00
Louis Dureuil
50fca8fc70
Create update files in new format 2025-01-22 15:51:21 +01:00
Kerollmops
b9d92c481b
Update version for the next release (v1.12.6) in Cargo.toml 2025-01-22 15:51:20 +01:00
Kerollmops
d142c5e432
Do not panic when the facet string is not found 2025-01-22 15:50:43 +01:00
Kerollmops
4d4683adb6
Add a test to check the facet casing is good 2025-01-22 15:50:42 +01:00
Louis Dureuil
d6063079af
Unify facet strings by their normalized value 2025-01-22 15:50:42 +01:00
Louis Dureuil
2e04ab4737
Replace guards by OR patterns
Co-authored-by: Tamo <tamo@meilisearch.com>
2025-01-22 15:50:42 +01:00
Louis Dureuil
d95384a636
Remove batch ids on export 2025-01-22 15:50:42 +01:00
Louis Dureuil
c0690f5b9e
Make offline upgrade more flexible 2025-01-22 15:50:42 +01:00
Louis Dureuil
909d84447d
meilitool dumps old-style dump for older DBs, otherwise new-style 2025-01-22 15:50:42 +01:00
Louis Dureuil
2cf57d584e
Handle empty payloads 2025-01-22 15:50:42 +01:00
Kerollmops
59242b9c4f
Fix warnings 2025-01-22 15:50:42 +01:00
Louis Dureuil
6a6212d4e1
Fix warnings 2025-01-22 15:50:42 +01:00
ManyTheFish
a8006a3750
Change format of update file when importing dump 2025-01-22 15:50:41 +01:00
Louis Dureuil
0e0e462f5b
Also fix dump import from meilitool 2025-01-22 15:50:41 +01:00
Louis Dureuil
805531c90d
Do not explode on missing content file if the task has no docs 2025-01-22 15:50:41 +01:00
Louis Dureuil
a6470a0c37
Improve error log 2025-01-22 15:50:41 +01:00
Louis Dureuil
8a54f14b8e
Demote panic to error log 2025-01-22 15:49:24 +01:00
Louis Dureuil
4709c638ed
Swap implementations of ollama 2025-01-20 22:22:22 +01:00
meili-bors[bot]
0776217801
Merge #5234
5234: Parse ollama URL to adapt configuration depending on the endpoint r=Kerollmops a=dureuill

# Pull Request

## Related issue
Fixes #5002 

## What does this PR do?
- Parses `url` parameter of `ollama` to recognize supported endpoint and adapt the REST configuration to the recognized endpoint
- Throws a new error if no endpoint is recognized
- Add a test for the various recognized endpoints


Thanks to `@Guikingone` for the original report and PR

Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-20 09:51:42 +00:00
meili-bors[bot]
c85146524b
Merge #5232
5232: Stabilize vector store feature r=Kerollmops a=dureuill

# Pull Request

## Related issue
Fixes #4733 

## What does this PR do?
- `vectorStore` feature can no longer be set or get from `/experimental-features`
- That feature has been removed, and there is no longer any check for its activation
- Always display `embedders` in the settings, even if empty
- Always hide `_vectors` in documents, unless `retrieveVectors: true`
- Make error codes consistent with the usual nomenclature
- Update tests as needed


Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-16 11:50:21 +00:00
Tamo
445e5aff02
fix the corruption 2025-01-15 12:38:40 +01:00