Louis Dureuil
72b9005344
Redact uid for Value
2024-07-31 17:57:13 +02:00
Louis Dureuil
ab1ec9ca21
Add tokenized test
2024-07-31 15:03:45 +02:00
Louis Dureuil
9d6efd92d2
new assets for tokenized test
2024-07-31 15:03:45 +02:00
Louis Dureuil
abdb337fd6
Add openai tests
2024-07-31 15:03:45 +02:00
Louis Dureuil
1c755c8899
Add openai responses
2024-07-31 15:03:45 +02:00
Louis Dureuil
3a42c3134e
update tests after changing authorized error message
2024-07-31 15:03:45 +02:00
Tamo
b1b3a1a98b
add a get, set and put test for the localized attributes setting
2024-07-30 15:51:02 +02:00
Tamo
c457069367
ensure a test is 100% not flaky
2024-07-30 15:41:51 +02:00
Tamo
bb1283222e
make clippy happy
2024-07-30 15:10:56 +02:00
Tamo
7a5a38f870
fix a sync issue on empty indexes
2024-07-30 15:09:12 +02:00
Tamo
ded3cd0dd6
an additionnal 30% of perf for the tests
2024-07-30 15:03:54 +02:00
Tamo
68f885f1c4
fix two snapshots
2024-07-30 14:45:59 +02:00
Tamo
9372c34dab
prepare the tests to share indexes with api key
2024-07-30 14:34:11 +02:00
Tamo
6666c57880
reduce the number of thread spawned by milli
2024-07-30 14:34:10 +02:00
Tamo
b53a019b07
fix the initialization problem over the shared indexes with documents
2024-07-30 14:24:57 +02:00
Tamo
d262b1df32
craft an API over the Shared Server and Shared index to avoid hard to debug mistakes
2024-07-30 14:24:57 +02:00
Tamo
ed795bc837
fmt
2024-07-30 14:24:57 +02:00
Tamo
993264227d
reuse an index with already indexed documents instead of reindexing from scratch
2024-07-30 14:24:57 +02:00
Tamo
953d3a44bd
make the new_shared function synchronous and stop indexing documents when it's not required
2024-07-30 14:24:57 +02:00
Tamo
e5345fb0eb
shave off 15s by providing a shared instance to the integration tests
2024-07-30 14:24:55 +02:00
Louis Dureuil
8532fe8afc
Fix tests
2024-07-25 12:10:32 +02:00
Louis Dureuil
6c598fa06d
test custom headers
2024-07-25 12:01:51 +02:00
Louis Dureuil
8338df0dbe
Fix tests
2024-07-25 12:01:51 +02:00
Louis Dureuil
22ef2d877f
Ensure test server has a single indexing thread
2024-07-25 12:01:51 +02:00
Louis Dureuil
59115fd058
Fix tests
2024-07-25 10:52:57 +02:00
ManyTheFish
a918561ac1
Fix PR comments
2024-07-25 10:52:56 +02:00
ManyTheFish
d82f8fd904
Add tests
2024-07-25 10:51:27 +02:00
Tamo
988552e178
add tests on the rest embedder
2024-07-24 14:34:17 +02:00
meili-bors[bot]
ea73615abf
Merge #4804
...
4804: Implements the experimental contains filter operator r=irevoire a=irevoire
# Pull Request
Related PRD: (private link) https://www.notion.so/meilisearch/Contains-Like-Filter-Operator-0d8ad53c6761466f913432eb1d843f1e
Public usage page: https://meilisearch.notion.site/Contains-filter-operator-usage-3e7421b0aacf45f48ab09abe259a1de6
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/3613
## What does this PR do?
- Extract the contains operator from this PR: https://github.com/meilisearch/meilisearch/pull/3751
- Gate it behind a feature flag
- Add tests
Co-authored-by: Tamo <tamo@meilisearch.com>
2024-07-17 15:47:11 +00:00
Tamo
02c61eabfa
fix the range reported when the experimental feature has not been set
2024-07-17 16:54:33 +02:00
Tamo
2af9481804
Implements the experimental contains filter operator«
2024-07-17 11:13:37 +02:00
Louis Dureuil
8d6ac261ae
Add tests on various failure modes for embedders
2024-07-16 13:39:02 +02:00
Louis Dureuil
b4c8b01c88
Update existing snapshots
2024-07-16 13:39:01 +02:00
Louis Dureuil
a61b852695
Add tests
2024-07-15 08:43:21 +02:00
Clément Renault
487997f6ad
Support the new editDocumentsByFunction experimental feature
2024-07-10 16:29:18 +02:00
Clément Renault
f07256971a
Fix tests
2024-07-10 16:28:14 +02:00
Tamo
9feba5028d
update byte-unit
2024-07-09 23:41:29 +02:00
Tamo
4aa7d386d8
remove http and uses actix_web::http instead
2024-07-08 21:17:10 +02:00
Tamo
3d9befd64f
fix warning
2024-07-02 15:30:16 +02:00
Tamo
ee14d5196c
fix the tests
2024-07-02 15:18:30 +02:00
ManyTheFish
015d90a962
merge main
2024-07-01 11:50:36 +02:00
Louis Dureuil
e53de15b8e
Fix behavior of limit and offset for hybrid search when keyword results are returned early
...
The test is fixed
2024-06-27 14:25:33 +02:00
Louis Dureuil
8c4921b9dd
Add failing test on limit+offset for hybrid search
2024-06-27 14:21:34 +02:00
Tamo
ce08dc509b
add more tests and improve the location of the error
2024-06-27 11:51:45 +02:00
Tamo
1daaed163a
Make _vectors.:embedding.regenerate mandatory + tests + error messages
2024-06-27 11:04:58 +02:00
meili-bors[bot]
809e742253
Merge #4731
...
4731: Fix the missing geo distance when one or both of the lat / lng are string r=irevoire a=irevoire
# Pull Request
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4193
## What does this PR do?
- Properly extract the lat / lng when one or both of them are string
- Add a test
Co-authored-by: Tamo <tamo@meilisearch.com>
2024-06-27 07:33:22 +00:00
meili-bors[bot]
decdfe03bc
Merge #4724
...
4724: Improve tenant token error messages r=ManyTheFish a=irevoire
# Pull Request
## Related issue
Fixes #4727
## What does this PR do?
- Introduce a bunch of new error messages around tenant tokens
- Ignore the error messages in most tests that were doing for loop over multiple kinds of errors
- Introduce new tests that specifically test these error messages
Co-authored-by: Tamo <tamo@meilisearch.com>
2024-06-27 06:47:40 +00:00
Tamo
a108d8f6f3
update yaup
2024-06-26 16:03:51 +02:00
Tamo
eb292a7a62
Fix the missing geo distance when one or both of the lat / lng are string
2024-06-26 14:50:15 +02:00
meili-bors[bot]
1e4699b82c
Merge #4716
...
4716: Fix bad http status and error message on wrong payload r=irevoire a=Karribalu
# Pull Request
## Related issue
Fixes #4698
## What does this PR do?
- Fixes bad http status when bad payload with gzip Content-Encoding
## PR checklist
Please check if your PR fulfills the following requirements:
- [x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
- [x] Have you read the contributing guidelines?
- [x] Have you made sure that the title is accurate and descriptive of the changes?
Thank you so much for contributing to Meilisearch!
Co-authored-by: karribalu <karri.balu123456@gmail.com>
2024-06-26 08:00:51 +00:00
meili-bors[bot]
2c09c324f7
Merge #4730
...
4730: fix a possibly flaky test r=irevoire a=irevoire
On slow CI, it was possible for a document addition to _not_ to be processed and then get autobatched with an index deletion, which changed their task summary details in the end.
Now, I wait for the task to finish, and the result will always be the same
Co-authored-by: Tamo <tamo@meilisearch.com>
2024-06-26 07:32:51 +00:00
Tamo
3d6b61d8d2
fix flakyness for real
2024-06-26 09:24:09 +02:00
Tamo
1374b661d1
fix a possibly flaky test
2024-06-26 09:14:59 +02:00
karribalu
2608a596a0
Update error message and add tests for incomplete compressed document
2024-06-25 18:36:29 +01:00
JWSong
6fb36ed30e
get rid of the redundant info in document_addition_with_huge_int_primary_key
2024-06-25 23:54:27 +09:00
JWSong
dcdc83946f
accept large number as string
2024-06-25 21:41:47 +09:00
Tamo
7da21bb601
introduce as many custom error message as possible
2024-06-25 12:40:51 +02:00
Tamo
a74fb87d1e
start introducing new error messages
2024-06-24 19:00:53 +02:00
Tamo
558b66e535
makes most tests works with variable error messages
2024-06-24 19:00:44 +02:00
Tamo
606e108420
fix all the flaky snapshots
2024-06-24 11:13:45 +02:00
Tamo
7be17b7e4c
add the missing snapshots
2024-06-24 10:52:57 +02:00
Tamo
1693332cab
Update arroy and always build the tree that need to be built
2024-06-24 10:14:03 +02:00
meili-bors[bot]
e580d6b98f
Merge #4693
...
4693: Introduce distinct attributes at search time r=irevoire a=Kerollmops
This PR fixes #4611 .
### To Do
- [x] Remove the `distinguishableAttributes` settings (not even a commit about that).
- [x] Use the `filterableAttributes` to be able to use the `distinct` parameter at search.
- [x] Work on the errors and make tests.
Co-authored-by: Clément Renault <clement@meilisearch.com>
Co-authored-by: Tamo <tamo@meilisearch.com>
2024-06-18 07:45:03 +00:00
Tamo
8ba65e333b
add snapshot files
2024-06-17 16:50:26 +02:00
Tamo
43875e6758
fix bug around nested fields
2024-06-17 15:59:30 +02:00
Tamo
d7844a6e45
add a bunch of tests on the errors of the distinct at search time
2024-06-17 15:37:32 +02:00
meili-bors[bot]
e9bf4c43a4
Merge #4649
...
4649: Don't store the vectors in the documents database r=dureuill a=irevoire
# Pull Request
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4607
## What does this PR do?
- Ensure that anything falling under `_vectors` is NOT searchable, filterable or sortable
- [x] per embedder, add a roaring bitmap of documents that provide "userProvided" embeddings
- [x] in the indexing process in extract_vector_points, set the bit corresponding to the document depending on the "userProvided" subfield in the _vectors field.
- [x] in the document DB in typed chunks, when writing the _vectors field, remove all keys corresponding to an embedder
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-06-17 12:32:03 +00:00
Louis Dureuil
09d9b63e1c
- test case where all vectors were generated
...
- update tests following changes in behavior from previous commit
2024-06-13 17:16:41 +02:00
Tamo
6bf07d969e
add failing test
2024-06-13 15:49:42 +02:00
Louis Dureuil
3f212a8202
Update tests
2024-06-12 18:13:34 +02:00
Louis Dureuil
fca9fe39b3
Update test snapshots
2024-06-12 14:50:55 +02:00
Tamo
3493093c4f
add a batch of tests
2024-06-11 16:03:54 +02:00
Tamo
600e97d9dc
gate the retrieveVectors parameter behind the vectors feature flag
2024-06-10 18:26:12 +02:00
ManyTheFish
57d066595b
fix Tests almost all features
2024-06-06 17:24:50 +02:00
Tamo
734d1c53ad
fix a panic in yaup
2024-06-06 16:31:07 +02:00
Tamo
2cdcb703d9
fix the deletion of vectors and add a test
2024-06-06 11:39:29 +02:00
Tamo
6607875f49
add the retrieveVectors parameter to the get and fetch documents route
2024-06-06 11:39:29 +02:00
Tamo
31a793d226
fix the regeneration of the embeddings in the search
2024-06-06 11:39:29 +02:00
Tamo
49fa41ce65
apply first round of review comments
2024-06-06 11:39:29 +02:00
Tamo
400cf3eb92
add api error test on the new retrieveVectors parameter
2024-06-06 11:39:29 +02:00
Tamo
d92c173fdc
update the new similar tests
2024-06-06 11:39:29 +02:00
Tamo
6b29676e7e
update snapshots
2024-06-06 11:39:29 +02:00
Tamo
cc5dca8321
fix two bug and add a dump test
2024-06-06 11:39:29 +02:00
Tamo
5d50850e12
always push the user defined vectors in arroy
2024-06-06 11:39:29 +02:00
Tamo
04f6523f3c
expose a new parameter to retrieve the embedders at search time
2024-06-06 11:36:11 +02:00
meili-bors[bot]
fc584f1db3
Merge #4666
...
4666: Add a score threshold search parameter r=ManyTheFish a=dureuill
# Pull Request
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4609
## What does this PR do?
- See [usage](https://meilisearch.notion.site/Filter-by-score-usage-224a183ce7b24ca99b6a9a8da755668a?pvs=25#95b76ded400342ba9ab3d67c734836f0 ) and [the known limitation](https://meilisearch.notion.site/Filter-by-score-usage-224a183ce7b24ca99b6a9a8da755668a?pvs=25#e4e32195bf0e4195b5daecdbb7a97a17 )
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-06-03 08:42:44 +00:00
meili-bors[bot]
d6bd88ce4f
Merge #4667
...
4667: Frequency matching strategy r=Kerollmops a=ManyTheFish
# Pull Request
## Related issue
Fixes #3773
## What does this PR do?
- add test for matching strategy
- implement frequency matching strategy
See the [PRD for more details](https://www.notion.so/meilisearch/Frequency-Matching-Strategy-0f3ba08833a442a39590a53a1505ab00 ).
[Public API](https://www.notion.so/meilisearch/frequency-matching-strategy-89868fb7fc584026bc56e378eb854a7f ).
Co-authored-by: ManyTheFish <many@meilisearch.com>
2024-05-30 14:53:31 +00:00
ManyTheFish
3f1a510069
Add tests and fix matching strategy
2024-05-30 12:02:42 +02:00
Louis Dureuil
41976b82b1
Tests for ranking_score_threshold
2024-05-30 11:22:26 +02:00
ManyTheFish
1ab88e10b9
Merge branch 'main' into merge-release-v1.8.1-in-main
2024-05-29 16:24:00 +02:00
Louis Dureuil
2cf3e1c80a
Temporarily ignore perform snapshot test under Windows
2024-05-29 12:42:47 +02:00
Many the fish
e1fbfde6c4
Merge branch 'main' into merge-release-v1.8.1-in-main
2024-05-29 11:31:03 +02:00
Louis Dureuil
ca006e38ec
Basic tests
2024-05-28 15:28:19 +02:00
Louis Dureuil
e26bd87780
Error tests for similar routes
2024-05-28 15:28:19 +02:00
Louis Dureuil
c01e498a63
Test server can call similar
2024-05-28 15:28:19 +02:00
Clément Renault
487431a035
Fix tests
2024-05-27 16:12:20 +02:00
meili-bors[bot]
19acc65ad2
Merge #4646
...
4646: Reduce `Transform`'s disk usage r=Kerollmops a=Kerollmops
This PR implements what is described in #4485 . It reduces the number of disk writes and disk usage.
Co-authored-by: Clément Renault <clement@meilisearch.com>
2024-05-23 16:06:50 +00:00
Clément Renault
fe17c0f52e
Construct the minimal OBKVs according to the settings diff
2024-05-23 11:23:57 +02:00
ManyTheFish
3e94a90722
Fixes
2024-05-21 13:39:46 +02:00
Louis Dureuil
afcd7b9f0c
Test hybrid search with hf embedder
2024-05-20 14:44:10 +02:00
