searchengines-web/MeiliSearch
searchengines-web/MeiliSearch
1
0
Fork 0
mirror of https://github.com/meilisearch/MeiliSearch synced 2026-03-09 16:35:24 +01:00
Code Issues Releases Wiki Activity
10,129 commits 277 branches 615 tags 214 MiB
Commit graph

1,014 commits

Author SHA1 Message Date
ManyTheFish
974272f2e9 Merge branch 'main' into indexer-edition-2024 2024-09-25 07:41:16 +02:00
Clément Renault
e0c7067355
 		Expose an IndexedParallelIterator to the index function 2024-09-24 17:24:59 +02:00
meili-bors[bot]
462a2329f1
 		Merge #4941 
4941: Implement the binary quantization in meilisearch r=irevoire a=irevoire

# Pull Request

## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4873

## What does this PR do?
- Add a settings for the binary quantization
- Once enabled, the bq cannot be disabled

TODO:
- [ ] Missing a bunch of tests

Co-authored-by: Tamo <tamo@meilisearch.com>
 2024-09-19 15:50:24 +00:00
meili-bors[bot]
bd34ed01d9
 		Merge #4945 
4945: Add swedish in default pipelines r=dureuill a=ManyTheFish

# Summary
## Fix Swedish support

In Swedish the characters `å`/`ä`/`ö` are completely different than `a` or `o`  and should not be normalized as the same character.
because the Swedish specialized pipeline was not activated by default, these characters were normalized even with the settings:
```json
{
  "localizedAttributes": [ { "locales": ["swe"], "attributePatterns": ["*"] } ]
}
```

## Update Charabia adding German support

German segmentation will now be activated using the setting:
```json
{
  "localizedAttributes": [ { "locales": ["deu"], "attributePatterns": ["*"] } ]
}
```

# TODO

- [x] Activate Swedish Pipeline
- [x] Add a test to avoid future regressions
- [x] Update Charabia


Co-authored-by: ManyTheFish <many@meilisearch.com>
 2024-09-19 14:42:03 +00:00
ManyTheFish
465afe01b2 Add test for German 2024-09-19 16:09:01 +02:00
ManyTheFish
7d6768e4c4 Add german tokenization pipeline 2024-09-19 16:09:01 +02:00
ManyTheFish
f77661ec44 Update Charabia v0.9.1 2024-09-19 16:08:59 +02:00
Tamo
fd43c6c404 Improve the error message explaining you can't un-bq an embedder 2024-09-19 15:51:29 +02:00
Tamo
2b120b89e4 update the test now that the embedder must be specified 2024-09-19 12:08:59 +02:00
Tamo
633537ccd7 fix updating documents without updating the settings 2024-09-19 12:00:58 +02:00
Tamo
e8d7c00d30 add a test on the settings value 2024-09-19 12:00:58 +02:00
Tamo
3f6301dbc9 fix the missing embedder name in the error message when trying to disable the binary quantization 2024-09-19 12:00:58 +02:00
Tamo
ca71b63ed1 adds integration tests 2024-09-19 12:00:58 +02:00
Tamo
cc45e264ca implement the binary quantization in meilisearch 2024-09-19 12:00:56 +02:00
meili-bors[bot]
5f474a640d
 		Merge #4938 
4938: Remove default embedder r=ManyTheFish a=dureuill

# Pull Request

## Related issue
Fixes #4738 

## What does this PR do?

[See public usage](https://meilisearch.notion.site/v1-11-AI-search-changes-0e37727193884a70999f254fa953ce6e#1044b06b651f80edb9d4ef6dc367bad0)

- Remove `hybrid.embedder` boolean from analytics because embedder is now mandatory and so the boolean would always be `true`
- Rework search kind so that a search without query but with vector is a vector search regardless of (non-zero) semantic ratio


Co-authored-by: Louis Dureuil <louis@meilisearch.com>
 2024-09-19 09:17:14 +00:00
ManyTheFish
877717cb26 Add a test using Swedish documents 2024-09-19 08:34:04 +02:00
meili-bors[bot]
ff523a2357
 		Merge #4939 
4939: Introduce the `STARTS WITH` filter operator r=irevoire a=Kerollmops

This PR fixes #4872 by introducing the `STARTS WITH` filter operator and gating it under the _contains filter_ experimental feature along with the `CONTAINS` one. I also updated [the experimental feature discussion page](https://github.com/orgs/meilisearch/discussions/763).

Co-authored-by: Clément Renault <clement@meilisearch.com>
 2024-09-18 10:19:48 +00:00
meili-bors[bot]
29c3aca72a
 		Merge #4929 
4929: Add facets support to federated r=Kerollmops a=dureuill

# Pull Request

## Related issue 

- Fixes #4932 (sprint issue)
- Fixes  #4913 (user-opened issue)

## What does this PR do?

See [public usage](https://meilisearch.notion.site/v1-11-Federated-search-59b30e03383c40729d7541a3dffb0069)

> [!CAUTION]
> This PR introduces a 🚨**breaking change**🚨: `queries.facets` when `federation` is present and non-`null` is now **an error**

### Implementation standpoint:

- Facet distribution: fix issue where truncated facet distribution would have a wrong order
- facet distribution: implement Display for OrderBy


Co-authored-by: Louis Dureuil <louis@meilisearch.com>
 2024-09-18 09:47:20 +00:00
Louis Dureuil
00f8d03f43
 		Use f32::min and f32::max 2024-09-18 11:46:10 +02:00
Clément Renault
50981ea778
 		Update the error messages 2024-09-18 11:44:29 +02:00
Louis Dureuil
c2caff1716
 		Remove obsolete enum 2024-09-18 11:26:43 +02:00
Louis Dureuil
174d69ff72
 		Don't override max value in indexes 2024-09-17 18:16:14 +02:00
Louis Dureuil
52a52f97cf
 		Update tests 2024-09-17 17:49:12 +02:00
Louis Dureuil
5de4b48552
 		Fixup error messages 2024-09-17 17:49:00 +02:00
Louis Dureuil
df648ce7a6
 		Update tests 2024-09-17 17:40:14 +02:00
Louis Dureuil
af8edab21d
 		Remove mention of sort order and recommend changing index settings on inconsistent order error 2024-09-17 17:39:51 +02:00
Louis Dureuil
c42746c4cd
 		Update tests 2024-09-17 17:22:14 +02:00
Louis Dureuil
98b77aec66
 		Remove runtime sortFacetValuesBy 2024-09-17 17:22:03 +02:00
Clément Renault
54d3ba3357
 		Fix tests that check error message content 2024-09-17 17:14:39 +02:00
ManyTheFish
6e058709f2 Rustfmt 2024-09-17 17:02:06 +02:00
ManyTheFish
0fbf9ea5b1 Factorize using macro 2024-09-17 17:00:03 +02:00
Louis Dureuil
1120a5296c
 		Update tests 2024-09-17 16:30:43 +02:00
Louis Dureuil
a35a339c3d
 		Touchup error message 2024-09-17 16:30:43 +02:00
Louis Dureuil
cac5836f6f
 		Remove hybrid.embedder boolean from analytics because embedder is now mandatory 2024-09-17 16:30:43 +02:00
Louis Dureuil
5239ae0297
 		Rework search kind so that a search without query but with vector is a vector search regardless of semantic ratio 2024-09-17 16:30:43 +02:00
Louis Dureuil
2fdb1d8018
 		SearchQueryGet can fail 2024-09-17 16:30:43 +02:00
Louis Dureuil
da0dd6febf
 		Make embedder mandatory 2024-09-17 16:30:43 +02:00
ManyTheFish
a197d63ab6 simplify tests 2024-09-17 15:30:12 +02:00
ManyTheFish
390eadb733 Support iso-639-1 2024-09-17 15:01:01 +02:00
Louis Dureuil
d9e0df74ea
 		update test 2024-09-17 10:39:48 +02:00
Louis Dureuil
dc8a662209
 		federated queries: adjust error message 2024-09-17 10:39:48 +02:00
Louis Dureuil
6732dd95d7
 		Update tests 2024-09-17 10:39:48 +02:00
Louis Dureuil
95da428dc8
 		Use route in federated 2024-09-17 10:39:48 +02:00
Louis Dureuil
38c4be1c8e
 		compute_facets accepts Route argument to fixup error code 2024-09-17 10:39:48 +02:00
Louis Dureuil
47e3c4b5c3
 		Add new tests 2024-09-17 10:39:48 +02:00
Louis Dureuil
533f1d4345
 		Federated search: support facets 2024-09-17 10:39:48 +02:00
Louis Dureuil
7b55462610
 		BREAKING CHANGE: errors if queries.facets in federated search 2024-09-17 10:39:48 +02:00
Louis Dureuil
f6114a1ff2
 		Introduce ComputedFacets and compute_facet_distribution_stats 2024-09-17 10:39:48 +02:00
Louis Dureuil
7c084b1286
 		SearchQueriesWithIndex changes 2024-09-17 10:39:47 +02:00
Louis Dureuil
72cc573e0a
 		Add new error types 2024-09-17 10:39:47 +02:00