ManyTheFish
bf144a94d8
No more use FST to find a word without any typo
2025-03-17 14:20:10 +01:00
meili-bors[bot]
cbdf80893d
Merge #5422
...
5422: Add more progress levels to measure merging r=Kerollmops a=Kerollmops
I found out that Meilisearch was not correctly reporting the long indexing times in the progress and that a lot of time was spent on extracting words with all documents already extracted. The reason was that there was no step to report merging the cache and sending the entries to write to the writer thread. This PR adds these entries to the progress.
Co-authored-by: Kerollmops <clement@meilisearch.com>
2025-03-17 12:02:46 +00:00
Kerollmops
e2156ddfc7
Simplify the IndexingStep progress enum
2025-03-17 11:40:50 +01:00
meili-bors[bot]
13a88d6131
Merge #5407
...
5407: Geo update bug r=irevoire a=ManyTheFish
# Pull Request
## Related issue
Fixes #5380
Fixes #5399
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: ManyTheFish <many@meilisearch.com>
2025-03-17 10:24:33 +00:00
Kerollmops
cb16baab18
Add more progress levels to measure merging
2025-03-17 10:13:29 +01:00
Tamo
009c36a4d0
Add support for the progress API of arroy
2025-03-13 19:00:43 +01:00
Louis Dureuil
e2d372823a
Disable the cache by default and make it experimental
2025-03-13 17:22:51 +01:00
Louis Dureuil
1876132172
Mutex-based implementation
2025-03-13 17:22:50 +01:00
Louis Dureuil
b08544e86d
Add embedding cache
2025-03-13 17:22:50 +01:00
Louis Dureuil
d9111fe8ce
Add lru crate to milli again
2025-03-13 17:22:50 +01:00
Kerollmops
5fe02ab5e0
Move to heed 0.22 and arroy 0.6
2025-03-13 15:48:18 +01:00
Tamo
5ef7767429
Let arroy uses all the memory available instead of 50% of the 70%
2025-03-13 15:06:03 +01:00
Clément Renault
a92a48b9b9
Do not recompute stats on dumpless upgrade
...
Co-authored-by: Tamo <tamo@meilisearch.com>
2025-03-13 13:58:58 +01:00
Tamo
d53225bf64
uses a random seed instead of 42
2025-03-13 12:43:31 +01:00
Kerollmops
1af520077c
Call the underlying Env::copy_to_path method
2025-03-13 11:49:25 +01:00
Tamo
ef9d9f8481
set the memory in arroy
2025-03-13 11:29:00 +01:00
Kerollmops
fedb444e66
Fix the upgrade arroy calls
2025-03-13 11:07:49 +01:00
Kerollmops
ff8cf38d6b
Move to the latest version of arroy
2025-03-13 11:07:48 +01:00
Kerollmops
566b4efb06
Dumpless upgrade from v1.13 to v1.14
2025-03-13 11:07:44 +01:00
Kerollmops
1d499ed9b2
Use the new arroy upgrade method to move from 0.4 to 0.5
2025-03-13 11:07:44 +01:00
Kerollmops
3bc62f0549
WIP: Still need to introduce a Env::copy_to_path method
2025-03-13 11:07:39 +01:00
Kerollmops
21bbbdec76
Specify WithoutTls everywhere
2025-03-13 11:07:38 +01:00
Kerollmops
78ebd8dba2
Fix the error variants
2025-03-13 11:07:38 +01:00
Kerollmops
34df44a002
Open Env without TLS
2025-03-13 11:07:38 +01:00
Kerollmops
48a27f669e
Bump heed and other dependencies
2025-03-13 11:07:37 +01:00
Kerollmops
0197dc87e0
Make sure to delete useless prefixes
2025-03-12 11:24:13 +01:00
ManyTheFish
d3cd5ea689
Check if the geo fields changed additionally to the other faceted fields when reindexing facets
2025-03-12 11:20:10 +01:00
ManyTheFish
d500c7f625
Add default deserialize value
2025-03-11 17:55:49 +01:00
ManyTheFish
ea7e299663
Update has_changed_for_fields documentation
2025-03-11 16:48:55 +01:00
ManyTheFish
a370b467fe
Merge MetadataBuilder::_new into MetadataBuilder::new
2025-03-11 15:31:57 +01:00
ManyTheFish
8790880589
Fix clippy
2025-03-11 15:22:39 +01:00
ManyTheFish
7072fe9780
Fix typos in comments and messages
2025-03-11 15:22:00 +01:00
ManyTheFish
6d52c6e711
Merge branch 'main' into granular-filterable-attributes
2025-03-11 10:05:58 +01:00
ManyTheFish
dfb8411647
Revert "Remove filter pre-check"
...
This reverts commit b12ffd13569e1c90f7ae1b3a45211eec4594b0e2.
2025-03-11 09:48:30 +01:00
ManyTheFish
40c5f911fd
Revert metadata creation when computing the facet-distribution
2025-03-10 17:05:41 +01:00
ManyTheFish
abef655849
Revert metadata creation when computing facet search and distinct
2025-03-10 15:45:59 +01:00
ManyTheFish
b12ffd1356
Remove filter pre-check
2025-03-10 14:29:45 +01:00
ManyTheFish
c9a4c6ed96
REvert metadata creation when computing filters at search time
2025-03-10 14:29:44 +01:00
ManyTheFish
689e69d6d2
Take into account PR messages
2025-03-10 13:46:33 +01:00
ManyTheFish
ed1dcbe0f7
Fix behavior change in the Attributes criterion
2025-03-06 14:18:25 +01:00
ManyTheFish
5ceddbda84
Add the max_weight of the weight map if it's lacking
2025-03-06 13:58:28 +01:00
ManyTheFish
ca41ce3bbd
Old indexer document addition now check if facet search is globally activated
2025-03-06 11:43:42 +01:00
ManyTheFish
8ec0c322ea
Apply PR requests related to Refactor the FieldIdMapWithMetadata
2025-03-06 11:42:53 +01:00
ManyTheFish
b88aa9cc76
Rely on FieldIdMapWithMetadata in facet search and filters
2025-03-05 18:22:12 +01:00
meili-bors[bot]
3fd86e8d76
Merge #5371
...
5371: Composite embedders r=irevoire a=dureuill
# Pull Request
## Related issue
Fixes #5343
## What does this PR do?
- Implement [public usage](https://www.notion.so/meilisearch/Composite-embedder-usage-14a4b06b651f81859dc3df21e8cd02a0 )
- Refactor the way we check if a parameter is mandatory/allowed/disallowed for a given source
- Take the "nesting context" into account for computer if a parameter is mandatory/allowed/disallowed
- Add tests checking all parameters with all sources, and made sure the results didn't change compared with v1.13
## Dumpless Upgrade
- This adds a new value for an existing parameter => compatible without change
- This adds new optional parameters => compatible without change
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-03-05 17:18:11 +00:00
ManyTheFish
67f7470c83
Apply PR requests related to Refactor search and facet-search
2025-03-05 18:17:42 +01:00
Louis Dureuil
4fab72cbea
Rename SettingsDiff::diff to SettingsDiff::apply_and_diff
2025-03-05 18:16:57 +01:00
Louis Dureuil
afb4b9677f
Remove Embedder:embed
2025-03-05 18:16:57 +01:00
Louis Dureuil
73d2dbd60f
Error handling
2025-03-05 18:16:57 +01:00
ManyTheFish
63e753bde0
Apply PR requests related to settings API
2025-03-05 12:05:40 +01:00
