ManyTheFish
77802dabf6
rename DocumentChangeContext into DocumentContext
2025-06-26 18:14:48 +02:00
nnethercott
1811168b96
remove duplicated check on geo field changes
2025-05-28 15:45:13 +02:00
Nate Nethercott
b06cc1e0a2
Update crates/milli/src/update/new/extract/faceted/extract_facets.rs
...
Co-authored-by: Many the fish <many@meilisearch.com>
2025-05-28 15:38:23 +02:00
Nate Nethercott
44f812c36d
Update crates/milli/src/update/new/extract/faceted/extract_facets.rs
...
Co-authored-by: Many the fish <many@meilisearch.com>
2025-05-28 15:38:12 +02:00
nnethercott
9ad43b6841
rename has_changed to has_changed_for_facets
2025-05-26 18:37:20 +02:00
nnethercott
c9ec502ed9
refactor for readability
2025-05-26 18:32:59 +02:00
nnethercott
18aed75d3b
fix logic
2025-05-26 18:20:55 +02:00
nnethercott
6738a4f6ee
feat: mettre a jour the insta snapshots
2025-05-26 16:36:36 +02:00
nnethercott
95821d0bde
refactor: update macro
2025-05-26 10:07:13 +02:00
nnethercott
f690fa0686
feat: add macro_rules to factorize
2025-05-26 09:46:14 +02:00
nnethercott
24e94b28c1
feat: uncouple geo extraction from full doc
2025-05-26 09:22:20 +02:00
Tamo
b025f1bcf1
Merge branch 'main' into release-v1.14.0-tmp
2025-04-14 12:35:47 +02:00
Clément Renault
4d90e3d2ec
Make Cargo and Clippy happy
2025-04-01 11:26:34 +02:00
ManyTheFish
d3cd5ea689
Check if the geo fields changed additionally to the other faceted fields when reindexing facets
2025-03-12 11:20:10 +01:00
ManyTheFish
8790880589
Fix clippy
2025-03-11 15:22:39 +01:00
ManyTheFish
689e69d6d2
Take into account PR messages
2025-03-10 13:46:33 +01:00
ManyTheFish
95bccaf5f5
Refactor Document indexing process (Facets)
...
**Changes:**
The Documents changes now take a selector closure instead of a list of field to match the field to extract.
The seek_leaf_values_in_object function now uses a selector closure of a list of field to match the field to extract
The facet database extraction is now relying on the FilterableAttributesRule to match the field to extract.
The facet-search database extraction is now relying on the FieldIdMapWithMetadata to select the field to index.
The facet level database extraction is now relying on the FieldIdMapWithMetadata to select the field to index.
**Important:**
Because the filterable attributes are patterns now,
the fieldIdMap will only register the fields that exists in at least one document.
if a field doesn't exist in any document, it will not be registered even if it has been specified in the filterable fields.
**Impact:**
- Document Addition/modification facet indexing
- Document deletion facet indexing
2025-03-03 10:32:03 +01:00
Louis Dureuil
d6063079af
Unify facet strings by their normalized value
2025-01-22 15:50:42 +01:00
Louis Dureuil
de7f8c4406
refactor indexer mod
2025-01-07 15:29:02 +01:00
Tamo
df9b68f8ed
inital implementation of the progress
2024-12-11 16:25:01 +01:00
Louis Dureuil
fa8b9acdf6
Ignore documents that didn't change in facets
2024-12-05 16:12:52 +01:00
Clément Renault
08d6413365
Fix result types
2024-11-27 14:32:42 +01:00
Clément Renault
70802eb7c7
Fix most issues with the lifetimes
2024-11-27 14:32:42 +01:00
Clément Renault
56c7c5d5f0
Fix comments
2024-11-20 13:16:44 +01:00
Louis Dureuil
f893b5153e
Don't mark [""] as empty facet
2024-11-20 13:16:42 +01:00
Louis Dureuil
ca779c21f9
facets: Handle boolean and skip empty strings
2024-11-20 13:16:42 +01:00
Louis Dureuil
8049df125b
Add depth to facet extraction so that null inside an array doesn't mark the entire field as null
2024-11-20 13:16:40 +01:00
Louis Dureuil
c782c09208
Move step to a dedicated mod and replace it with an enum
2024-11-18 18:22:13 +01:00
Louis Dureuil
04c38220ca
Move MostlySend, ThreadLocal, FullySend to their own commit
2024-11-18 16:43:05 +01:00
Louis Dureuil
5f93651cef
fixes
2024-11-18 16:23:11 +01:00
Clément Renault
5b4c06c24c
Plug the grenad max memory parameter
2024-11-18 11:28:04 +01:00
Clément Renault
8e5b1a3ec1
Compute the field distribution and convert _geo into an f64s
2024-11-13 17:44:05 +01:00
ManyTheFish
e627e182ce
Fix facet strings
2024-11-13 17:43:02 +01:00
ManyTheFish
51b6293738
Add linear facet databases
2024-11-13 17:43:02 +01:00
Clément Renault
b17896d899
Finialize the GeoExtractor
2024-11-13 17:43:02 +01:00
Clément Renault
0e4e9e866a
Move the RefCellExt trait in a dedicated module
2024-11-07 11:36:09 +01:00
Louis Dureuil
10f49f0d75
Post processing of the merge
2024-11-06 17:50:12 +01:00
Louis Dureuil
ee03743355
Merge branch 'indexer-edition-2024' into indexer-edition-2024-doc-chunks
2024-11-06 15:50:53 +01:00
ManyTheFish
10feeb88f2
Merge branch 'main' into indexer-edition-2024
2024-11-06 15:19:18 +01:00
