ManyTheFish
900be0ccad
Extract or regenerate vectors related to settings changes
2025-06-26 18:14:48 +02:00
ManyTheFish
51a087b764
Write back user provided vectors from deleted embedders
2025-06-26 18:14:48 +02:00
ManyTheFish
510a4b91be
Introduce DatabaseDocument type
2025-06-26 18:14:48 +02:00
ManyTheFish
e704f4d1ec
Reimplement reindexing shell
2025-06-26 18:14:48 +02:00
Mubelotix
29f6eeff8f
Remove lots of Arcs
2025-06-26 12:15:08 +02:00
Mubelotix
d08e89ea3d
Remove options
2025-06-24 15:10:15 +02:00
Mubelotix
d7721fe607
Format
2025-06-24 12:20:22 +02:00
Mubelotix
4925b30196
Move embedder stats out of progress
2025-06-23 15:24:14 +02:00
Kerollmops
cb16baab18
Add more progress levels to measure merging
2025-03-17 10:13:29 +01:00
ManyTheFish
ae8d453868
Refactor Document indexing process (searchables)
...
**Changes:**
The searchable database extraction is now relying on the AttributePatterns and FieldIdMapWithMetadata to match the field to extract.
Remove the SearchableExtractor trait to make the code less complex.
**Impact:**
- Document Addition/modification searchable indexing
- Document deletion searchable indexing
2025-03-03 10:32:42 +01:00
ManyTheFish
9f3663e768
Implement Incremental document database stats computing
2025-02-26 17:01:35 +01:00
Kerollmops
76fd5d92d7
Clarify the tail writing to database
2025-02-20 17:35:23 +01:00
Kerollmops
05cc8c650c
Expose the write channel congestion in the batches
2025-02-19 15:47:54 +01:00
Kerollmops
424c5bde40
Move the embedding computation and extraction log to debug
2025-01-29 16:40:36 +01:00
Louis Dureuil
c14967eeac
Use new incremental facet indexing and enable sanity checks in debug
2025-01-09 10:36:35 +01:00
Louis Dureuil
de7f8c4406
refactor indexer mod
2025-01-07 15:29:02 +01:00