MeiliSearch/crates
meili-bors[bot] 796acd1aee
Merge #5288
5288: Improve AI logging r=dureuill a=Kerollmops

This PR fixes #5285 and brings the changes from #5233 to simplify debugging indexation and search performance issues related to AI. The following texts can be found in the logs to debug and understand performance issues:

 - `embed_one: search` represents the time we spent waiting for the embedding generation, i.e., OpenAI, local HuggingFace, Ollama.
 - `filtered_universe: search::universe` the time spent filtering the documents.
 - ~`next_bucket: search::vector_sort` is the time spent finding the nearest neighbors (ANNs) in the vector store (arroy), locally~ was being triggered too many times.
 - `indexing::vectors` is the time arroy spends indexing the new vectors for a batch.
 - `documents::extract vectors` and `documents::merge vectors` to see the time spent generating and writing the embeddings.

Co-authored-by: Kerollmops <clement@meilisearch.com>
2025-02-04 10:20:45 +00:00
..
benchmarks fix the bad index version on opening 2025-01-23 16:51:24 +01:00
build-info Upgrade compatible dependencies 2025-01-08 13:52:14 +01:00
dump Add the new tasks with most of the job done 2025-01-23 16:48:32 +01:00
file-store Upgrade incompatible dependencies 2025-01-08 15:58:03 +01:00
filter-parser Fix insta to 1.39 2025-01-08 15:18:08 +01:00
flatten-serde-json Move crates under a sub folder to clean up the code 2024-10-21 08:18:43 +02:00
fuzzers fix the bad index version on opening 2025-01-23 16:51:24 +01:00
index-scheduler Add a link to the experimental feature GitHub discussion 2025-02-03 10:24:53 +01:00
json-depth-checker Move crates under a sub folder to clean up the code 2024-10-21 08:18:43 +02:00
meili-snap Upgrade compatible dependencies 2025-01-08 13:52:14 +01:00
meilisearch Fix test 2025-02-03 10:36:34 +01:00
meilisearch-auth Upgrade incompatible dependencies 2025-01-08 15:58:03 +01:00
meilisearch-types store the enqueued at to eases the batch deletion 2025-01-28 16:53:50 +01:00
meilitool Merge #5235 2025-02-03 10:11:01 +00:00
milli Merge #5288 2025-02-04 10:20:45 +00:00
permissive-json-pointer Add indices field to _matchesPosition to specify where in an array a match comes from (#5005) 2024-11-20 01:00:43 +01:00
tracing-trace Upgrade compatible dependencies 2025-01-08 13:52:14 +01:00
xtask Fix after upgrading sysinfo 2025-01-08 15:59:30 +01:00