mirror of
https://github.com/meilisearch/MeiliSearch
synced 2025-07-04 20:37:15 +02:00
![]() 5288: Improve AI logging r=dureuill a=Kerollmops This PR fixes #5285 and brings the changes from #5233 to simplify debugging indexation and search performance issues related to AI. The following texts can be found in the logs to debug and understand performance issues: - `embed_one: search` represents the time we spent waiting for the embedding generation, i.e., OpenAI, local HuggingFace, Ollama. - `filtered_universe: search::universe` the time spent filtering the documents. - ~`next_bucket: search::vector_sort` is the time spent finding the nearest neighbors (ANNs) in the vector store (arroy), locally~ was being triggered too many times. - `indexing::vectors` is the time arroy spends indexing the new vectors for a batch. - `documents::extract vectors` and `documents::merge vectors` to see the time spent generating and writing the embeddings. Co-authored-by: Kerollmops <clement@meilisearch.com> |
||
---|---|---|
.. | ||
documents | ||
facet | ||
fields_ids_map | ||
heed_codec | ||
prompt | ||
search | ||
snapshots/index.rs | ||
update | ||
vector | ||
asc_desc.rs | ||
constants.rs | ||
criterion.rs | ||
error.rs | ||
external_documents_ids.rs | ||
fieldids_weights_map.rs | ||
fields_ids_map.rs | ||
index.rs | ||
lib.rs | ||
localized_attributes_rules.rs | ||
order_by_map.rs | ||
progress.rs | ||
proximity.rs | ||
score_details.rs | ||
snapshot_tests.rs | ||
thread_pool_no_abort.rs |