mirror of
https://github.com/meilisearch/MeiliSearch
synced 2024-12-02 17:45:46 +01:00
049bd45849
4371: Fixes embedder issues r=irevoire a=dureuill # Pull Request ## Related issue Fixes #4361 Fixes #4370 ## What does this PR do? - Truncate tokens to 512 for Hugging Face embedders - Move the tokio runtime to OpenAI so that we no longer have a thread with rayon -> tokio -> rayon - Spawn a new reqwest client after each new runtime to avoid spurious runtime error ## Manual tests - embedding failing document from `@CaroFG` with hugging face - embedding movies with hugging face - embedding and searching movies with openai Co-authored-by: Louis Dureuil <louis@meilisearch.com> |
||
|---|---|---|
| .. | ||
| documents | ||
| facet | ||
| heed_codec | ||
| prompt | ||
| search | ||
| snapshots/index.rs | ||
| update | ||
| vector | ||
| asc_desc.rs | ||
| criterion.rs | ||
| error.rs | ||
| external_documents_ids.rs | ||
| fields_ids_map.rs | ||
| index.rs | ||
| lib.rs | ||
| proximity.rs | ||
| score_details.rs | ||
| snapshot_tests.rs | ||