MeiliSearch/milli/src/vector
meili-bors[bot] 5ed7b6a0b2
Merge #4456
4456: Add Ollama as an embeddings provider r=dureuill a=jakobklemm

# Pull Request

## Related issue
[Related Discord Thread](https://discord.com/channels/1006923006964154428/1211977150316683305)

## What does this PR do?
- Adds Ollama as a provider of Embeddings besides HuggingFace and OpenAI under the name `ollama`
- Adds the environment variable `MEILI_OLLAMA_URL` to set the embeddings URL of an Ollama instance with a default value of `http://localhost:11434/api/embeddings` if no variable is set
- Changes some of the structs and functions in `openai.rs` to be public so that they can be shared.
- Added more error variants for Ollama specific errors
- It uses the model `nomic-embed-text` as default, but any string value is allowed, however it won't automatically check if the model actually exists or is an embedding model

Tested against Ollama version `v0.1.27` and the `nomic-embed-text` model.

## PR checklist
Please check if your PR fulfills the following requirements:
- [x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
- [x] Have you read the contributing guidelines?
- [x] Have you made sure that the title is accurate and descriptive of the changes?

Co-authored-by: Jakob Klemm <jakob@jeykey.net>
Co-authored-by: Louis Dureuil <louis.dureuil@gmail.com>
2024-03-13 08:48:47 +00:00
..
error.rs Merge #4456 2024-03-13 08:48:47 +00:00
hf.rs get rids of log in milli and add logs for the bucket sort 2024-02-08 15:04:05 +01:00
manual.rs WIP 2023-12-14 16:08:41 +01:00
mod.rs Merge #4456 2024-03-13 08:48:47 +00:00
ollama.rs Add Ollama dimension inference and add clearer errors 2024-03-12 19:59:11 +01:00
openai.rs Merge #4456 2024-03-13 08:48:47 +00:00
settings.rs Add Ollama dimension inference and add clearer errors 2024-03-12 19:59:11 +01:00