85 commits

Author	SHA1	Message	Date
Louis Dureuil	3740755d9c	Compare to RawValue::NULL constant rather than explicit "null"	2025-07-03 10:11:07 +02:00
Louis Dureuil	a06cb1bfd6	Remove Embed::process_embeddings and have it be an inherent function of the type that uses it	2025-07-03 10:02:16 +02:00
Louis Dureuil	428463e45c	Check indexing fragments as well as search fragments	2025-07-02 16:17:22 +02:00
Louis Dureuil	7113fcf63a	New error	2025-07-02 16:17:12 +02:00
Louis Dureuil	82a796aea7	vector settings: fix bug where removed fragments were returned as new	2025-07-02 11:36:50 +02:00
Louis Dureuil	f6287602e9	Improve error message when request contains the wrong type of placeholder	2025-07-02 11:36:50 +02:00
Louis Dureuil	ede456c5b0	New error: rest inconsistent fragments	2025-07-02 11:36:50 +02:00
Louis Dureuil	3f5b5df139	Check consistency of fragments	2025-07-02 11:36:50 +02:00
Louis Dureuil	d72e5f5f69	Hide documentTemplate and documentTemplateMaxBytes when indexing_fragment is defined	2025-07-02 11:29:50 +02:00
Louis Dureuil	eda309d562	make sure fragments are ordered	2025-07-02 00:05:13 +02:00
Louis Dureuil	2b2e6c0b3a	Settings changes	2025-07-02 00:05:13 +02:00
Louis Dureuil	9ce5598fef	parsed vectors: embeddings is None when it is null when read from DB	2025-07-02 00:05:13 +02:00
Louis Dureuil	cab5e35ff7	Implement in old settings indexer and old dump import indexer	2025-07-02 00:05:12 +02:00
Louis Dureuil	f8232976ed	Implement in new document indexer	2025-07-02 00:05:12 +02:00
Louis Dureuil	f3d5c74c02	Vector settings to add indexingFragments and searchFragments	2025-07-02 00:05:12 +02:00
Louis Dureuil	c45ede44a8	Add new parameters to openai and rest embedders	2025-07-02 00:05:11 +02:00
Louis Dureuil	4235a82dcf	REST embedder supports fragments	2025-07-02 00:05:11 +02:00
Louis Dureuil	e7b9b8f002	Change embedder API	2025-07-02 00:05:11 +02:00
Louis Dureuil	422a786ffd	RuntimeEmbedder and RuntimeFragments	2025-07-02 00:05:11 +02:00
Louis Dureuil	836ae19bec	ArroyWrapper changes	2025-07-02 00:05:11 +02:00
Louis Dureuil	0b5bc41b79	Add new vector errors	2025-07-02 00:05:11 +02:00
Louis Dureuil	b45059e8f2	Add vector::session module	2025-07-02 00:05:11 +02:00
Louis Dureuil	c16c60b599	Add vector::extractor module	2025-07-02 00:05:11 +02:00
Louis Dureuil	17a94c40dc	Add vector::db module	2025-07-02 00:05:10 +02:00
Louis Dureuil	76ca44b214	Expand json_template module	2025-07-02 00:05:10 +02:00
Mubelotix	29f6eeff8f	Remove lots of Arcs	2025-06-26 12:15:08 +02:00
Mubelotix	ef007d547d	Remove panics	2025-06-26 12:15:08 +02:00
Mubelotix	d08e89ea3d	Remove options	2025-06-24 15:10:15 +02:00
Mubelotix	d7721fe607	Format	2025-06-24 12:20:22 +02:00
Mubelotix	4a179fb3c0	Improve code quality	2025-06-24 11:38:11 +02:00
Mubelotix	2f82d94502	Fix the test and simplify types	2025-06-23 18:55:23 +02:00
Mubelotix	4925b30196	Move embedder stats out of progress	2025-06-23 15:24:14 +02:00
Mubelotix	4cadc8113b	Add embedder stats in batches	2025-06-20 12:42:22 +02:00
Clément Renault	c6930c8819	Introduce the new index chat settings	2025-06-03 15:31:25 +02:00
Clément Renault	4d90e3d2ec	Make Cargo and Clippy happy	2025-04-01 11:26:34 +02:00
Tamo	009c36a4d0	Add support for the progress API of arroy	2025-03-13 19:00:43 +01:00
Louis Dureuil	e2d372823a	Disable the cache by default and make it experimental	2025-03-13 17:22:51 +01:00
Louis Dureuil	1876132172	Mutex-based implementation	2025-03-13 17:22:50 +01:00
Louis Dureuil	b08544e86d	Add embedding cache	2025-03-13 17:22:50 +01:00
Tamo	ef9d9f8481	set the memory in arroy	2025-03-13 11:29:00 +01:00
Louis Dureuil	4fab72cbea	Rename SettingsDiff::diff to SettingsDiff::apply_and_diff	2025-03-05 18:16:57 +01:00
Louis Dureuil	afb4b9677f	Remove Embedder:embed	2025-03-05 18:16:57 +01:00
Louis Dureuil	73d2dbd60f	Error handling	2025-03-05 18:16:57 +01:00
Louis Dureuil	24fe6cd205	Fix multiple embeddings in hf	2025-02-24 16:24:04 +01:00
Louis Dureuil	9f3e4801b1	Refactor settings validation and introduce SubEmbedderSettings	2025-02-24 13:58:26 +01:00
Louis Dureuil	294cf39cad	Integrate composite embedder	2025-02-24 13:58:26 +01:00
Louis Dureuil	4a2643daa2	Rename embed_one to embed_search and embed_chunks* to embed_index*	2025-02-24 13:58:26 +01:00
Louis Dureuil	8d2d9066ba	Add composite embedder	2025-02-24 13:58:26 +01:00
Louis Dureuil	14e1459bf5	Document settings	2025-02-19 15:06:22 +01:00
Louis Dureuil	7b4ce468a6	Allow overriding pooling method	2025-02-18 17:12:23 +01:00