156 Commits

Author	SHA1	Message	Date
Louis Dureuil	de04d5eddd	Support network in dumps	2025-01-30 11:33:41 +01:00
Louis Dureuil	b563ddfc11	Network stored in DB	2025-01-30 11:31:24 +01:00
Louis Dureuil	3998a850f7	Add new experimental feature	2025-01-30 11:31:24 +01:00
Tamo	ef47a0d820	apply review comment	2025-01-28 16:53:50 +01:00
Tamo	e0f0da57e2	make sure the batches we snapshots actually all contains an enqueued_at	2025-01-28 16:53:50 +01:00
Tamo	485e3127c7	use the remove_n_tasks_datetime_earlier_than function when updating batches	2025-01-28 16:53:50 +01:00
Tamo	58f90b70c7	store the enqueued at to eases the batch deletion	2025-01-28 16:53:50 +01:00
Tamo	508db9020d	update the snapshots	2025-01-28 16:53:50 +01:00
Kerollmops	6ff37c6fc4	Fix the insta snapshots	2025-01-28 16:53:50 +01:00
Kerollmops	f21ae1f5d1	Remove the batch id from the date time databases	2025-01-28 16:53:50 +01:00
Louis Dureuil	c1e5897076	Do not assume v1.12 when there is no index-scheduler version	2025-01-23 17:16:53 +01:00
Louis Dureuil	182c3f4b80	Write assumed version to the index-scheduler version db when it is missing	2025-01-23 16:51:25 +01:00
Tamo	7197ced673	fix the bad index version on opening	2025-01-23 16:51:24 +01:00
Tamo	787472453d	write the version of the index while upgrading it	2025-01-23 16:51:24 +01:00
Tamo	8f65f35de9	rewrite part of the index-scheduler upgrade test	2025-01-23 16:51:23 +01:00
Tamo	c27c923439	introduce a trait to upgrade the indexes	2025-01-23 16:51:23 +01:00
Tamo	fd5649091d	add the upgradeTo field in the details	2025-01-23 16:51:23 +01:00
Tamo	9a57736773	fix the early exit when rewriting a batch	2025-01-23 16:51:23 +01:00
Tamo	7740997ea8	reintroduce the unrecoverable error and use it where its supposed to be used	2025-01-23 16:51:22 +01:00
Tamo	7eb23f73ba	add the version to the index-scheduler snapshots + fix a bug when opening an index scheduler for the first time	2025-01-23 16:51:22 +01:00
Tamo	b9e9fc376a	add the version in the index-scheduler	2025-01-23 16:51:22 +01:00
Tamo	27bf2f1298	remove the empty progress made for the upgrade database	2025-01-23 16:51:22 +01:00
Tamo	d4d82fbd0c	commit the index wtxn before the index-scheduler wtxn	2025-01-23 16:51:21 +01:00
Tamo	eda09a54da	improve the index-scheduler tests	2025-01-23 16:51:21 +01:00
Tamo	b132d70413	fix the details in all cases	2025-01-23 16:51:21 +01:00
Tamo	e41ebd3047	expose the number of database in the index-scheduler and rewrite the lib.rs to use the value provided in the options instead of a magic number	2025-01-23 16:51:21 +01:00
Tamo	705d31e8bd	apply all the comments changes	2025-01-23 16:51:21 +01:00
Tamo	7d95950ce6	fix warning	2025-01-23 16:51:21 +01:00
Tamo	41eeffd88d	fmt	2025-01-23 16:51:20 +01:00
Tamo	1eb9fe8562	remove warnings	2025-01-23 16:51:20 +01:00
Tamo	bac7a1623a	fix the upgrade test	2025-01-23 16:51:19 +01:00
Tamo	5458850d21	write a test ensuring the index-scheduler is effectively down when the upgrade task fail and try to process it when it restarts. There is a bug when deleting this task	2025-01-23 16:51:19 +01:00
Tamo	cfc1e193b6	update the test with the stats	2025-01-23 16:51:19 +01:00
Tamo	0cc25c7e4c	add a large test importing a data.ms from the v1.12.0	2025-01-23 16:51:18 +01:00
Tamo	102681e384	starts adding tests and fix the starts of meilisearch	2025-01-23 16:51:18 +01:00
Tamo	3ef7a478cd	move the version check to the task queue	2025-01-23 16:48:32 +01:00
Tamo	e70ac35e02	fix bugs after rebase	2025-01-23 16:48:32 +01:00
Tamo	d3654906bf	Add the new tasks with most of the job done	2025-01-23 16:48:32 +01:00
Louis Dureuil	50fca8fc70	Create update files in new format	2025-01-22 15:51:21 +01:00
Louis Dureuil	d95384a636	Remove batch ids on export	2025-01-22 15:50:42 +01:00
Louis Dureuil	2cf57d584e	Handle empty payloads	2025-01-22 15:50:42 +01:00
Kerollmops	59242b9c4f	Fix warnings	2025-01-22 15:50:42 +01:00
Louis Dureuil	6a6212d4e1	Fix warnings	2025-01-22 15:50:42 +01:00
ManyTheFish	a8006a3750	Change format of update file when importing dump	2025-01-22 15:50:41 +01:00
Louis Dureuil	805531c90d	Do not explode on missing content file if the task has no docs	2025-01-22 15:50:41 +01:00
meili-bors[bot]	c85146524b	Merge #5232 ... 5232: Stabilize vector store feature r=Kerollmops a=dureuill # Pull Request ## Related issue Fixes #4733 ## What does this PR do? - `vectorStore` feature can no longer be set or get from `/experimental-features` - That feature has been removed, and there is no longer any check for its activation - Always display `embedders` in the settings, even if empty - Always hide `_vectors` in documents, unless `retrieveVectors: true` - Make error codes consistent with the usual nomenclature - Update tests as needed Co-authored-by: Louis Dureuil <louis@meilisearch.com>	2025-01-16 11:50:21 +00:00
Tamo	445e5aff02	fix the corruption	2025-01-15 12:38:40 +01:00
Tamo	234d0c360f	Add a test reproducing the issue	2025-01-15 12:29:56 +01:00
Louis Dureuil	87ea080c10	Fully remove vector store feature	2025-01-14 13:55:34 +01:00
Louis Dureuil	29eeb84ce3	Add --experimental-disable-vector-store CLI flag	2025-01-14 13:53:53 +01:00