210 commits

Author	SHA1	Message	Date
Louis Dureuil	771a367b97	clippy: use rewind instead of seek 0	2023-01-31 10:40:48 +01:00
Louis Dureuil	89675e5f15	clippy: Replace seek 0 by rewind	2023-01-31 09:32:40 +01:00
Kerollmops	29961b8c6b	Make it work with the dumps	2023-01-25 14:41:36 +01:00
bors[bot]	60018d0fe4	Merge #3343 ... 3343: Extract creation and last updated timestamp for v3 dump r=curquiza a=FrancisMurillo # Pull Request ## Related issue Fixes #2988 ## What does this PR do? Inspired by the v4 dump implementation, this extracts the first `createdAt` and last `updatedAt` fields by parsing the task queue. Questions: - Should the parsing of the tasks be cached instead of being parsed for every index since it might add a performance penalty? - I am not sure if the `created_at` and `processed_at` fields are correct - Should I assume the data is sorted in some order like with `uuid` or `updateId`? I assumed the list is unordered. - I was planning to populate my dev instance with data and dump my data. Is there a way to dump with previous versions? ## PR checklist Please check if your PR fulfills the following requirements: - [x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)? - [x] Have you read the contributing guidelines? - [x] Have you made sure that the title is accurate and descriptive of the changes? Thank you so much for contributing to Meilisearch! Co-authored-by: Francis Murillo <evacuee.overlap.vs3op@aleeas.com>	2023-01-19 16:14:21 +00:00
Louis Dureuil	72e2b220ed	Fix tests	2023-01-19 15:48:20 +01:00
Francis Murillo	798aa4ee92	Fix clippy issues	2023-01-19 19:38:20 +08:00
Tamo	0f727d079b	fix the wrong error code on minWordSizeForTypos	2023-01-18 12:28:46 +01:00
Francis Murillo	6993924f32	Use finished_at for v3 dumps instead	2023-01-17 23:11:49 +08:00
Loïc Lecrenier	07b90dec08	Remove unused proptest dependency	2023-01-17 11:07:07 +01:00
Francis Murillo	a97281af08	Extract createdAt and updatedAt from v3 dump	2023-01-13 22:45:45 +08:00
Loïc Lecrenier	7f80b116bc	Add specific immutable_field error codes	2023-01-12 16:20:14 +01:00
Loïc Lecrenier	1fc11264e8	Refactor deserr integration	2023-01-11 19:08:39 +01:00
Loïc Lecrenier	2bc2e99ff3	Simplify declaration of the error codes	2023-01-11 19:08:39 +01:00
Tamo	d308684395	remove two ununsed error codes + fix the sort error_code	2023-01-10 11:32:11 +01:00
Loïc Lecrenier	9ab791bedc	Update error codes on the api key routes	2023-01-09 12:30:25 +01:00
Tamo	97854274b4	rename the invalid_geo_field error code to invalid_document_geo_field	2023-01-05 21:08:19 +01:00
Tamo	50ce0409bc	Integrate deserr on the most important routes	2023-01-05 20:48:29 +01:00
bors[bot]	1f8ddb366c	Merge #3302 ... 3302: Update insta snap tests for index dates of dump v5 r=curquiza a=loiclec This PR simply updates the content of the insta snapshot test following https://github.com/meilisearch/meilisearch/pull/3013 . I manually verified that the dates in the snaps are indeed correct. Co-authored-by: Loïc Lecrenier <loic.lecrenier@me.com>	2023-01-05 12:58:10 +00:00
Loïc Lecrenier	ba839852f5	Update insta snap tests for index dates of dump v5	2023-01-05 11:45:40 +01:00
Loïc Lecrenier	f9aa897ab5	Update insta tests	2023-01-05 10:19:19 +01:00
Loïc Lecrenier	2d74678b51	Replace underscores with hyphens in doc link to error code	2023-01-05 10:09:02 +01:00
bors[bot]	a402fc4486	Merge #3013 ... 3013: Extract the dates out of the dumpv5. r=loiclec a=funilrys Hi there, please review this PR that tries to fix #2986. I'm still learning Rust and I found that #2986 is an excellent way for me to read and learn what others do with Rust. So please excuse my semantics ... Stay safe and healthy. --- # Pull Request This patch possibly fixes #2986. This patch introduces a way to fill the IndexMetadata.created_at and IndexMetadata.updated_at keys from the tasks events. This is done by reading the creation date of the first event (created_at) and the creation date of the last event (updated_at). ## Related issue Fixes #2986 ## What does this PR do? - Extract the dates out of the dumpv5. ## PR checklist Please check if your PR fulfills the following requirements: - [x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)? - [x] Have you read the contributing guidelines? - [x] Have you made sure that the title is accurate and descriptive of the changes? Thank you so much for contributing to Meilisearch! Co-authored-by: funilrys <contact@funilrys.com>	2023-01-05 08:23:52 +00:00
Louis Dureuil	fcbd47281b	Fix tests	2023-01-04 14:24:20 +01:00
Louis Dureuil	b6d80293f7	Propagate new error codes from milli	2023-01-04 14:24:20 +01:00
funilrys	3e0e8164a3	fixup! Adjust + Cleanup changes.	2022-12-22 18:01:54 +01:00
funilrys	0bc4572905	Adjust + Cleanup changes. ... Indeed, I missed some of the changed that were introduced by #3190.	2022-12-22 17:53:33 +01:00
funilrys	4e6c663a2e	Release unecessary ownership.	2022-12-22 17:47:58 +01:00
funilrys	e2775c6f49	Remove unused object.	2022-12-22 17:47:58 +01:00
funilrys	c07a5932cb	Apply fmt.	2022-12-22 17:47:58 +01:00
funilrys	528a944997	Reimplement v5 date extraction. ... Indeed, before this patch the implementation wasn't correct.	2022-12-22 17:47:58 +01:00
funilrys	13fb5ce974	Re-Open tasks list when needed. ... Indeed, before this patch we were using the reference instead of "reopening" the task list each time we needed to access it. Without this patch, all other usage of the task attribute will break.	2022-12-22 17:47:57 +01:00
funilrys	a43a0712fa	Add reader.v5.tasks.Task.updated_at. ... There was no way to "quickly" get the update date.	2022-12-22 17:47:57 +01:00
funilrys	1be4619b91	Add reader.v5.tasks.Task.created_at. ... There was no way to "quickly" get the creation date.	2022-12-22 17:47:57 +01:00
funilrys	cf50f85986	Add reader.v5.tasks.Task.processed_at. ... There was no way to "quickly" get the processed date.	2022-12-22 17:47:57 +01:00
funilrys	61b3a29ff3	Extract the dates out of the dumpv5. ... This patch possibly fixes #2986. This patch introduces a way to fill the IndexMetadata.created_at and IndexMetadata.updated_at keys from the tasks events. This is done by reading the creation date of the first event (created_at) and the creation date of the last event (updated_at).	2022-12-22 17:47:57 +01:00
Tamo	9e0cce5ca4	Update dump/src/error.rs ... Co-authored-by: Louis Dureuil <louis@meilisearch.com>	2022-12-20 18:08:51 +01:00
Tamo	336ea57384	Update dump/src/error.rs ... Co-authored-by: Louis Dureuil <louis@meilisearch.com>	2022-12-20 18:08:44 +01:00
Tamo	c637bfba37	convert all the document format error due to io to io::Error	2022-12-20 17:49:38 +01:00
Tamo	52aa34d984	remove an unused error handling file	2022-12-20 16:32:51 +01:00
Louis Dureuil	869d331680	Clippy fixes after updating Rust to v1.66	2022-12-19 14:17:12 +01:00
curquiza	026cf223b3	Update version for the next release (v1.0.0) in Cargo.toml files	2022-12-08 12:20:17 +00:00
Tamo	1c3a326199	stop snapshotting the version of meilisearch in the dump ... It might change and we don't want to update this test everytime we make a new release.	2022-12-07 13:26:02 +01:00
Kerollmops	c1337f9e08	Update dump snap to new version	2022-12-07 11:48:29 +01:00
curquiza	5db7c4057c	Update version for the next release (v0.30.1) in Cargo.toml files	2022-12-06 20:05:46 +01:00
bors[bot]	2867d2e91a	Merge #3190 ... 3190: Fix the dump date-import of the dumpv4 r=irevoire a=irevoire # Pull Request After merging https://github.com/meilisearch/meilisearch/pull/3012 I realized that the tests on the date of the dump-v4 were still ignored, thus, I fixed them and then noticed #3012 wasn't working properly. ## Related issue Fixes https://github.com/meilisearch/meilisearch/issues/2987 a second time `@funilrys` since you wrote most of the code you might be interested, but don't feel obligated to review this code. Someone from the team will double-check it works 😁 Co-authored-by: Tamo <tamo@meilisearch.com>	2022-12-06 10:47:00 +00:00
Tamo	bef81065f9	return the same time in case we didn't found a created or updated at	2022-12-06 11:03:23 +01:00
Tamo	180511795b	Update dump/src/reader/v4/mod.rs fix typo ... Co-authored-by: Louis Dureuil <louis@meilisearch.com>	2022-12-06 10:53:43 +01:00
bors[bot]	9b23885e85	Merge #3188 ... 3188: re-enable the dump test on the dates r=irevoire a=irevoire I just noticed that we have the real date in the dump-v1 contrarily to the dump-v2/3/4/5, thus we can ensure it doesn't change unexpectedly 👍 Co-authored-by: Tamo <tamo@meilisearch.com>	2022-12-05 18:10:22 +00:00
Tamo	9c89e3dadc	uncomment more test for the dump v4	2022-12-05 18:15:29 +01:00
Tamo	b0cf431614	Fix the dump date-import of the dumpv4	2022-12-05 18:08:35 +01:00