93 Commits

Author	SHA1	Message	Date
Clément Renault	98d4a2909e	Fix the way we spawn the rayon threadpool	2024-11-27 16:05:44 +01:00
Clément Renault	a514ce472a	Make clippy happy	2024-11-27 14:59:04 +01:00
Clément Renault	cc63802115	Modify and return the IndexEmbeddings to write them later	2024-11-27 14:58:03 +01:00
Clément Renault	acec45ad7c	Send a WakeUp when writing data in the BBQueue buffers	2024-11-27 14:33:23 +01:00
Clément Renault	08d6413365	Fix result types	2024-11-27 14:32:42 +01:00
Clément Renault	70802eb7c7	Fix most issues with the lifetimes	2024-11-27 14:32:42 +01:00
Clément Renault	6ac5b3b136	Finish most of the channels types	2024-11-27 14:32:26 +01:00
Clément Renault	2094ce8a9a	Move the arroy building after the writing loop	2024-11-27 14:30:33 +01:00
Clément Renault	8442db8101	Implement mostly all senders	2024-11-27 14:16:35 +01:00
Clément Renault	79671c9faa	Implement a first version of the bbqueue channels	2024-11-27 14:15:00 +01:00
meili-bors[bot]	a2f64f6552	Merge #5095 ... 5095: Span to measure the part of db writes that is after the merge/extraction r=curquiza a=dureuill Co-authored-by: Louis Dureuil <louis@meilisearch.com>	2024-11-27 11:10:00 +00:00
meili-bors[bot]	d0b2c0a523	Merge #5091 ... 5091: Settings opt out r=Kerollmops a=ManyTheFish # Pull Request Related PRD: https://www.notion.so/meilisearch/API-usage-Settings-to-opt-out-indexing-features-fff4b06b651f8108ade3f858aeb16b14?pvs=4 ## Related issue Fixes #4979 - [x] Add setting opt-out - [x] Add analytics - [x] Add tests Co-authored-by: ManyTheFish <many@meilisearch.com> Co-authored-by: Many the fish <many@meilisearch.com>	2024-11-26 15:50:28 +00:00
Louis Dureuil	8f57b4fdf4	Span to measure the part of db writes that is after the merge/extraction	2024-11-26 14:46:36 +01:00
Louis Dureuil	aa460819a7	Add more precise spans	2024-11-26 09:45:36 +01:00
ManyTheFish	d66dc363ed	Test and implement settings opt-out	2024-11-25 18:23:22 +01:00
Clément Renault	a3103f347e	Fix the facet f64 database name	2024-11-25 16:05:31 +01:00
Clément Renault	25aac45fc7	Expose better error messages	2024-11-25 15:54:43 +01:00
Louis Dureuil	323ecbb885	Add span on document operation	2024-11-21 17:01:10 +01:00
Louis Dureuil	dcc3caef0d	Remove TopLevelMap	2024-11-21 16:56:46 +01:00
Louis Dureuil	221e547e86	Slight changes	2024-11-21 16:47:44 +01:00
Clément Renault	61d0615253	Document the geo point extractor	2024-11-21 16:47:08 +01:00
Clément Renault	5727e00374	Remove useless geo skipped	2024-11-21 16:47:08 +01:00
Clément Renault	9b60843831	Remove commented lines	2024-11-21 16:47:07 +01:00
ManyTheFish	36962b943b	First batch of PR comment	2024-11-21 16:38:11 +01:00
Louis Dureuil	32bcacefd5	Changes Document::len to Document::top_level_fields_count	2024-11-21 15:01:07 +01:00
ManyTheFish	94b260fd25	Remove orphan span	2024-11-21 12:12:07 +01:00
Clément Renault	ab2c83f868	Use the disk less when computing prefixes	2024-11-21 10:45:37 +01:00
Louis Dureuil	e0864f1b21	Separate side effect and debug asserts	2024-11-20 16:25:17 +01:00
Clément Renault	a38344acb3	Replace eprintlns by tracing	2024-11-20 15:29:51 +01:00
ManyTheFish	4d616f8794	Parse every attributes and filter before tokenization	2024-11-20 15:15:25 +01:00
Louis Dureuil	ff9c92c409	rename documents -> substep	2024-11-20 15:12:02 +01:00
Louis Dureuil	867138f166	Add SP to into_changes	2024-11-20 15:07:05 +01:00
Louis Dureuil	84600a10d1	Add MSP to document_update.into_changes()	2024-11-20 14:53:37 +01:00
Louis Dureuil	7d64e8dbd3	Fix Windows compilation	2024-11-20 14:40:38 +01:00
Louis Dureuil	cae8c89467	"fix" last warnings	2024-11-20 14:03:52 +01:00
Clément Renault	7cb8732b45	Introduce a new bincode internal error	2024-11-20 13:23:11 +01:00
ManyTheFish	fe5d50969a	Fix filed selector in extrators	2024-11-20 13:16:44 +01:00
Clément Renault	56c7c5d5f0	Fix comments	2024-11-20 13:16:44 +01:00
Louis Dureuil	2afa33011a	Fix tokenize_document	2024-11-20 13:16:43 +01:00
Louis Dureuil	f893b5153e	Don't mark [""] as empty facet	2024-11-20 13:16:42 +01:00
Louis Dureuil	ca779c21f9	facets: Handle boolean and skip empty strings	2024-11-20 13:16:42 +01:00
Louis Dureuil	477077bdc2	Remove _vectors from fid map when there are no vectors in sight	2024-11-20 13:16:42 +01:00
ManyTheFish	b1f8aec348	Fix index_documents_check_exists_database	2024-11-20 13:16:41 +01:00
ManyTheFish	ba7f091db3	Use tokenizer on numbers and booleans	2024-11-20 13:16:41 +01:00
Louis Dureuil	8049df125b	Add depth to facet extraction so that null inside an array doesn't mark the entire field as null	2024-11-20 13:16:40 +01:00
Clément Renault	3957917e0b	Correctly count indexed documents	2024-11-20 13:16:36 +01:00
Louis Dureuil	651c30899e	Allow fetching embedders from inside tests	2024-11-20 13:16:36 +01:00
Clément Renault	2c7a7fe4e8	Count the number of documents correctly	2024-11-20 13:16:35 +01:00
Clément Renault	23f0c2c29b	Generate internal ids only when needed	2024-11-20 13:16:35 +01:00
Clément Renault	3cf1352ae1	Fix the benchmark tests	2024-11-20 13:16:31 +01:00