10119 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Clément Renault	92b55bdc57	Remove all the remaining RefBumps	2024-10-29 10:30:14 +01:00
Clément Renault	fdfad0c3c1	Add some security when merging buckets together	2024-10-29 10:21:21 +01:00
Clément Renault	9fcf51dcc6	Finalize the cache freeze function	2024-10-29 10:09:56 +01:00
Clément Renault	498f51c7b3	Finished the merging of all spilled entries	2024-10-28 16:15:13 +01:00
Clément Renault	93d639ead1	Bring grenad back to spill	2024-10-28 15:02:02 +01:00
Clément Renault	2444ddbd3d	Use the bumpalo Bump instead of the RefBump/RefBytes	2024-10-24 17:47:41 +02:00
Clément Renault	b7e106b34a	Rewrite the cache to fill multiple caches	2024-10-24 17:40:02 +02:00
Clément Renault	437940d053	Describe the multi-threaded cache merging	2024-10-24 15:26:42 +02:00
Clément Renault	3a76ccb6e1	Make progress on the new cache system	2024-10-17 18:01:25 +02:00
Clément Renault	f18fed9e32	Introduce the UnorderedEntries type	2024-10-17 13:55:36 +02:00
Clément Renault	cd0d211add	Remove useless commented code	2024-10-17 10:50:52 +02:00
Clément Renault	b602f73f0d	Correctly spill into a grenad sorter	2024-10-17 10:31:29 +02:00
Clément Renault	287b1c51db	Fix all errors around the cache	2024-10-17 10:19:36 +02:00
Clément Renault	27fc50c476	Fix even more errors around the cache	2024-10-17 10:17:34 +02:00
Clément Renault	495742e113	Fix more errors around the cache	2024-10-17 10:16:51 +02:00
Clément Renault	05a015b27c	Improve the cache again	2024-10-17 10:16:14 +02:00
Louis Dureuil	f095477c0c	Call spill_if_needed in for_each_document_change	2024-10-17 10:16:13 +02:00
Clément Renault	336c2816e3	WIP	2024-10-17 10:16:13 +02:00
Clément Renault	7169dd8e37	Implement a basic non working bumpalo-based cache	2024-10-17 10:15:44 +02:00
Louis Dureuil	c1fcb2ebc6	add some warning	2024-10-17 09:43:11 +02:00
Louis Dureuil	0749633618	Don't sort in parallel in sorters of the new indexer	2024-10-17 09:30:18 +02:00
Louis Dureuil	0647f75e6b	Add borrow_mut_or_yield extension method	2024-10-16 17:36:41 +02:00
Louis Dureuil	c75de1f391	Remove TODO	2024-10-16 11:18:59 +02:00
Louis Dureuil	198238687f	Guess and retrieve primary key correctly in batch	2024-10-16 09:27:18 +02:00
Louis Dureuil	f9a6c624a7	Put primary key, and use provided key in operation	2024-10-16 09:27:00 +02:00
Louis Dureuil	017757004e	Add PrimaryKey::new_or_insert	2024-10-16 09:26:18 +02:00
Louis Dureuil	152683083b	Change document operation to use method in primary key	2024-10-15 14:08:37 +02:00
Louis Dureuil	c283c95f6a	Support nested primary keys	2024-10-15 14:08:37 +02:00
Clément Renault	9a0e1dc375	Fix the prefix deletion	2024-10-15 11:20:09 +02:00
Clément Renault	1e81d72b5f	Use the fixed version of the Rhai crate	2024-10-14 18:18:59 +02:00
Clément Renault	52b95c4e59	Make sure we edit the task statuses	2024-10-14 16:48:15 +02:00
Clément Renault	7e1dc8439b	Introduce the new update by function	2024-10-14 16:32:50 +02:00
Louis Dureuil	96658ec775	Make de public	2024-10-14 15:41:58 +02:00
Louis Dureuil	c01ee7b732	external changes	2024-10-14 15:41:58 +02:00
Louis Dureuil	6ad3f57bc1	Changes to de	2024-10-14 15:41:58 +02:00
Louis Dureuil	28d92c521a	External docids to &'bump str	2024-10-14 15:41:58 +02:00
Louis Dureuil	7df20d8282	Changes to primary key	2024-10-14 15:41:57 +02:00
ManyTheFish	b4102741e6	Fix duplicated fields when a document is modified	2024-10-14 14:59:40 +02:00
ManyTheFish	a525598ad6	Fix facet string indexing	2024-10-14 11:12:10 +02:00
ManyTheFish	4e97e38177	Serialize docids bitmap one time	2024-10-14 11:12:10 +02:00
ManyTheFish	d675e73af1	Finish prefix databases	2024-10-14 11:12:10 +02:00
ManyTheFish	a2fbf2ea21	set updated at at the end of the indexing	2024-10-14 11:05:25 +02:00
ManyTheFish	132916f62c	Only run word pair proximity docids extraction if proximity_precision enables it	2024-10-14 11:05:25 +02:00
Louis Dureuil	8371819114	Some clippy related fixes	2024-10-14 10:58:37 +02:00
Louis Dureuil	6028d6ba43	Remove somme warnings	2024-10-10 22:42:37 +02:00
Louis Dureuil	68a2502388	Introduce indexer level bumpalo	2024-10-10 22:23:05 +02:00
Clément Renault	39b27e42be	Plug the deletion pipeline	2024-10-08 16:04:19 +02:00
Clément Renault	470c2272dd	Show much more stats about the LRU caches	2024-10-08 15:29:24 +02:00
Clément Renault	2230674c0a	Merge branch 'fix-append-only-vec' into indexer-edition-2024	2024-10-08 10:32:45 +02:00
Clément Renault	eb09dfed04	Avoid reallocation with the ThreadLocal pool	2024-10-07 16:41:17 +02:00