44 Commits

Author	SHA1	Message	Date
Clément Renault	a9d0f4a002	Improve english comments ... Co-authored-by: Louis Dureuil <louis@meilisearch.com>	2025-01-29 15:16:40 +01:00
Kerollmops	cec88cfc29	Measure the bbqueue congestion	2025-01-29 14:21:02 +01:00
Clément Renault	9b579069df	Comment the max grant of the bbqueue ... Co-authored-by: Louis Dureuil <louis@meilisearch.com>	2025-01-24 12:18:32 +01:00
Kerollmops	5ab4cdb1f3	Reduce the maximum grant possible we can store in the BBQueue	2025-01-24 12:18:32 +01:00
Kerollmops	261d2ceb06	Yield the BBQueue writer instead of spin looping	2024-12-04 14:16:40 +01:00
Kerollmops	96831ed9bb	Send the WakeUp message if necessary in the reserve function	2024-12-04 11:03:01 +01:00
Kerollmops	0459b1a242	Change the reserve and grant function to accept a closure	2024-12-04 10:32:25 +01:00
Clément Renault	767259be7e	Prefer returning a abort indexation rather than throwing a panic	2024-12-02 11:53:42 +01:00
Clément Renault	e9f34fb4b1	Make the frame consumer pulling fair	2024-12-02 11:49:01 +01:00
Clément Renault	d5c07ef7b3	Manage key length conversion error correctly	2024-12-02 11:03:00 +01:00
Clément Renault	5e218f3f4d	Remove a sync_all (mark my words)	2024-12-02 11:03:00 +01:00
Clément Renault	bcab61ab1d	Do spurious wake ups on the receiver side	2024-12-02 11:03:00 +01:00
Clément Renault	263c5a348e	Move the spin looping for BBQueue frames into a dedicated function	2024-12-02 10:33:49 +01:00
Clément Renault	be7d2fbe63	Move the EntryHeader up in the file and document the safety related to the size	2024-12-02 10:19:11 +01:00
Clément Renault	f7f9a131e4	Improve copying bytes into aligned memory area	2024-12-02 10:15:58 +01:00
Clément Renault	5df5eb2db2	Clarify a method name	2024-12-02 10:10:48 +01:00
Clément Renault	30eb0e5b5b	Rename recv and read methods to recv_action and recv_frame	2024-12-02 10:08:01 +01:00
Clément Renault	5b860cb989	Fix english in the doc	2024-12-02 10:06:35 +01:00
Clément Renault	3c7ac093d3	Take the BBQueue capacity into account in the max memory	2024-11-28 15:43:14 +01:00
Clément Renault	b57dd5c58e	Remove the Vector variant and use the Vectors	2024-11-28 15:20:43 +01:00
Clément Renault	096a28656e	Fix a bug around deleting all the vectors of a doc	2024-11-28 15:15:06 +01:00
Clément Renault	cc4bd54669	Correctly construct the Embeddings struct	2024-11-28 13:53:25 +01:00
Clément Renault	58eab9a018	Send large payload through crossbeam	2024-11-28 12:01:06 +01:00
Clément Renault	5c488e20cc	Send the geo rtree through crossbeam channel	2024-11-27 18:03:45 +01:00
Clément Renault	e83534a430	Fix the indexer::index to correctly use the rayon::ThreadPool	2024-11-27 16:27:43 +01:00
Clément Renault	98d4a2909e	Fix the way we spawn the rayon threadpool	2024-11-27 16:05:44 +01:00
Clément Renault	a514ce472a	Make clippy happy	2024-11-27 14:59:04 +01:00
Clément Renault	acec45ad7c	Send a WakeUp when writing data in the BBQueue buffers	2024-11-27 14:33:23 +01:00
Clément Renault	70802eb7c7	Fix most issues with the lifetimes	2024-11-27 14:32:42 +01:00
Clément Renault	6ac5b3b136	Finish most of the channels types	2024-11-27 14:32:26 +01:00
Clément Renault	8442db8101	Implement mostly all senders	2024-11-27 14:16:35 +01:00
Clément Renault	79671c9faa	Implement a first version of the bbqueue channels	2024-11-27 14:15:00 +01:00
Clément Renault	a3103f347e	Fix the facet f64 database name	2024-11-25 16:05:31 +01:00
Clément Renault	25aac45fc7	Expose better error messages	2024-11-25 15:54:43 +01:00
ManyTheFish	36962b943b	First batch of PR comment	2024-11-21 16:38:11 +01:00
Clément Renault	a38344acb3	Replace eprintlns by tracing	2024-11-20 15:29:51 +01:00
Clément Renault	9e8367f1e6	Move the rayon thread pool outside the extract method	2024-11-14 10:40:32 +01:00
ManyTheFish	e627e182ce	Fix facet strings	2024-11-13 17:43:02 +01:00
ManyTheFish	51b6293738	Add linear facet databases	2024-11-13 17:43:02 +01:00
Clément Renault	b17896d899	Finialize the GeoExtractor	2024-11-13 17:43:02 +01:00
Louis Dureuil	6094bb299a	Fix user_provided vectors	2024-11-12 10:15:55 +01:00
Louis Dureuil	10f49f0d75	Post processing of the merge	2024-11-06 17:50:12 +01:00
Louis Dureuil	ee03743355	Merge branch 'indexer-edition-2024' into indexer-edition-2024-doc-chunks	2024-11-06 15:50:53 +01:00
ManyTheFish	10feeb88f2	Merge branch 'main' into indexer-edition-2024	2024-11-06 15:19:18 +01:00