Commit Graph

33 Commits

Author SHA1 Message Date
Clément Renault ea016d97af
Implementing an IS EMPTY filter 2023-03-15 14:12:34 +01:00
Clément Renault 43ff236df8
Write the NULL facet values in the database 2023-03-08 16:49:53 +01:00
ManyTheFish bbecab8948 fix clippy 2023-02-21 10:18:44 +01:00
f3r10 fd60a39f1c Format code 2023-01-31 11:28:05 +01:00
f3r10 d97fb6117e Extract and index data 2023-01-31 11:28:05 +01:00
Loïc Lecrenier b1ab09196c Remove outdated TODOs 2022-10-26 13:47:04 +02:00
Loïc Lecrenier bee3c23b45 Add comparison benchmark between bulk and incremental facet indexing 2022-10-26 13:47:04 +02:00
Loïc Lecrenier 9b55e582cd Add FacetsUpdate type that wraps incremental and bulk indexing methods 2022-10-26 13:47:04 +02:00
Loïc Lecrenier 61252248fb Fix some facet indexing bugs 2022-10-26 13:47:04 +02:00
Loïc Lecrenier 85824ee203 Try to make facet indexing incremental 2022-10-26 13:47:04 +02:00
Loïc Lecrenier bd2c0e1ab6 Remove unused code 2022-10-26 13:46:14 +02:00
Loïc Lecrenier c3f49f766d Prepare refactor of facets database
Prepare refactor of facets database
2022-10-26 13:46:14 +02:00
Ewan Higgs beb987d3d1 Fixing piles of clippy errors.
Most of these are calling clone when the struct supports Copy.

Many are using & and &mut on `self` when the function they are called
from already has an immutable or mutable borrow so this isn't needed.

I tried to stay away from actual changes or places where I'd have to
name fresh variables.
2022-10-13 22:02:54 +02:00
Loïc Lecrenier 1506683705 Avoid using too much memory when indexing facet-exists-docids 2022-07-19 14:42:35 +02:00
Loïc Lecrenier aed8c69bcb Refactor indexation of the "facet-id-exists-docids" database
The idea is to directly create a sorted and merged list of bitmaps
in the form of a BTreeMap<FieldId, RoaringBitmap> instead of creating
a grenad::Reader where the keys are field_id and the values are docids.

Then we send that BTreeMap to the thing that handles TypedChunks, which
inserts its content into the database.
2022-07-19 10:07:33 +02:00
Loïc Lecrenier 453d593ce8 Add a database containing the docids where each field exists 2022-07-19 10:07:33 +02:00
ad hoc b799f3326b
rename merge_nothing to merge_ignore_values 2022-04-05 18:44:35 +02:00
ad hoc 0a77be4ec0
introduce exact_word_docids db 2022-04-04 20:54:02 +02:00
Clément Renault ff8d7a810d
Change the behavior of the as_cloneable_grenad by taking a ref 2022-02-16 15:40:08 +01:00
Clément Renault f367cc2e75
Finally bump grenad to v0.4.1 2022-02-16 15:28:48 +01:00
Tamo 98a365aaae
store the geopoint in three dimensions 2021-12-14 12:21:24 +01:00
many 3296bb243c
Simplify word level position DB into a word position DB 2021-10-05 12:15:02 +02:00
Irevoire a84f3a8b31
Apply suggestions from code review
Co-authored-by: Clément Renault <clement@meilisearch.com>
2021-09-09 15:09:35 +02:00
Tamo bd4c248292
improve the error handling in general and introduce the concept of reserved keywords 2021-09-08 18:24:09 +02:00
Irevoire ea2f2ecf96
create a new database containing all the documents that were geo-faceted 2021-09-08 17:51:08 +02:00
Irevoire 70ab2c37c5
remove multiple bugs 2021-09-08 17:51:07 +02:00
Irevoire b4b6ba6d82
rename all the ’long’ into ’lng’ like written in the specification 2021-09-08 17:51:07 +02:00
Irevoire 44d6b6ae9e
Index the geo points 2021-09-08 17:51:07 +02:00
many db0c681bae
Fix Pr comments 2021-09-02 15:17:52 +02:00
many 9452fabfb2
Optimize cbo roaring bitmaps merge 2021-09-01 16:48:40 +02:00
many 8f702828ca
Ignore errors comming from crossbeam channel senders 2021-09-01 16:48:40 +02:00
many 823da19745
Fix test and use progress callback 2021-09-01 16:48:39 +02:00
many 1d314328f0
Plug new indexer 2021-09-01 16:48:36 +02:00