Commit Graph

37 Commits

Author SHA1 Message Date
Clément Renault ea016d97af
Implementing an IS EMPTY filter 2023-03-15 14:12:34 +01:00
Clément Renault 0ad53784e7
Create a new struct to reduce the type complexity 2023-03-09 13:21:21 +01:00
Clément Renault 43ff236df8
Write the NULL facet values in the database 2023-03-08 16:49:53 +01:00
Clément Renault 19ab4d1a15
Classify the NULL fields values in the facet extractor 2023-03-08 16:49:31 +01:00
ManyTheFish bbecab8948 fix clippy 2023-02-21 10:18:44 +01:00
f3r10 fd60a39f1c Format code 2023-01-31 11:28:05 +01:00
f3r10 d97fb6117e Extract and index data 2023-01-31 11:28:05 +01:00
unvalley c7322f704c Fix cargo clippy errors
Dont apply clippy for tests for now

Fix clippy warnings of filter-parser package

parent 8352febd646ec4bcf56a44161e5c4dce0e55111f
author unvalley <38400669+unvalley@users.noreply.github.com> 1666325847 +0900
committer unvalley <kirohi.code@gmail.com> 1666791316 +0900

Update .github/workflows/rust.yml

Co-authored-by: Clémentine Urquizar - curqui <clementine@meilisearch.com>

Allow clippy lint too_many_argments

Allow clippy lint needless_collect

Allow clippy lint too_many_arguments and type_complexity

Fix for clippy warnings comparison_chains

Fix for clippy warnings vec_init_then_push

Allow clippy lint should_implement_trait

Allow clippy lint drop_non_drop

Fix lifetime clipy warnings in filter-paprser

Execute cargo fmt

Fix clippy remaining warnings

Fix clippy remaining warnings again and allow lint on each place
2022-10-27 01:04:23 +09:00
Loïc Lecrenier 54c0cf93fe Merge remote-tracking branch 'origin/main' into facet-levels-refactor 2022-10-26 15:13:34 +02:00
Loïc Lecrenier b1ab09196c Remove outdated TODOs 2022-10-26 13:47:04 +02:00
Loïc Lecrenier afdf87f6f7 Fix bugs in asc/desc criterion and facet indexing 2022-10-26 13:47:04 +02:00
Loïc Lecrenier c3f49f766d Prepare refactor of facets database
Prepare refactor of facets database
2022-10-26 13:46:14 +02:00
Ewan Higgs 6b2fe94192 Fixes for clippy bringing us down to 18 remaining issues.
This brings us a step closer to enforcing clippy on each build.
2022-10-25 20:49:02 +02:00
Ewan Higgs beb987d3d1 Fixing piles of clippy errors.
Most of these are calling clone when the struct supports Copy.

Many are using & and &mut on `self` when the function they are called
from already has an immutable or mutable borrow so this isn't needed.

I tried to stay away from actual changes or places where I'd have to
name fresh variables.
2022-10-13 22:02:54 +02:00
Loïc Lecrenier 1506683705 Avoid using too much memory when indexing facet-exists-docids 2022-07-19 14:42:35 +02:00
Loïc Lecrenier aed8c69bcb Refactor indexation of the "facet-id-exists-docids" database
The idea is to directly create a sorted and merged list of bitmaps
in the form of a BTreeMap<FieldId, RoaringBitmap> instead of creating
a grenad::Reader where the keys are field_id and the values are docids.

Then we send that BTreeMap to the thing that handles TypedChunks, which
inserts its content into the database.
2022-07-19 10:07:33 +02:00
Loïc Lecrenier 30bd4db0fc Simplify indexing task for facet_exists_docids database 2022-07-19 10:07:33 +02:00
Loïc Lecrenier 453d593ce8 Add a database containing the docids where each field exists 2022-07-19 10:07:33 +02:00
Irevoire 4f3ce6d9cd
nested fields 2022-04-07 16:58:46 +02:00
ad hoc 8d46a5b0b5
extract exact word docids 2022-04-04 20:54:02 +02:00
ad hoc 0a77be4ec0
introduce exact_word_docids db 2022-04-04 20:54:02 +02:00
ad hoc 5f9f82757d
refactor spawn_extraction_task 2022-04-04 20:54:02 +02:00
Clément Renault ff8d7a810d
Change the behavior of the as_cloneable_grenad by taking a ref 2022-02-16 15:40:08 +01:00
many c5a6075484
Make max_position_per_attributes changable 2021-10-12 10:10:50 +02:00
many 3296bb243c
Simplify word level position DB into a word position DB 2021-10-05 12:15:02 +02:00
Irevoire a84f3a8b31
Apply suggestions from code review
Co-authored-by: Clément Renault <clement@meilisearch.com>
2021-09-09 15:09:35 +02:00
Tamo bd4c248292
improve the error handling in general and introduce the concept of reserved keywords 2021-09-08 18:24:09 +02:00
Tamo f73273d71c
only call the extractor if needed 2021-09-08 17:51:08 +02:00
Irevoire a21c854790
handle errors 2021-09-08 17:51:07 +02:00
Irevoire 70ab2c37c5
remove multiple bugs 2021-09-08 17:51:07 +02:00
Irevoire 44d6b6ae9e
Index the geo points 2021-09-08 17:51:07 +02:00
many db0c681bae
Fix Pr comments 2021-09-02 15:17:52 +02:00
many 8f702828ca
Ignore errors comming from crossbeam channel senders 2021-09-01 16:48:40 +02:00
many a2f59a28f7
Remove unwrap sending errors in channel 2021-09-01 16:48:40 +02:00
many 2d1727697d
Take stop word in account 2021-09-01 16:48:40 +02:00
many 823da19745
Fix test and use progress callback 2021-09-01 16:48:39 +02:00
many 1d314328f0
Plug new indexer 2021-09-01 16:48:36 +02:00