ea016d97af
Implementing an IS EMPTY filter
2023-03-15 14:12:34 +01:00
e064c52544
Rename an internal facet deletion method
2023-03-09 13:08:02 +01:00
9287858997
Introduce a new facet_id_is_null_docids database in the index
2023-03-08 16:14:00 +01:00
8aa808d51b
Merge branch 'main' into enhance-language-detection
2023-02-20 18:14:34 +01:00
fbec48f56e
Merge remote-tracking branch 'milli/main' into bring-v1-changes
2023-02-06 16:48:10 +01:00
064158e4e2
Update test
2023-02-01 15:34:01 +01:00
369c05732e
Add test checking if from script_language_docids database were removed
...
deleted docids
2023-01-31 11:28:05 +01:00
b216ddba63
Delete and clear data from the new database
2023-01-31 11:28:05 +01:00
20f05efb3c
clippy: needless_lifetimes
2023-01-31 11:12:59 +01:00
3296cf7ae6
clippy: remove needless lifetimes
2023-01-31 09:32:40 +01:00
1b78231e18
Make clippy happy
2023-01-17 18:25:54 +01:00
fc0e7382fe
Fix hard-deletion of an external id that was soft-deleted
2022-12-20 15:33:31 +01:00
69edbf9f6d
Update milli/src/update/delete_documents.rs
2022-12-19 18:23:50 +01:00
ad9937c755
Fix tests after adding DeletionStrategy
2022-12-19 10:07:17 +01:00
171c942282
Soft-deletion computation no longer takes into account the mapsize
...
Implemented solution 2.3 from https://github.com/meilisearch/meilisearch/issues/3231#issuecomment-1348628824
2022-12-19 10:07:17 +01:00
e2ae3b24aa
Hard or soft delete according to the deletion strategy
2022-12-19 10:00:13 +01:00
fc7618d49b
Add DeletionStrategy
2022-12-19 09:49:58 +01:00
be3b00350c
Apply review suggestions: naming and documentation
2022-12-13 10:15:22 +01:00
e3ee553dcc
Remove soft deleted ids from ExternalDocumentIds during document import
...
If the document import replaces a document using hard deletion
2022-12-12 14:16:09 +01:00
f2cf981641
Add more tests and allow disabling of soft-deletion outside of tests
...
Also allow disabling soft-deletion in the IndexDocumentsConfig
2022-12-05 10:51:01 +01:00
f4ec1abb9b
Fix all clippy error after conflicts
2022-10-27 23:58:13 +09:00
811f156031
Execute cargo clippy --fix
2022-10-27 01:00:00 +09:00
54c0cf93fe
Merge remote-tracking branch 'origin/main' into facet-levels-refactor
2022-10-26 15:13:34 +02:00
f198b20c42
Add facet deletion tests that use both the incremental and bulk methods
...
+ update deletion snapshots to the new database format
2022-10-26 13:47:46 +02:00
e3ba1fc883
Make deletion tests for both soft-deletion and hard-deletion
2022-10-26 13:47:46 +02:00
ab5e56fd16
Add document deletion snapshot tests and tests for hard-deletion
2022-10-26 13:47:46 +02:00
d885de1600
Add option to avoid soft deletion of documents
2022-10-26 13:47:46 +02:00
1165ba2171
Make facet deletion incremental
2022-10-26 13:47:04 +02:00
cb8442a119
Further unify facet databases of f64s and strings
2022-10-26 13:47:04 +02:00
9026867d17
Give same interface to bulk and incremental facet indexing types
...
+ cargo fmt, oops, sorry for the bad history :(
2022-10-26 13:47:04 +02:00
485a72306d
Refactor facet-related codecs
2022-10-26 13:47:04 +02:00
3d145d7f48
Merge the two <facetttype>_faceted_documents_ids methods into one
2022-10-26 13:47:04 +02:00
68cbcdf08b
Fix compile errors/warnings in http-ui and infos
2022-10-26 13:47:04 +02:00
85824ee203
Try to make facet indexing incremental
2022-10-26 13:47:04 +02:00
e8a156d682
Reorganise facets database indexing code
2022-10-26 13:46:46 +02:00
39a4a0a362
Reintroduce filter range search and facet extractors
2022-10-26 13:46:14 +02:00
22d80eeaf9
Reintroduce facet deletion functionality
2022-10-26 13:46:14 +02:00
6cc91824c1
Remove unused heed codec files
2022-10-26 13:46:14 +02:00
c3f49f766d
Prepare refactor of facets database
...
Prepare refactor of facets database
2022-10-26 13:46:14 +02:00
6b2fe94192
Fixes for clippy bringing us down to 18 remaining issues.
...
This brings us a step closer to enforcing clippy on each build.
2022-10-25 20:49:02 +02:00
264a04922d
Add prefix_word_pair_proximity database
...
Similar to the word_prefix_pair_proximity one but instead the keys are:
(proximity, prefix, word2)
2022-10-18 10:37:34 +02:00
4aae07d5f5
expose the size methods
2022-08-17 17:07:38 +02:00
acff17fb88
Simplify indexing tests
2022-08-04 12:03:13 +02:00
07003704a8
Merge branch 'filter/field-exist'
2022-07-21 14:51:41 +02:00
453d593ce8
Add a database containing the docids where each field exists
2022-07-19 10:07:33 +02:00
399eec5c01
Fix the indexation tests
2022-07-12 14:55:51 +02:00
250be9fe6c
put the threshold back to 10k
2022-07-05 15:57:44 +02:00
eaf28b0628
Apply review suggestions
...
Co-authored-by: Clément Renault <clement@meilisearch.com>
2022-07-05 15:30:33 +02:00
3b309f654a
Fasten the document deletion
...
When a document deletion occurs, instead of deleting the document we mark it as deleted
in the new “soft deleted” bitmap. It is then removed from the search, and all the other
endpoints.
2022-07-05 15:30:33 +02:00
177154828c
Extends deletion tests
2022-06-13 17:34:16 +02:00
Clément Renault