764 Commits

Author SHA1 Message Date
Kerollmops
fcfb39c5de
Move the RoaringBitmap related codecs into a module 2021-02-18 13:56:28 +01:00
Clément Renault
85c3d8aa52
Merge pull request #79 from meilisearch/prefix-caches
Introduce prefix databases
2021-02-17 11:27:15 +01:00
Kerollmops
aa4d9882d2
Introduce the new words-prefixes-docids infos subcomand 2021-02-17 11:22:27 +01:00
Kerollmops
49aee6d02c
Fix the database-stats infos subcommand 2021-02-17 11:22:27 +01:00
Kerollmops
7a0f86a04f
Introduce an infos command to extract the words prefixes fst 2021-02-17 11:22:27 +01:00
Kerollmops
a4a48be923
Run the words prefixes update inside of the indexing documents update 2021-02-17 11:22:26 +01:00
Kerollmops
8788485924
Take the prefix databases into account in the infos subcommand 2021-02-17 11:22:26 +01:00
Kerollmops
616ed8f73c
Clean up the word prefix pair proximities when deleting documents 2021-02-17 11:22:26 +01:00
Clément Renault
ea37fd821d
Clean up the words prefixes when deleting documents and words 2021-02-17 11:22:25 +01:00
Clément Renault
62eee9c69e
Introduce the sorter_into_lmdb_database helper function 2021-02-17 11:12:39 +01:00
Clément Renault
b5b89990eb
Compute and write the word prefix pair proximities database 2021-02-17 11:12:38 +01:00
Kerollmops
9b03b0a1b2
Introduce the word prefix pair proximity docids database 2021-02-17 11:12:38 +01:00
Clément Renault
f365de636f
Compute and write the word-prefix-docids database 2021-02-17 11:12:38 +01:00
Clément Renault
ee5a60e1c5
Clear the words prefixes when clearing an index 2021-02-17 10:45:17 +01:00
Clément Renault
5e7b26791b
Take the words-prefixes into account while computing the biggest values 2021-02-17 10:45:17 +01:00
Clément Renault
b3a21d5a50
Introduce the getters and setters for the words prefixes FST 2021-02-17 10:45:17 +01:00
Clément Renault
48b470140b
Merge pull request #84 from meilisearch/stringify-documents-ids
Stringify documents ids even when deleting documents
2021-02-15 21:30:51 +01:00
Clément Renault
89ce4e74fe
Do not change the primary key type when we serialize documents 2021-02-15 21:24:36 +01:00
Clément Renault
69acdd437e
Deserialize documents ids into JSON Values on deletion 2021-02-15 21:24:36 +01:00
Clément Renault
b3776598d8
Add a test to check deletion of documents with number as primary key 2021-02-15 21:24:35 +01:00
Clément Renault
5d0ac3e3e6
Merge pull request #81 from meilisearch/smart-workspace
Change the project to become a workspace
2021-02-14 19:02:00 +01:00
Clément Renault
fecf3d6fc1
Move the command lines helpers into different crates 2021-02-14 18:55:15 +01:00
Clément Renault
d8f3421608
Update the dependencies and remove the unused ones 2021-02-14 18:32:46 +01:00
Clément Renault
e8639517da
Change the project to become a workspace with milli as a default-member 2021-02-12 16:15:09 +01:00
Clément Renault
d450b971f9
Merge pull request #78 from meilisearch/required-changes-for-transplant
Changes for transplant
2021-02-02 16:22:09 +01:00
mpostma
8f43698a60
fix httpui 2021-02-01 19:49:51 +01:00
mpostma
3b60432687
Use update_id in UpdateBuilder
Add `the update_id` to the to the updates. The rationale is the
following:
- It allows for better tracability of the update events, thus improved
  debugging and logging.
- The enigne is now aware of what he's already processed, and can return
  it if asked. It may not make sense now, but in the future, the update
  store may not work the same way, and this information about the state
  of the engine will be desirable (distributed environement).
2021-02-01 19:46:34 +01:00
mpostma
d487791b03
derive serde for method and format
This is nicer when working with UpdateMeta struct
2021-02-01 19:46:34 +01:00
mpostma
91d8198d17
return documents number on addition 2021-02-01 19:42:10 +01:00
Clément Renault
fa0cc2dc13
Merge pull request #66 from meilisearch/show-available-facets
Expose an API to compute facets distribution
2021-02-01 18:39:45 +01:00
Clément Renault
14ae01a6c9
Fix some typos in error messages 2021-02-01 18:10:57 +01:00
Clément Renault
f5f4438b43
Remove the duplicated code inside the facet_values_from_documents method 2021-01-28 11:22:18 +01:00
Clément Renault
b6e91291fb
Add a comment to explain Serialize on FacetValue is implemented by hand 2021-01-27 18:29:56 +01:00
Clément Renault
b41bf58658
Split the FacetDistribution facet_values method into three 2021-01-27 18:29:56 +01:00
Clément Renault
a3e3bebed7
Rework the FacetDistribution execute method to use the faceted_fields struct 2021-01-27 18:29:54 +01:00
Clément Renault
11309ee99c
Rework the FacetDistribution execute method to use the faceted_fields struct 2021-01-27 14:53:50 +01:00
Clément Renault
9c8a654079
Add comments to help read the facet_values branchings 2021-01-27 14:49:08 +01:00
Clément Renault
2e00740515
Make sure that we don't iterate throught all string facet values 2021-01-27 14:41:36 +01:00
Clément Renault
b52d500fbc
Reorder the FacetType enum branching in the facet_value method 2021-01-27 14:36:49 +01:00
Clément Renault
d91d321129
Introduce some constants to the FacetDistribution struct and settings 2021-01-27 14:32:30 +01:00
Clément Renault
60480a1e2f
Rework the FacetCondition from_array constructor 2021-01-27 14:25:53 +01:00
Clément Renault
65b821b192
Rename the Index facets method into facets_distribution 2021-01-27 14:15:33 +01:00
Clément Renault
433ac8c38a
Remove the ordered-float serde feature 2021-01-27 14:11:10 +01:00
Clément Renault
70e9b1e936
Introduce a flag to the search subcommand to display the facet distribution 2021-01-26 14:58:18 +01:00
Kerollmops
61dbcfa44a
Bump the roaring to 0.6.4 2021-01-26 14:38:43 +01:00
Kerollmops
916dd3b7c5
Use the faceted_fields_ids method to fetch the ids 2021-01-26 14:14:38 +01:00
Clément Renault
b0c31500fc
Simplify the front page 2021-01-26 14:14:38 +01:00
Kerollmops
7be275b692
Add the count to the facet distribution 2021-01-26 14:14:37 +01:00
Clément Renault
4b9e81fc89
Order the facet values lexicographically 2021-01-26 14:09:09 +01:00
Clément Renault
51a37de885
Introduce the FacetValue enum type 2021-01-26 14:09:09 +01:00