Commit Graph

9464 Commits

Author SHA1 Message Date
nd419
f741942226
Remove redundant black_box import 2020-10-15 15:57:34 +01:00
Clément Renault
90d4c1d153
Simplify the words pair proximity computation 2020-10-15 16:18:43 +02:00
qdequele
a27399cf65 apply recommanded updates from dependabot 2020-10-15 13:26:52 +02:00
bors[bot]
29b8810db8
Merge #914
914: lazily create an index on documents push r=LegendreM a=qdequele

Create an index if it's possible when a user trying to send data to a non-existing index. https://github.com/meilisearch/MeiliSearch/issues/918

Co-authored-by: qdequele <quentin@meilisearch.com>
Co-authored-by: qdequele <quentin@dequelen.me>
2020-10-15 09:37:15 +00:00
qdequele
a5a47911d1 add tests 2020-10-15 09:43:54 +02:00
Clément Renault
9021b2dba6
Introduce the enable-chunk-fusing flag 2020-10-14 18:44:59 +02:00
bors[bot]
7bf6a3d7b2
Merge #984
984: Add test search r=LegendreM a=LegendreM

- Get an error if the index does not exist
- Get an error if a parameter is not expected (e.g.: "lol")
- Check a basic search with no parameter
- Check a basic search with only a q parameter

isssue #814 

Co-authored-by: many <maxime@meilisearch.com>
2020-10-14 16:22:10 +00:00
Kerollmops
f980422c57
Move from oxidized-mtbl to grenad 2020-10-14 12:47:32 +02:00
bors[bot]
0cabcb7c79
Merge #979
979: Add dependabot with a monthly update r=LegendreM a=qdequele



Co-authored-by: qdequele <quentin@dequelen.me>
2020-10-14 09:15:48 +00:00
bors[bot]
f359b64d59
Merge #946
946: Sort displayedAttributes field r=MarinPostma a=gorogoroumaru

Fix #943

displayedAttributes use the HashSet struct which is an unsorted structure, so I changed the implementation from HashSet into BTreeSet.

Co-authored-by: gorogoroumaru <zokutyou2@gmail.com>
2020-10-13 14:37:47 +00:00
bors[bot]
2f3ecab8d9
Merge #978
978: Add code coverage r=MarinPostma a=qdequele



Co-authored-by: qdequele <quentin@dequelen.me>
2020-10-13 14:12:53 +00:00
qdequele
17f71a1a55 add lazy create index on settings handlers 2020-10-13 10:54:02 +02:00
qdequele
bfe3bb0eeb create an helper to allow to delete the index on error 2020-10-13 10:54:02 +02:00
qdequele
0a67248bfe cargo fmt 2020-10-13 10:54:02 +02:00
qdequele
2644f087d0 add tests 2020-10-13 10:54:02 +02:00
qdequele
91c8c7a2e3 lazily create an index during document addition 2020-10-13 10:54:02 +02:00
qdequele
029abd3413 add code coverage 2020-10-13 10:53:26 +02:00
qdequele
726756bad4 add dependabot with a monthly update 2020-10-13 10:52:17 +02:00
many
10c56d9919
Add test on search
related to SEARCH part in #814
2020-10-13 10:38:22 +02:00
bors[bot]
5f59f93804
Merge #1007
1007: fix clippy errors r=MarinPostma a=qdequele

I fixed clippy warning and errors. It will allow us to not have future issues when bors try to merge a branch. 

Co-authored-by: qdequele <quentin@dequelen.me>
2020-10-13 08:29:49 +00:00
qdequele
704defea78 fix clippy 2020-10-13 10:01:57 +02:00
gorogoroumaru
eb240c8b60 update test 2020-10-10 06:13:27 +00:00
gorogoroumaru
c3bcd7a410 Merge branch 'issue943' of https://github.com/gorogoroumaru/MeiliSearch into issue943 2020-10-10 02:58:16 +00:00
gorogoroumaru
26124e6436 update test 2020-10-10 02:56:44 +00:00
gorogoroumaru
3cd6f5c7ea
Merge branch 'master' into issue943 2020-10-10 11:50:45 +09:00
gorogoroumaru
7c646e031c update test 2020-10-10 02:43:09 +00:00
Clément Renault
b342a86c15
Divide the max-memory parameter by the number of sorters in the store 2020-10-08 17:27:53 +02:00
nd419
0a2ca075d3
fix(core): fix benchmark in core with types
forces a dereference onto query and then creates an option to wrap the
query

Closes 994
2020-10-08 13:37:58 +01:00
Kerollmops
fb2c402ae1
Split the max-memory by the number of jobs 2020-10-07 14:23:22 +02:00
Kerollmops
38820bc75c
Improve and simplify the query tokenizer 2020-10-07 14:23:22 +02:00
Kerollmops
4e9bd1fef5
Bump oxidized-mtbl 2020-10-07 14:23:22 +02:00
Kerollmops
a00f5850ee
Add support for placeholder search for empty queries 2020-10-06 20:19:50 +02:00
bors[bot]
b406b6ee44
Merge #989
989: URL encode search in web UI r=LegendreM a=akrantz01

Fixes #986 

Co-authored-by: Alex Krantz <alex@krantz.dev>
2020-10-06 15:28:46 +00:00
Kerollmops
433d9bbc6e
Use CompressionType::from_str rather than a custom function 2020-10-06 13:50:34 +02:00
Kerollmops
4b819457c9
Enable the strucopt/clap warp help feature 2020-10-06 13:06:22 +02:00
Alex Krantz
726e867058
URL encode search in web UI
Fixes #986
2020-10-05 11:57:52 -07:00
Clément Renault
a2182e68a6
Rewrite the parallel merge indexing part 2020-10-05 20:54:06 +02:00
Kerollmops
e9e03259c1
Improve the mDFS performance and return the proximity 2020-10-05 18:13:56 +02:00
Kerollmops
bb15f16d8c
Merge other databases content while writing into LMDB at the same time 2020-10-05 16:35:10 +02:00
Clément Renault
9af946a306
Merging the main, word docids and words pairs proximity docids in parallel 2020-10-04 18:40:34 +02:00
Clément Renault
99705deb7d
Directly use a writer for the docid word positions 2020-10-04 18:17:53 +02:00
Clément Renault
67577a3760
It is an error to merge docid word positions 2020-10-04 17:31:12 +02:00
Clément Renault
ce8e56ee18
Rewrite the indexer to use one MTBL by database
This allows us to avoid prefixing keys and appending into LMDB databases
2020-10-04 17:04:33 +02:00
Clément Renault
770f29fd05
Bump the oxidized-mtbl dependency 2020-10-04 17:04:33 +02:00
Clément Renault
acd2a63879
Introduce a simple FST based chinese word segmenter 2020-10-04 17:04:33 +02:00
Clément Renault
6cc6addc2f
Increase the CboRoaringBitmapCodec threshold 2020-10-02 17:06:17 +02:00
Clément Renault
e41a3822a6
Add a simple test for the CboRoaringBitmapCodec 2020-10-02 16:52:36 +02:00
Clément Renault
c4b0c57059
Reduce the default indexer max-memory parameter 2020-10-02 16:47:41 +02:00
Kerollmops
007e647462
Introduce the Mdfs Iterator that explore the proximity graph using a mana DFS 2020-10-02 16:46:07 +02:00
Kerollmops
d4e80407e5
Introduce the mana depth first search algorithm 2020-10-02 16:46:07 +02:00