Commit Graph

313 Commits

Author SHA1 Message Date
mpostma
2b7d614e84 fix test warnings 2020-05-27 19:32:55 +02:00
Samuel Jimenez
8438ac9756 Rename fields_frequency into fields_distribution 2020-05-26 20:40:49 +02:00
Kerollmops
8cebf78485
Bump heed to 0.8.0 and handle abort errors 2020-05-26 17:04:13 +02:00
Kerollmops
bc7b0a38fd Use fst 0.4.4 in the project 2020-05-22 15:01:55 +02:00
Kerollmops
6c87723b19
Bump the fst crate to 0.4.4 2020-05-22 15:01:35 +02:00
Kerollmops
ddeb5745be
Refactor a little bit 2020-05-20 17:01:57 +02:00
Kerollmops
a60e3fb1cb
Rename user ids into external docids 2020-05-20 15:08:56 +02:00
Kerollmops
7bbb101555
Prefix the attributes_for_faceting key name 2020-05-20 14:19:00 +02:00
Kerollmops
788e2202c9
Reduce the DocumentId size from 64 to 32bits 2020-05-20 14:19:00 +02:00
Kerollmops
3bca31856d
Discover and remove documents ids 2020-05-20 14:18:59 +02:00
Kerollmops
5bf15a4190
Compute and merge discovered ids 2020-05-20 14:18:59 +02:00
Kerollmops
016bfa391b
Introduce internal and user ids put and get methods 2020-05-20 14:18:59 +02:00
Kerollmops
e6a7521610
Introduce the DiscoverIds and DocumentsIds types 2020-05-20 14:18:59 +02:00
Kerollmops
e2b115f3a9
Improve Number extraction/conversion function 2020-05-19 16:51:33 +02:00
Kerollmops
ae30ee2ade
Clean up some comments and variable names 2020-05-19 16:51:33 +02:00
Kerollmops
3026840530
Introduce an index_document helper function 2020-05-19 16:51:33 +02:00
Kerollmops
d300d788c7
Make the compute_document_id validate the id 2020-05-19 16:51:33 +02:00
Kerollmops
2828b5fa19
Move the helper function to their own module 2020-05-19 16:51:33 +02:00
Kerollmops
25b3c9a057
Remove the serde ExtractDocumentId struct 2020-05-19 16:51:33 +02:00
Kerollmops
2558ce9a00
Export the value_to_string helper function 2020-05-19 16:51:33 +02:00
Kerollmops
65ed2dcc1b
Remove the serde ConvertToNumber 2020-05-19 16:51:32 +02:00
Kerollmops
5e063da14f
Remove the serde Indexer 2020-05-19 16:51:32 +02:00
Kerollmops
615825b9fd
Remove the serde Serializer 2020-05-19 16:51:32 +02:00
mpostma
f38d0d731f style fix 2020-05-13 11:48:34 +02:00
mpostma
869b6019c6 fix tests 2020-05-13 11:48:34 +02:00
mpostma
347045adf2 smarter field_id name passing 2020-05-13 11:29:46 +02:00
mpostma
e5126af458 enables facet count 2020-05-13 11:29:46 +02:00
mpostma
effbb7f7f1 add sort result struct 2020-05-12 18:22:24 +02:00
Kerollmops
48e94b4372
Enable jemalloc only on linux 2020-05-11 21:24:35 +02:00
mpostma
d7f099d3ba enables faceted search 2020-05-11 17:38:52 +02:00
mpostma
e07fe017c1 document update 2020-05-11 17:38:52 +02:00
mpostma
270c7b0288 facet settings 2020-05-11 16:12:13 +02:00
mpostma
59c67f6bc8 setting up facets 2020-05-11 16:12:13 +02:00
qdequele
2e55457ecc
implement default on DatabaseOptions 2020-05-07 15:40:44 +02:00
mpostma
2e3a765dac fix database options 2020-04-29 22:29:09 +02:00
Jan Emmens
dff36eaef4 Fix example not compiling 2020-04-29 11:04:09 +02:00
Jan Emmens
bdd088830a Add DatabaseOptions arg to query_builder test 2020-04-29 10:12:25 +02:00
Jan Emmens
17401cfbe9 Fix compilation error in unit tests 2020-04-29 09:21:07 +02:00
Jan Emmens
c4287cdfac Add support for configuring lmdb map size 2020-04-29 09:21:07 +02:00
Clément Renault
287226b609 Bump crates versions to v0.10.1 2020-04-28 15:55:29 +02:00
mpostma
d1f1bfe071 fix floats bug
Update CHANGELOG.md

Co-Authored-By: Clément Renault <renault.cle@gmail.com>
2020-04-28 10:44:07 +02:00
mpostma
812465e014 fixes parenthesis
adds tests
2020-04-27 22:29:29 +02:00
mposmta
cd3c0d750c Add support for filtering on arrays of strings
update changelog

Update CHANGELOG.md

Co-Authored-By: Clément Renault <renault.cle@gmail.com>

fix requested changes
2020-04-21 10:33:57 +02:00
Clément Renault
979bea0327
Bump MeiliSearch version to v0.10 2020-04-10 15:43:03 +02:00
mposmta
a0a481697b replace lazy_static with once_cell 2020-04-09 17:13:34 +02:00
mposmta
3e031d8297 adds error handling and integration 2020-04-09 17:13:34 +02:00
mposmta
83f50914ec tests 2020-04-09 17:13:34 +02:00
mposmta
d3916f28aa implements filter logic 2020-04-09 17:13:34 +02:00
mposmta
dcf1096ac3 implements parser 2020-04-09 17:13:31 +02:00
Clément Renault
29d021ad4d
Fixes the stop words and words fst generation 2020-04-06 18:53:02 +02:00
sgummaluri
e5a336a042 Fix for 'First update does not appear before being processed' #542 2020-04-04 23:18:43 +05:30
Clément Renault
38c43759bb
Update most of the dependencies 2020-04-02 18:36:04 +02:00
Pedro Paulo de Amorim
9950fffb6f Simplify imports of std::fs and std::io, remove space not needed, Remove UpdateState 2020-04-02 11:02:19 +01:00
Pedro Paulo de Amorim
f5d57c9dce Replace the toml reader with the JSON settings reader, directly parse the data to SettingsUpdate, Update CHANGELOG 2020-04-02 11:01:56 +01:00
Pedro Paulo de Amorim
1b47a10e89 Add support for seq values 2020-04-01 12:59:40 +01:00
Pedro Paulo de Amorim
690b8e0dd0 Replace .toString to String::new() 2020-03-31 14:01:44 +01:00
Pedro Paulo de Amorim
bc6d86c8ce serialize_unit returns a empty string 2020-03-31 13:51:12 +01:00
Clément Renault
69aee870da
Make the engine index booleans
The engine will see the values like text "true" and "false"
2020-03-31 10:39:58 +02:00
Clément Renault
c18e907f96
Construct a Set using the from_dirty method
This commit fixes #566 by ensuring that the slice of matches is
ordered and deduplicated.
2020-03-30 20:56:30 +02:00
mposmta
a6dcd7a421 fixes tests
fixes tests impacted by sifnature change of query
2020-03-25 15:17:20 +01:00
mposmta
fd65cf9dcb populates exhaustive number of hits 2020-03-25 12:44:38 +01:00
Clément Renault
3ca8db2cc1
Bump the workspace crates to 0.9.0 2020-03-19 11:56:23 +01:00
Clément Renault
f6972ec682
Bump the workspace crates to 0.9.0-rc.1 2020-03-16 16:58:20 +01:00
Quentin de Quelen
2d82f1b655 ranking fields should be stored and indexed by default; fix #521 2020-03-16 16:19:23 +01:00
qdequele
ef3bcd65ab
fix comments from review 2020-03-10 15:59:11 +01:00
qdequele
179969a9e2
fix tests + fmt 2020-03-10 11:29:56 +01:00
qdequele
c984d8d5a5
rename identifier into primaryKey; fix #514 2020-03-09 18:45:29 +01:00
qdequele
8ffa80883a
remove the unused function 2020-03-09 18:45:29 +01:00
qdequele
86c3482cbd
review the internal schema to allow to create schema without identifier; fix #513 2020-03-09 18:45:20 +01:00
qdequele
6016f2e941 change wording of custom ranking rules dsc -> desc; #490 2020-03-06 10:15:19 +01:00
Clément Renault
5e31d28759
Fix the inference of the documents searchable fields 2020-03-03 20:54:17 +01:00
qdequele
a2f0f95337
use distinct on search 2020-03-02 16:19:41 +01:00
qdequele
250aeaa86c
stop reindexing by chunk during complete reindexing 2020-02-28 11:49:12 +01:00
qdequele
47009615ee
rename words_position to wordsPosition; fix #483 2020-02-27 16:24:49 +01:00
qdequele
dda08d60d2
cargo fmt 2020-02-27 14:33:57 +01:00
qdequele
f182afc50b
update tests 2020-02-27 11:30:23 +01:00
qdequele
bb5d931f16
rename criterions on settings route; fix #480 2020-02-27 11:30:22 +01:00
qdequele
3c74e71d4f
show default ranking rules if user reset them; fix #476 2020-02-27 11:30:17 +01:00
qdequele
79e07fa852
reset value of searchable and displayed attributes; fix #473 2020-02-27 11:04:39 +01:00
qdequele
2eb6f81c58
rename ranking_distinct to distinct_attribute; fix #474 2020-02-27 11:04:39 +01:00
qdequele
a067a1b16b
replace index_new_fields to accept_new_fields; fix #475 2020-02-27 11:04:38 +01:00
Clément Renault
96248d9bfa
Change the exactness criterion in the tests 2020-02-25 14:24:15 +01:00
Clément Renault
9d167c08f4
Rename the Exact criterion into Exactness 2020-02-25 14:16:55 +01:00
qdequele
2d7a1bfce0
fix un-rankable fields errors; fix #463 2020-02-14 10:34:33 +01:00
qdequele
4986adc186
move identifier from settings to index; fix #470 2020-02-12 17:00:14 +01:00
qdequele
dc9ca2ebc9
fixes for review 2020-02-12 16:51:14 +01:00
qdequele
559c2f8907
Add stop words on query 2020-02-11 15:28:00 +01:00
Quentin de Quelen
dc6907e748
rebase from master 2020-02-11 15:28:00 +01:00
qdequele
a5b0e468ee
fix for review 2020-02-11 15:28:00 +01:00
qdequele
50a9825a0f
fix some uses cases on settings 2020-02-11 15:27:59 +01:00
Quentin de Quelen
585bba43a0
set new attributes indexed if needed 2020-02-11 15:27:58 +01:00
qdequele
9c0497c419
change the way settings are show in updates 2020-02-11 15:27:58 +01:00
qdequele
f77f38dfa0
fix update system 2020-02-11 15:27:57 +01:00
qdequele
58fe87067b
finish settings 2020-02-11 15:27:57 +01:00
Quentin de Quelen
dbba310770
squash me 2020-02-11 15:27:57 +01:00
Quentin de Quelen
6deb481589
definitely remove attributes_ranked on settings; auto create it with ranking_rules 2020-02-11 15:27:57 +01:00
Quentin de Quelen
036977bfe4
add the possibility to totally clear the schema 2020-02-11 15:27:57 +01:00
Quentin de Quelen
7a6f583b1f
fix issue on ranking rules 2020-02-11 15:27:56 +01:00
Quentin de Quelen
e078eafb1f
clean unused functions 2020-02-11 15:27:56 +01:00
Quentin de Quelen
6f534540a6
fix error on stop words fst 2020-02-11 15:27:56 +01:00
qdequele
38d57d213f
expose api for new settings 2020-02-11 15:27:56 +01:00
qdequele
ae0a11e422
fix schema & fix tests 2020-02-11 15:27:55 +01:00
qdequele
a35eb16a2a
store the schema after each document updates 2020-02-11 15:27:54 +01:00
qdequele
4f0ead625b
adapt meilisearch-http to the new schemaless option 2020-02-11 15:27:54 +01:00
qdequele
21d122a870
rewrite indexed_pos -> field_id for hightligths 2020-02-11 15:27:54 +01:00
qdequele
130fb74928
introduce a new schemaless way 2020-02-11 15:27:54 +01:00
qdequele
bbe1845f66
squash-me 2020-02-11 15:27:54 +01:00
qdequele
2ee90a891c
introduce a new settings update system 2020-02-11 15:27:54 +01:00
qdequele
110adcae85
Remove the schema; fix #422 2020-02-11 15:27:53 +01:00
qdequele
91c6539baf
Rewrite the stop-words endpoint; fix #417 2020-02-11 15:27:53 +01:00
qdequele
f0590d3301
Change documents routes; fix #416 2020-02-11 15:27:53 +01:00
Clément Renault
7c0d8f073b
Support compaction with multi database 2020-01-24 17:38:14 +01:00
Clément Renault
a2bc689b92
Fix the tests a little bit 2020-01-22 18:12:56 +01:00
Clément Renault
a9adbda2cd
Make the engine support non-exact multi-words synonyms 2020-01-22 18:11:58 +01:00
Clément Renault
0b9fe2c072
Introduce the new Query Tree creation supporting more operations 2020-01-22 17:46:46 +01:00
Clément Renault
789e05304c
Replace prints by debug logs 2020-01-21 11:05:34 +01:00
Clément Renault
7604387701
Clean up the dependencies 2020-01-21 11:04:25 +01:00
Clément Renault
daffcaf4c6
Make the docids OR operation method conditional 2020-01-19 12:29:06 +01:00
Clément Renault
ff1ec599e0
Try a better version of sdset 2020-01-19 12:01:24 +01:00
Clément Renault
e44d498c94
Display more debug info for prefix tolerant fetches 2020-01-19 11:07:32 +01:00
Clément Renault
c334d6b7fe
Avoid sorting sorted sequences, prefer using set operations 2020-01-19 10:58:01 +01:00
Clément Renault
5465e401bb
Catch query tree related errors 2020-01-17 10:41:27 +01:00
Clément Renault
9cc3c56c9c
Fix the prefix system 2020-01-16 18:41:27 +01:00
Clément Renault
d7a7560220
Use an union instead of a sort for prefix fetching 2020-01-16 17:09:27 +01:00
Clément Renault
70a529d197
Reduce the number of args of update functions 2020-01-16 16:29:50 +01:00
Clément Renault
be31a14326
Make the clear all operation clear caches 2020-01-16 16:19:04 +01:00
Clément Renault
96139da0d2
Reintroduce the distinct search system 2020-01-16 15:55:55 +01:00
Clément Renault
74fa9ee4df
Introduce a better higlighting system 2020-01-16 14:56:16 +01:00
Clément Renault
00336c5154
Reintroduce a basic highlight display 2020-01-16 14:24:45 +01:00
Clément Renault
3912d1ec4b
Improve query parsing and interpretation 2020-01-16 14:11:17 +01:00
Clément Renault
70d4f47f37
Differentiate short words as prefix or exact matches 2020-01-16 12:01:51 +01:00
Clément Renault
9809ded23d
Implement synonym fetching 2020-01-16 11:38:23 +01:00
Clément Renault
5f9a3546e0
Use an union instead of a sort for OR ops 2020-01-15 15:14:24 +01:00
Clément Renault
db625a08f7
Update lock file 2020-01-15 12:25:14 +01:00
Clément Renault
44fec1b6c9
Cache prefixes of a length of 2 2020-01-14 18:17:52 +01:00
Clément Renault
54dacb362d
Use different algorithms for different documents ratios 2020-01-14 17:51:08 +01:00
Clément Renault
6edb460bea
Try with an exponential search 2020-01-14 16:52:24 +01:00
Clément Renault
40dab80dfa
Change the way we filter the documents 2020-01-14 14:18:01 +01:00
Clément Renault
681711fced
Fix query ids to be usize 2020-01-14 13:12:42 +01:00
Clément Renault
21c1473e0c
Introduce the distance data 2020-01-14 11:38:04 +01:00
Clément Renault
8acbdcbbad
wip: Make the new query tree work with the criteria 2020-01-13 14:36:06 +01:00
Clément Renault
da8abebfa2
Introduce the query words mapping along with the query tree 2020-01-13 13:29:47 +01:00
Clément Renault
4f7a7ea0bb
Faster intersection group by 2020-01-09 16:30:03 +01:00
Clément Renault
d6c9ba8f08
Store the postings lists 2020-01-09 15:04:53 +01:00
Clément Renault
ec8916bf54
Change the debug outputs 2020-01-09 12:05:39 +01:00
Clément Renault
81c573ec92
Add the raw document IDs to the postings lists 2020-01-08 15:30:43 +01:00
Clément Renault
9420edadf4
Introduce the Postings type to decorrelate the DocumentIds 2020-01-08 14:48:23 +01:00
Clément Renault
d724a7659e
Introduce a query tree context struct 2020-01-08 13:37:22 +01:00
Clément Renault
887c212b49
Add more logs about the docids construction 2020-01-08 13:22:42 +01:00
Clément Renault
07937ed6d7
Use the prefix caches 2020-01-08 13:14:07 +01:00