Commit Graph

319 Commits

Author SHA1 Message Date
mpostma 9c58ca7ce5 error codes for core 2020-05-28 16:23:46 +02:00
mpostma 30fd24aa47 fix details 2020-05-28 16:23:46 +02:00
mpostma 3bd15a4195 fix tests, restore behavior 2020-05-28 16:23:46 +02:00
mpostma c771694623 remove heed from http dependencies 2020-05-28 16:23:46 +02:00
mpostma d69180ec67 refactor errors / isolate core/http errors 2020-05-28 16:23:46 +02:00
mpostma 7c7f753463 add facet count in response 2020-05-28 12:08:38 +02:00
mpostma 2b7d614e84 fix test warnings 2020-05-27 19:32:55 +02:00
Samuel Jimenez 8438ac9756 Rename fields_frequency into fields_distribution 2020-05-26 20:40:49 +02:00
Kerollmops 8cebf78485
Bump heed to 0.8.0 and handle abort errors 2020-05-26 17:04:13 +02:00
Kerollmops bc7b0a38fd Use fst 0.4.4 in the project 2020-05-22 15:01:55 +02:00
Kerollmops 6c87723b19
Bump the fst crate to 0.4.4 2020-05-22 15:01:35 +02:00
Kerollmops ddeb5745be
Refactor a little bit 2020-05-20 17:01:57 +02:00
Kerollmops a60e3fb1cb
Rename user ids into external docids 2020-05-20 15:08:56 +02:00
Kerollmops 7bbb101555
Prefix the attributes_for_faceting key name 2020-05-20 14:19:00 +02:00
Kerollmops 788e2202c9
Reduce the DocumentId size from 64 to 32bits 2020-05-20 14:19:00 +02:00
Kerollmops 3bca31856d
Discover and remove documents ids 2020-05-20 14:18:59 +02:00
Kerollmops 5bf15a4190
Compute and merge discovered ids 2020-05-20 14:18:59 +02:00
Kerollmops 016bfa391b
Introduce internal and user ids put and get methods 2020-05-20 14:18:59 +02:00
Kerollmops e6a7521610
Introduce the DiscoverIds and DocumentsIds types 2020-05-20 14:18:59 +02:00
Kerollmops e2b115f3a9
Improve Number extraction/conversion function 2020-05-19 16:51:33 +02:00
Kerollmops ae30ee2ade
Clean up some comments and variable names 2020-05-19 16:51:33 +02:00
Kerollmops 3026840530
Introduce an index_document helper function 2020-05-19 16:51:33 +02:00
Kerollmops d300d788c7
Make the compute_document_id validate the id 2020-05-19 16:51:33 +02:00
Kerollmops 2828b5fa19
Move the helper function to their own module 2020-05-19 16:51:33 +02:00
Kerollmops 25b3c9a057
Remove the serde ExtractDocumentId struct 2020-05-19 16:51:33 +02:00
Kerollmops 2558ce9a00
Export the value_to_string helper function 2020-05-19 16:51:33 +02:00
Kerollmops 65ed2dcc1b
Remove the serde ConvertToNumber 2020-05-19 16:51:32 +02:00
Kerollmops 5e063da14f
Remove the serde Indexer 2020-05-19 16:51:32 +02:00
Kerollmops 615825b9fd
Remove the serde Serializer 2020-05-19 16:51:32 +02:00
mpostma f38d0d731f style fix 2020-05-13 11:48:34 +02:00
mpostma 869b6019c6 fix tests 2020-05-13 11:48:34 +02:00
mpostma 347045adf2 smarter field_id name passing 2020-05-13 11:29:46 +02:00
mpostma e5126af458 enables facet count 2020-05-13 11:29:46 +02:00
mpostma effbb7f7f1 add sort result struct 2020-05-12 18:22:24 +02:00
Kerollmops 48e94b4372
Enable jemalloc only on linux 2020-05-11 21:24:35 +02:00
mpostma d7f099d3ba enables faceted search 2020-05-11 17:38:52 +02:00
mpostma e07fe017c1 document update 2020-05-11 17:38:52 +02:00
mpostma 270c7b0288 facet settings 2020-05-11 16:12:13 +02:00
mpostma 59c67f6bc8 setting up facets 2020-05-11 16:12:13 +02:00
qdequele 2e55457ecc
implement default on DatabaseOptions 2020-05-07 15:40:44 +02:00
mpostma 2e3a765dac fix database options 2020-04-29 22:29:09 +02:00
Jan Emmens dff36eaef4 Fix example not compiling 2020-04-29 11:04:09 +02:00
Jan Emmens bdd088830a Add DatabaseOptions arg to query_builder test 2020-04-29 10:12:25 +02:00
Jan Emmens 17401cfbe9 Fix compilation error in unit tests 2020-04-29 09:21:07 +02:00
Jan Emmens c4287cdfac Add support for configuring lmdb map size 2020-04-29 09:21:07 +02:00
Clément Renault 287226b609 Bump crates versions to v0.10.1 2020-04-28 15:55:29 +02:00
mpostma d1f1bfe071 fix floats bug
Update CHANGELOG.md

Co-Authored-By: Clément Renault <renault.cle@gmail.com>
2020-04-28 10:44:07 +02:00
mpostma 812465e014 fixes parenthesis
adds tests
2020-04-27 22:29:29 +02:00
mposmta cd3c0d750c Add support for filtering on arrays of strings
update changelog

Update CHANGELOG.md

Co-Authored-By: Clément Renault <renault.cle@gmail.com>

fix requested changes
2020-04-21 10:33:57 +02:00
Clément Renault 979bea0327
Bump MeiliSearch version to v0.10 2020-04-10 15:43:03 +02:00
mposmta a0a481697b replace lazy_static with once_cell 2020-04-09 17:13:34 +02:00
mposmta 3e031d8297 adds error handling and integration 2020-04-09 17:13:34 +02:00
mposmta 83f50914ec tests 2020-04-09 17:13:34 +02:00
mposmta d3916f28aa implements filter logic 2020-04-09 17:13:34 +02:00
mposmta dcf1096ac3 implements parser 2020-04-09 17:13:31 +02:00
Clément Renault 29d021ad4d
Fixes the stop words and words fst generation 2020-04-06 18:53:02 +02:00
sgummaluri e5a336a042 Fix for 'First update does not appear before being processed' #542 2020-04-04 23:18:43 +05:30
Clément Renault 38c43759bb
Update most of the dependencies 2020-04-02 18:36:04 +02:00
Pedro Paulo de Amorim 9950fffb6f Simplify imports of std::fs and std::io, remove space not needed, Remove UpdateState 2020-04-02 11:02:19 +01:00
Pedro Paulo de Amorim f5d57c9dce Replace the toml reader with the JSON settings reader, directly parse the data to SettingsUpdate, Update CHANGELOG 2020-04-02 11:01:56 +01:00
Pedro Paulo de Amorim 1b47a10e89 Add support for seq values 2020-04-01 12:59:40 +01:00
Pedro Paulo de Amorim 690b8e0dd0 Replace .toString to String::new() 2020-03-31 14:01:44 +01:00
Pedro Paulo de Amorim bc6d86c8ce serialize_unit returns a empty string 2020-03-31 13:51:12 +01:00
Clément Renault 69aee870da
Make the engine index booleans
The engine will see the values like text "true" and "false"
2020-03-31 10:39:58 +02:00
Clément Renault c18e907f96
Construct a Set using the from_dirty method
This commit fixes #566 by ensuring that the slice of matches is
ordered and deduplicated.
2020-03-30 20:56:30 +02:00
mposmta a6dcd7a421 fixes tests
fixes tests impacted by sifnature change of query
2020-03-25 15:17:20 +01:00
mposmta fd65cf9dcb populates exhaustive number of hits 2020-03-25 12:44:38 +01:00
Clément Renault 3ca8db2cc1
Bump the workspace crates to 0.9.0 2020-03-19 11:56:23 +01:00
Clément Renault f6972ec682
Bump the workspace crates to 0.9.0-rc.1 2020-03-16 16:58:20 +01:00
Quentin de Quelen 2d82f1b655 ranking fields should be stored and indexed by default; fix #521 2020-03-16 16:19:23 +01:00
qdequele ef3bcd65ab
fix comments from review 2020-03-10 15:59:11 +01:00
qdequele 179969a9e2
fix tests + fmt 2020-03-10 11:29:56 +01:00
qdequele c984d8d5a5
rename identifier into primaryKey; fix #514 2020-03-09 18:45:29 +01:00
qdequele 8ffa80883a
remove the unused function 2020-03-09 18:45:29 +01:00
qdequele 86c3482cbd
review the internal schema to allow to create schema without identifier; fix #513 2020-03-09 18:45:20 +01:00
qdequele 6016f2e941 change wording of custom ranking rules `dsc` -> `desc`; #490 2020-03-06 10:15:19 +01:00
Clément Renault 5e31d28759
Fix the inference of the documents searchable fields 2020-03-03 20:54:17 +01:00
qdequele a2f0f95337
use distinct on search 2020-03-02 16:19:41 +01:00
qdequele 250aeaa86c
stop reindexing by chunk during complete reindexing 2020-02-28 11:49:12 +01:00
qdequele 47009615ee
rename words_position to wordsPosition; fix #483 2020-02-27 16:24:49 +01:00
qdequele dda08d60d2
cargo fmt 2020-02-27 14:33:57 +01:00
qdequele f182afc50b
update tests 2020-02-27 11:30:23 +01:00
qdequele bb5d931f16
rename criterions on settings route; fix #480 2020-02-27 11:30:22 +01:00
qdequele 3c74e71d4f
show default ranking rules if user reset them; fix #476 2020-02-27 11:30:17 +01:00
qdequele 79e07fa852
reset value of searchable and displayed attributes; fix #473 2020-02-27 11:04:39 +01:00
qdequele 2eb6f81c58
rename ranking_distinct to distinct_attribute; fix #474 2020-02-27 11:04:39 +01:00
qdequele a067a1b16b
replace index_new_fields to accept_new_fields; fix #475 2020-02-27 11:04:38 +01:00
Clément Renault 96248d9bfa
Change the exactness criterion in the tests 2020-02-25 14:24:15 +01:00
Clément Renault 9d167c08f4
Rename the Exact criterion into Exactness 2020-02-25 14:16:55 +01:00
qdequele 2d7a1bfce0
fix un-rankable fields errors; fix #463 2020-02-14 10:34:33 +01:00
qdequele 4986adc186
move identifier from settings to index; fix #470 2020-02-12 17:00:14 +01:00
qdequele dc9ca2ebc9
fixes for review 2020-02-12 16:51:14 +01:00
qdequele 559c2f8907
Add stop words on query 2020-02-11 15:28:00 +01:00
Quentin de Quelen dc6907e748
rebase from master 2020-02-11 15:28:00 +01:00
qdequele a5b0e468ee
fix for review 2020-02-11 15:28:00 +01:00
qdequele 50a9825a0f
fix some uses cases on settings 2020-02-11 15:27:59 +01:00
Quentin de Quelen 585bba43a0
set new attributes indexed if needed 2020-02-11 15:27:58 +01:00
qdequele 9c0497c419
change the way settings are show in updates 2020-02-11 15:27:58 +01:00
qdequele f77f38dfa0
fix update system 2020-02-11 15:27:57 +01:00
qdequele 58fe87067b
finish settings 2020-02-11 15:27:57 +01:00
Quentin de Quelen dbba310770
squash me 2020-02-11 15:27:57 +01:00
Quentin de Quelen 6deb481589
definitely remove attributes_ranked on settings; auto create it with ranking_rules 2020-02-11 15:27:57 +01:00
Quentin de Quelen 036977bfe4
add the possibility to totally clear the schema 2020-02-11 15:27:57 +01:00
Quentin de Quelen 7a6f583b1f
fix issue on ranking rules 2020-02-11 15:27:56 +01:00
Quentin de Quelen e078eafb1f
clean unused functions 2020-02-11 15:27:56 +01:00
Quentin de Quelen 6f534540a6
fix error on stop words fst 2020-02-11 15:27:56 +01:00
qdequele 38d57d213f
expose api for new settings 2020-02-11 15:27:56 +01:00
qdequele ae0a11e422
fix schema & fix tests 2020-02-11 15:27:55 +01:00
qdequele a35eb16a2a
store the schema after each document updates 2020-02-11 15:27:54 +01:00
qdequele 4f0ead625b
adapt meilisearch-http to the new schemaless option 2020-02-11 15:27:54 +01:00
qdequele 21d122a870
rewrite indexed_pos -> field_id for hightligths 2020-02-11 15:27:54 +01:00
qdequele 130fb74928
introduce a new schemaless way 2020-02-11 15:27:54 +01:00
qdequele bbe1845f66
squash-me 2020-02-11 15:27:54 +01:00
qdequele 2ee90a891c
introduce a new settings update system 2020-02-11 15:27:54 +01:00
qdequele 110adcae85
Remove the schema; fix #422 2020-02-11 15:27:53 +01:00
qdequele 91c6539baf
Rewrite the stop-words endpoint; fix #417 2020-02-11 15:27:53 +01:00
qdequele f0590d3301
Change documents routes; fix #416 2020-02-11 15:27:53 +01:00
Clément Renault 7c0d8f073b
Support compaction with multi database 2020-01-24 17:38:14 +01:00
Clément Renault a2bc689b92
Fix the tests a little bit 2020-01-22 18:12:56 +01:00
Clément Renault a9adbda2cd
Make the engine support non-exact multi-words synonyms 2020-01-22 18:11:58 +01:00
Clément Renault 0b9fe2c072
Introduce the new Query Tree creation supporting more operations 2020-01-22 17:46:46 +01:00
Clément Renault 789e05304c
Replace prints by debug logs 2020-01-21 11:05:34 +01:00
Clément Renault 7604387701
Clean up the dependencies 2020-01-21 11:04:25 +01:00
Clément Renault daffcaf4c6
Make the docids OR operation method conditional 2020-01-19 12:29:06 +01:00
Clément Renault ff1ec599e0
Try a better version of sdset 2020-01-19 12:01:24 +01:00
Clément Renault e44d498c94
Display more debug info for prefix tolerant fetches 2020-01-19 11:07:32 +01:00
Clément Renault c334d6b7fe
Avoid sorting sorted sequences, prefer using set operations 2020-01-19 10:58:01 +01:00
Clément Renault 5465e401bb
Catch query tree related errors 2020-01-17 10:41:27 +01:00
Clément Renault 9cc3c56c9c
Fix the prefix system 2020-01-16 18:41:27 +01:00
Clément Renault d7a7560220
Use an union instead of a sort for prefix fetching 2020-01-16 17:09:27 +01:00
Clément Renault 70a529d197
Reduce the number of args of update functions 2020-01-16 16:29:50 +01:00
Clément Renault be31a14326
Make the clear all operation clear caches 2020-01-16 16:19:04 +01:00
Clément Renault 96139da0d2
Reintroduce the distinct search system 2020-01-16 15:55:55 +01:00
Clément Renault 74fa9ee4df
Introduce a better higlighting system 2020-01-16 14:56:16 +01:00
Clément Renault 00336c5154
Reintroduce a basic highlight display 2020-01-16 14:24:45 +01:00
Clément Renault 3912d1ec4b
Improve query parsing and interpretation 2020-01-16 14:11:17 +01:00
Clément Renault 70d4f47f37
Differentiate short words as prefix or exact matches 2020-01-16 12:01:51 +01:00
Clément Renault 9809ded23d
Implement synonym fetching 2020-01-16 11:38:23 +01:00
Clément Renault 5f9a3546e0
Use an union instead of a sort for OR ops 2020-01-15 15:14:24 +01:00
Clément Renault db625a08f7
Update lock file 2020-01-15 12:25:14 +01:00
Clément Renault 44fec1b6c9
Cache prefixes of a length of 2 2020-01-14 18:17:52 +01:00
Clément Renault 54dacb362d
Use different algorithms for different documents ratios 2020-01-14 17:51:08 +01:00
Clément Renault 6edb460bea
Try with an exponential search 2020-01-14 16:52:24 +01:00
Clément Renault 40dab80dfa
Change the way we filter the documents 2020-01-14 14:18:01 +01:00
Clément Renault 681711fced
Fix query ids to be usize 2020-01-14 13:12:42 +01:00
Clément Renault 21c1473e0c
Introduce the distance data 2020-01-14 11:38:04 +01:00
Clément Renault 8acbdcbbad
wip: Make the new query tree work with the criteria 2020-01-13 14:36:06 +01:00
Clément Renault da8abebfa2
Introduce the query words mapping along with the query tree 2020-01-13 13:29:47 +01:00
Clément Renault 4f7a7ea0bb
Faster intersection group by 2020-01-09 16:30:03 +01:00
Clément Renault d6c9ba8f08
Store the postings lists 2020-01-09 15:04:53 +01:00