Commit Graph

100 Commits

Author SHA1 Message Date
many
1df0fdf3e2
fix synonyms normalization
Synonyms needs to be indexed in ascendant order,
and the new normalization step for synonyms potentially changes this order
which break the indexation process
because "Harry Potter" > "HP"  but "harry potter" < "hp"
2021-02-03 15:21:06 +01:00
bors[bot]
c984fa1071
Merge #1176
1176: fix race condition in  document addition r=Kerollmops a=MarinPostma

As described in #1160, there was a race condition when updating settings and adding documents simultaneously. This was due to the schema being updated and document addition being processed in two different transactions. This PR moves the schema update logic for the primary key in the same transaction as the document addition, while maintaining the input checks for the validity of the primary key in the http route, in order not to break the error reporting for the document addition route.

close #1160.

Co-authored-by: mpostma <postma.marin@protonmail.com>
Co-authored-by: marin <postma.marin@protonmail.com>
2021-02-02 09:26:32 +00:00
Many
940f83698c
Update meilisearch-core/src/update/settings_update.rs
Co-authored-by: marin <postma.marin@protonmail.com>
2021-02-01 12:06:48 +01:00
marin
1d910dbb42
Update meilisearch-core/src/update/documents_addition.rs
Co-authored-by: Clément Renault <clement@meilisearch.com>
2021-01-15 00:55:31 +01:00
mpostma
430a5f902b
fix race condition in document addition 2021-01-13 13:17:52 +01:00
Many
bc0d53e819
Update meilisearch-core/src/update/settings_update.rs
Co-authored-by: marin <postma.marin@protonmail.com>
2021-01-13 13:17:19 +01:00
many
06b2a587af
normalize synonyms during indexation 2021-01-12 13:53:32 +01:00
mpostma
206308c1aa
replace hashset with fst::Set 2021-01-05 15:21:05 +01:00
mpostma
8843062604
fix indexer tests 2021-01-05 15:21:05 +01:00
mpostma
5fe0e06342 fix clippy warnings 2020-12-15 12:42:19 +01:00
mpostma
2904ca7f57 update codebase with shcema refactor 2020-12-15 12:04:51 +01:00
mpostma
56ad400c49 update heed 2020-12-09 11:27:38 +01:00
mpostma
3a0861694d fix clear document bug 2020-11-19 14:04:07 +01:00
mpostma
a8ab15d65d Revert "Merge #1001"
This reverts commit 690eab4a25, reversing
changes made to 086020e543.

update changelog
2020-11-02 15:10:09 +01:00
mpostma
190b78b7be Revert "Merge #1037"
This reverts commit 257f9fb2b2, reversing
changes made to 9bae7a35bf.
2020-10-27 17:27:47 +01:00
mpostma
d35a104ad3 requested changes 2020-10-27 11:53:24 +01:00
mpostma
f9ab85adbe deunicase synonyms 2020-10-26 17:47:55 +01:00
mpostma
dc2e5ceed2 fix bug 2020-10-16 14:16:12 +02:00
many
1639a7338d add test to reproduce #891 bug report
fix bug
2020-10-16 13:35:11 +02:00
mpostma
ac7226bb27 fix deserializer 2020-10-16 13:02:44 +02:00
mpostma
d114250ebb requested changes 2020-07-16 16:19:15 +02:00
mpostma
4b5437a882 fix displayed attrs empty array bug 2020-07-15 19:25:24 +02:00
mpostma
de4caef468 test reset attributes to wildcard 2020-07-15 18:56:19 +02:00
mpostma
51b7cb2722 remove accept new fields / add indexed * 2020-07-15 18:56:19 +02:00
mpostma
7f5fb50307 add displayed attributes wildcard 2020-07-15 18:56:19 +02:00
mpostma
f54397e0cf test unique document id bug 2020-07-13 15:14:07 +02:00
mpostma
754efe1f42 fix document id uniqueness bug 2020-07-13 15:14:07 +02:00
mpostma
bbe3a10107 implement placeholder search 2020-07-03 17:17:28 +02:00
mpostma
3c51e9f5ed Enable error code reporting for update errors 2020-07-02 15:18:30 +02:00
mpostma
4f6a6b1359 make clippy happy 2 2020-06-30 11:01:07 +02:00
mpostma
21253a2bcb make setting enums more balanced 2020-06-30 11:01:07 +02:00
mpostma
8035ca7138 fix distinct attribute behavior 2020-06-22 12:16:35 +02:00
mpostma
6167a10e5e change ranking rule addition behavior 2020-06-22 12:16:35 +02:00
mpostma
fabb1985ca recompute all facets during document addition 2020-06-22 11:40:08 +02:00
mpostma
d69180ec67 refactor errors / isolate core/http errors 2020-05-28 16:23:46 +02:00
Kerollmops
bc7b0a38fd Use fst 0.4.4 in the project 2020-05-22 15:01:55 +02:00
Kerollmops
ddeb5745be
Refactor a little bit 2020-05-20 17:01:57 +02:00
Kerollmops
a60e3fb1cb
Rename user ids into external docids 2020-05-20 15:08:56 +02:00
Kerollmops
788e2202c9
Reduce the DocumentId size from 64 to 32bits 2020-05-20 14:19:00 +02:00
Kerollmops
3bca31856d
Discover and remove documents ids 2020-05-20 14:18:59 +02:00
Kerollmops
5bf15a4190
Compute and merge discovered ids 2020-05-20 14:18:59 +02:00
Kerollmops
e2b115f3a9
Improve Number extraction/conversion function 2020-05-19 16:51:33 +02:00
Kerollmops
ae30ee2ade
Clean up some comments and variable names 2020-05-19 16:51:33 +02:00
Kerollmops
3026840530
Introduce an index_document helper function 2020-05-19 16:51:33 +02:00
Kerollmops
d300d788c7
Make the compute_document_id validate the id 2020-05-19 16:51:33 +02:00
Kerollmops
2828b5fa19
Move the helper function to their own module 2020-05-19 16:51:33 +02:00
Kerollmops
25b3c9a057
Remove the serde ExtractDocumentId struct 2020-05-19 16:51:33 +02:00
Kerollmops
2558ce9a00
Export the value_to_string helper function 2020-05-19 16:51:33 +02:00
Kerollmops
65ed2dcc1b
Remove the serde ConvertToNumber 2020-05-19 16:51:32 +02:00
Kerollmops
5e063da14f
Remove the serde Indexer 2020-05-19 16:51:32 +02:00