searchengines-web/MeiliSearch
searchengines-web/MeiliSearch
1
0
Fork 0
mirror of https://github.com/meilisearch/MeiliSearch synced 2024-11-30 00:34:26 +01:00
Code Issues Releases Wiki Activity
8,768 Commits 167 Branches 390 Tags 187 MiB
467b49153d
Commit Graph

8768 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Clément Renault
600aa223c2
Fix a bug where generated docids were not saved when indexing JSON docs 2020-11-01 12:19:07 +01:00
Clément Renault
f0e63025b0
Update the Transform struct to support JSON stream updates 2020-11-01 12:19:06 +01:00
dependabot[bot]
93953103ad
Bump serde from 1.0.116 to 1.0.117 
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.116 to 1.0.117.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.116...v1.0.117)

Signed-off-by: dependabot[bot] <support@github.com>
 2020-11-01 05:40:44 +00:00
Kerollmops
082ad84914
Fix the benchmarks 2020-10-31 22:18:29 +01:00
Kerollmops
6d52c5b2f0
Introduce a parameter to disable the engine to autogenerate docids 2020-10-31 21:46:55 +01:00
Clément Renault
21b4d60101
Add replace/update csv/json from the HTTP server 2020-10-31 20:52:49 +01:00
Clément Renault
a4f8be7811
Support numbers and boolean when indexing JSON 2020-10-31 20:52:49 +01:00
Clément Renault
f0d028d3a4
Update the Transform struct to support JSON updates 2020-10-31 20:52:49 +01:00
Clément Renault
9d47ee52b4
Generate a uuid v4 based document id when missing 2020-10-31 15:11:06 +01:00
Clément Renault
ddbd336387
Introduce primary key methods on the index 2020-10-31 11:50:59 +01:00
Juan Eugenio Abadie
f25890c140 Make small improvements 2020-10-30 23:48:23 -03:00
Clément Renault
0d01e4854b
Add a test to check that merging works correctly with CSVs 2020-10-30 13:46:56 +01:00
Clément Renault
955302fd95
Introduce an HTTP route to clear the documents 2020-10-30 13:12:55 +01:00
Clément Renault
7cc1a358f5
Fix a documents indexing bug and add a test 2020-10-30 12:14:25 +01:00
Clément Renault
99da69c85f
Introduce the prepare_for_closing Index method 2020-10-30 11:46:14 +01:00
Clément Renault
222063b19d
Introduce the Index path method 2020-10-30 11:46:00 +01:00
Clément Renault
085d3b9d94
Update heed to 0.10.0 2020-10-30 11:42:00 +01:00
Clément Renault
a30206a665
Prefer using iterator put_current instead of a get put method 2020-10-30 11:13:45 +01:00
Clément Renault
e63fdf2b22
Move the heed env into the index itself to ease the usage of the library 2020-10-30 10:56:35 +01:00
Clément Renault
b5d52b6b45
Prefer using a smallstr instead of a real String to reduce allocations 2020-10-29 14:32:32 +01:00
Clément Renault
40993a0d25
Fix an indexing process bug, where documents were not written in order 2020-10-29 14:20:03 +01:00
Clément Renault
855a251489
Enable the clear documents optimization that wasn't working due to a bug 2020-10-29 13:52:48 +01:00
bors[bot]
39cf1931ae
Merge #1047 
1047: bump meilisearch r=Kerollmops a=MarinPostma



Co-authored-by: mpostma <postma.marin@protonmail.com>
 2020-10-28 11:42:24 +00:00
mpostma
bbb6771625 bump meilisearch 2020-10-28 12:36:52 +01:00
Clément Renault
1228c2948d
Add a comment about the ClearDocuments operation in the DeleteDocuments 2020-10-28 11:17:36 +01:00
Clément Renault
98fc24cbdf
Bump heed to fix a prefix iter bug 2020-10-28 10:55:21 +01:00
Kerollmops
d6338af766
Improve documents deletion by iterating over all the word pair positions 2020-10-27 18:50:09 +01:00
Clément Renault
3889d956d9
Introduce the UpdateBuilder and use it in the HTTP routes 2020-10-27 18:47:58 +01:00
bors[bot]
e9f9f270e1
Merge #1045 
1045: Revert "Merge #1037" r=MarinPostma a=MarinPostma

This reverts commit 257f9fb2b2, reversing
changes made to 9bae7a35bf.

The reason fo this is that de-unicoding is not always desirable (for example is the case of CJK documents). This cannot be handled correctly for now, and will necessitate work on the tokenizer.

Co-authored-by: mpostma <postma.marin@protonmail.com>
 2020-10-27 17:16:27 +00:00
mpostma
190b78b7be Revert "Merge #1037" 
This reverts commit 257f9fb2b2, reversing
changes made to 9bae7a35bf.
 2020-10-27 17:27:47 +01:00
bors[bot]
257f9fb2b2
Merge #1037 
1037: Synonym unidecode r=Kerollmops a=MarinPostma

fix #964 

- unidecodes all synonyms before adding them to the synonyms fst
- stores a copy of the original synonyms (unicoded) for later retrieve

Co-authored-by: mpostma <postma.marin@protonmail.com>
 2020-10-27 10:57:40 +00:00
mpostma
d35a104ad3 requested changes 2020-10-27 11:53:24 +01:00
bors[bot]
9bae7a35bf
Merge #1032 
1032: Remove not maintained csv movies dataset r=MarinPostma a=bidoubiwa

Remove `movies.csv` from the dataset folder as it is not updated and not usable with MeiliSearch without converting it to json.

Co-authored-by: Charlotte Vermandel <charlottevermandel@gmail.com>
 2020-10-27 08:18:20 +00:00
mpostma
33c7c5a7e3 remove del_synonyms function 2020-10-26 21:33:39 +01:00
mpostma
91363daeaa add tests 2020-10-26 17:48:13 +01:00
mpostma
f9ab85adbe deunicase synonyms 2020-10-26 17:47:55 +01:00
Clément Renault
5c62fbb6a8
Move the IndexDocuments update into its own module 2020-10-26 12:21:13 +01:00
Clément Renault
8f76ec97c0
Move the DeleteDocuments update into its own module 2020-10-26 11:01:00 +01:00
Clément Renault
92ef1faa97
Move the ClearDocuments update into its own module 2020-10-26 10:58:17 +01:00
Clément Renault
1e1821f002
Introduce the merge_two_obkv function to merge documents on update 2020-10-26 10:55:07 +01:00
Clément Renault
60347a5483
Move the AvailableDocumentsIds iterator into the update module 2020-10-26 10:53:23 +01:00
Clément Renault
b14cca2ad9
Introduce the UpdateBuilder type along with some update operations 2020-10-25 18:32:01 +01:00
Clément Renault
adacc7977d
Make the Index return default values when value don't exist 2020-10-25 18:30:24 +01:00
Clément Renault
a7a4984175
Introduce the Transform type into the indexing system 2020-10-24 17:06:09 +02:00
Clément Renault
b44b04d25b
Serialize the CSV record values as JSON strings 2020-10-24 14:43:46 +02:00
Clément Renault
656a851830
Introduce the Transform struct transforming CSVs 
This allows us to:
  - transform a CSV, a JSON or a JSON lines data type into the same
    Grenad x Obkv streamable data type and creates the new FieldsIdsMap.
  - Extract all the documents user ids in advance to be able to delete
    the existing documents before re-indexing them.
  - Keep the last documents with the same user id avoiding duplicates
    in the same request.
 2020-10-24 13:37:38 +02:00
Clément Renault
8d82e37ec0
Introduce the AvailableDocumentsIds iterator 2020-10-23 12:07:01 +02:00
Charlotte Vermandel
9dbf43d3e7 Update readme accordingly 2020-10-22 20:33:20 +02:00
Charlotte Vermandel
772f4d6671 Remove not maintained cvs movies dataset 2020-10-22 20:33:20 +02:00
bors[bot]
1b57218739
Merge #1040 
1040: Update movie posters r=Kerollmops a=bidoubiwa

This PR resolves 3 issues: 

1. update posters URLs that changed
2. All posters point to a smaller image ( +- 20kb instead of 500kb+-) this was done by changing the width size from 1280 px to 500 px. 
3. Remove films that are not in the tmdb database

Co-authored-by: Charlotte Vermandel <charlottevermandel@gmail.com>
 2020-10-22 16:38:41 +00:00