Clément Renault
2f0567fad1
Introduce the compressed obkv readers and writers
2024-07-10 16:32:22 +02:00
Clément Renault
98cd6a865c
Update dependencies after removing useless ones
2024-07-10 13:37:24 +02:00
Clément Renault
5f4530ce57
Remove more unused dependencies
2024-07-10 13:36:34 +02:00
Tamo
952e742321
update charabia
2024-07-09 23:41:29 +02:00
Tamo
43db4f4242
update fxprof_processed_profile
2024-07-09 23:41:29 +02:00
Tamo
9feba5028d
update byte-unit
2024-07-09 23:41:29 +02:00
Tamo
4aa7d386d8
remove http and uses actix_web::http instead
2024-07-08 21:17:10 +02:00
Tamo
6afa578688
update most incompatible dependencies
2024-07-08 18:31:15 +02:00
Tamo
300bdfc2a7
update most dependencies
2024-07-08 18:09:12 +02:00
ManyTheFish
015d90a962
merge main
2024-07-01 11:50:36 +02:00
Tamo
a108d8f6f3
update yaup
2024-06-26 16:03:51 +02:00
Tamo
1693332cab
Update arroy and always build the tree that need to be built
2024-06-24 10:14:03 +02:00
meili-bors[bot]
e9bf4c43a4
Merge #4649
...
4649: Don't store the vectors in the documents database r=dureuill a=irevoire
# Pull Request
## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4607
## What does this PR do?
- Ensure that anything falling under `_vectors` is NOT searchable, filterable or sortable
- [x] per embedder, add a roaring bitmap of documents that provide "userProvided" embeddings
- [x] in the indexing process in extract_vector_points, set the bit corresponding to the document depending on the "userProvided" subfield in the _vectors field.
- [x] in the document DB in typed chunks, when writing the _vectors field, remove all keys corresponding to an embedder
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2024-06-17 12:32:03 +00:00
Clément Renault
8ec6e175e5
Replace roaring patch to the v0.10.5
2024-06-07 22:11:26 -04:00
Clément Renault
40f05fe156
Bump roaring to the latest commit
2024-06-06 10:59:55 -04:00
Clément Renault
ff2e498267
Patch roaring to use the version supporting intersection on deserialization
2024-06-06 09:17:50 -04:00
Tamo
9eb6f522ea
wraps the index embedding config in a struct
2024-06-06 11:37:30 +02:00
Tamo
84e498299b
Remove the vectors from the documents database
2024-06-06 11:36:11 +02:00
ManyTheFish
2e50c6ec81
Update Charabia
2024-06-06 10:18:43 +02:00
Louis Dureuil
8412665957
Update actix-web 4.5.1 -> 4.6.0
2024-06-04 09:54:30 +02:00
curquiza
07fdb081a4
Update version for the next release (v1.9.0) in Cargo.toml
2024-05-28 14:19:40 +00:00
Clément Renault
7f3e51349e
Remove puffin for the dependencies
2024-05-27 15:53:06 +02:00
Tamo
c9ac7f2e7e
update heed to latest version
2024-05-20 15:19:00 +02:00
Tamo
7e251b43d4
Revert "Stream documents"
2024-05-20 15:09:45 +02:00
Tamo
273c6e8c5c
uses the latest version of heed to get rid of unsafe code
2024-05-16 18:31:32 +02:00
Tamo
897d25780e
update milli to latest version
2024-05-16 18:31:32 +02:00
Tamo
8e6ffbfc6f
stream documents
2024-05-16 18:31:32 +02:00
Clément Renault
ac4bc143c4
Bump ureq to v2.9.7
2024-05-07 10:39:38 +02:00
Clément Renault
f33a1282f8
Bump Rustls to v0.21.12
2024-05-07 10:31:39 +02:00
ManyTheFish
fe51ceca6d
Update lock file
2024-04-30 14:33:37 +02:00
ManyTheFish
c71b5d09ff
Updatre charabia v0.8.9
2024-04-18 11:38:26 +02:00
Louis Dureuil
89e72fab32
Update grenad to fix rare DB corruption
2024-04-11 21:06:59 +02:00
Tamo
c26d356a35
Merge branch 'main' into release-v1.7.5-tmp
2024-04-09 14:46:15 +02:00
meili-bors[bot]
217fbc777f
Merge #4554
...
4554: Update version for the next release (v1.7.5) in Cargo.toml r=curquiza a=meili-bot
⚠️ This PR is automatically generated. Check the new version is the expected one and Cargo.lock has been updated before merging.
Co-authored-by: irevoire <irevoire@users.noreply.github.com>
2024-04-04 18:03:04 +00:00
irevoire
7a49a056fa
Update version for the next release (v1.7.5) in Cargo.toml
2024-04-04 16:33:45 +00:00
Tamo
fd4be26718
update h2
2024-04-04 18:27:16 +02:00
Louis Dureuil
58cafcc824
Update candle
2024-04-03 13:11:56 +02:00
meili-bors[bot]
75f81a0bab
Merge #4547
...
4547: Fix milli/Cargo.toml for usage as dependency via git r=dureuill a=Toromyx
# Pull Request
## Related issues/discussions
This enables th usage of `milli` [via git repository](https://doc.rust-lang.org/cargo/reference/specifying-dependencies.html#specifying-dependencies-from-git-repositories ) as mentioned in <https://github.com/meilisearch/meilisearch/issues/3367#issuecomment-1422613815 >, <https://github.com/meilisearch/meilisearch/discussions/1523#discussioncomment-1039338 >, and <https://github.com/meilisearch/meilisearch/discussions/1981#discussioncomment-1771568 >
## What does this PR do?
Trying to depend on `milli` like
```
[dependencies.milli]
git = "https://github.com/meilisearch/meilisearch.git "
tag = "v1.7.4"
```
leads to the following error:
```
error: failed to select a version for the requirement `candle-core = "^0.3.1"`
candidate versions found which didn't match: 0.4.2
location searched: Git repository https://github.com/huggingface/candle.git
required by package `milli v1.7.4 (https://github.com/meilisearch/meilisearch.git?tag=v1.7.4#0259ad60 )`
```
because the default branch of <https://github.com/huggingface/candle > does not contain the correct version.
To fix this, i added a `rev="..."` entry in the relevant dependencies, specifiyng the commit already present in the `Cargo.lock` file.
I also updated the version to the one in the Cargo.lock. This also updated `candle-kernels` sub-dependency from 0.3.1 to 0.3.3 which is probably correct?
## PR checklist
Please check if your PR fulfills the following requirements:
- [x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
- [x] Have you read the contributing guidelines?
- [x] Have you made sure that the title is accurate and descriptive of the changes?
Thank you so much for contributing to Meilisearch!
Co-authored-by: Thomas Gauges <thomas.gauges@gmail.com>
2024-04-03 07:31:36 +00:00
Thomas Gauges
d55d496250
Fix milli/Cargo.toml for usage as dependency via git
2024-04-02 15:19:30 +02:00
dureuill
b50f518764
Update version for the next release (v1.7.4) in Cargo.toml
2024-03-27 16:12:54 +00:00
Louis Dureuil
dfa5e41ea6
Check validity of the URL setting
2024-03-25 11:23:16 +01:00
Louis Dureuil
b6b4b6bab7
Remove the tokio and the reqwests
2024-03-25 11:23:03 +01:00
Louis Dureuil
c3d02f092d
OpenAI sync
2024-03-25 11:23:03 +01:00
meili-bors[bot]
ec81c2bf1a
Merge #4511
...
4511: Bump charabia to 0.8.8 r=ManyTheFish a=6543
... and update lock file
this will add the fix (https://github.com/meilisearch/charabia/pull/275 ) to support markdown formatted codeblocks
Co-authored-by: 6543 <6543@obermui.de>
2024-03-25 09:26:11 +00:00
Tamo
48d012c3e2
Merge branch 'main' into tmp-release-v1.7.3
2024-03-21 16:39:38 +01:00
curquiza
3b8e8b7f1a
Update version for the next release (v1.7.3) in Cargo.toml
2024-03-21 11:20:30 +00:00
irevoire
18f17ed728
Update version for the next release (v1.7.2) in Cargo.toml
2024-03-20 13:59:42 +01:00
6543
4628b7b7bd
bump charabia to 0.8.8
...
and update lock file
2024-03-20 13:39:00 +01:00
Tamo
c5322df519
Revert "Revert "Merge remote-tracking branch 'origin/main' into release-v1.7.1""
2024-03-20 10:08:28 +01:00
Tamo
567194b925
Revert "Merge remote-tracking branch 'origin/main' into release-v1.7.1"
...
This reverts commit bd74cce86a
, reversing
changes made to d2f77e88bd
.
2024-03-19 16:56:21 +01:00