106 Commits

Author SHA1 Message Date
Tamo
b9e9fc376a
add the version in the index-scheduler 2025-01-23 16:51:22 +01:00
Tamo
e41ebd3047
expose the number of database in the index-scheduler and rewrite the lib.rs to use the value provided in the options instead of a magic number 2025-01-23 16:51:21 +01:00
Tamo
705d31e8bd
apply all the comments changes 2025-01-23 16:51:21 +01:00
Tamo
bf96fdb858
update the cli url 2025-01-23 16:51:20 +01:00
Tamo
102681e384
starts adding tests and fix the starts of meilisearch 2025-01-23 16:51:18 +01:00
Tamo
d3654906bf
Add the new tasks with most of the job done 2025-01-23 16:48:32 +01:00
Louis Dureuil
89a4ac92eb
fix after rebase 2025-01-14 14:08:56 +01:00
Louis Dureuil
0c10063a87
PATCH experimental-features also returns the route type rather than internal type 2025-01-14 13:55:34 +01:00
Louis Dureuil
87ea080c10
Fully remove vector store feature 2025-01-14 13:55:34 +01:00
Louis Dureuil
de6cd3ac01
Consistent error codes 2025-01-14 13:55:34 +01:00
Louis Dureuil
73d3d286d9
Serialize features as camelCase 2025-01-14 13:53:53 +01:00
Louis Dureuil
29eeb84ce3
Add --experimental-disable-vector-store CLI flag 2025-01-14 13:53:53 +01:00
Louis Dureuil
d78951feb7
vectorStore stabilization
- `vectorStore` feature is always enabled
- `vectorStore` can no longer be set in the `/experimental-features` PATCH route
- `vectorStore` status is no longer returned in the `/experimental-features` GET route
2025-01-14 13:53:53 +01:00
Tamo
c9fb6c48b8
Update crates/meilisearch/src/routes/features.rs
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
2025-01-13 13:43:38 +01:00
Tamo
0de34aa8fa
avoid generating the same operationId 2025-01-13 12:36:22 +01:00
Tamo
6bfcad4b05
Add the server property 2025-01-13 12:13:39 +01:00
Tamo
67a0c9fff8
remove trailing slash in path 2025-01-13 11:55:59 +01:00
Tamo
5c7fa9b924
fix the examples of the experimental-feature route 2025-01-13 11:40:57 +01:00
meili-bors[bot]
42854c0bca
Merge #5223
5223: Limit batched tasks total size r=curquiza a=Kerollmops

Introduce a new engine parameter (env and config, too) to limit the maximum payload size processed by the engine in batches. You can [review the Discussion and usage on GitHub](https://github.com/orgs/meilisearch/discussions/801).

Co-authored-by: Clément Renault <clement@meilisearch.com>
2025-01-09 16:13:17 +00:00
Clément Renault
d0bdff7b7b
Make the batched tasks size limit effectively work 2025-01-09 12:06:28 +01:00
Clément Renault
8650ee66c1
Introduce the new experimental-limit-batched-tasks-total-size argument 2025-01-09 12:06:28 +01:00
Clément Renault
cf4c3c287b
Make rustfmt happy 2025-01-08 18:24:39 +01:00
Clément Renault
71e5605daa
Make clippy happy 2025-01-08 18:24:39 +01:00
Clément Renault
d4529d8c83
Fix after upgrading sysinfo 2025-01-08 15:59:30 +01:00
Clément Renault
3e3695445f
Fix after upgrading thiserror 2025-01-08 15:58:32 +01:00
Tamo
ae5a04e85c
apply review comments 2025-01-07 16:30:14 +01:00
Tamo
21026f0ca8
move the swagger behind a feature flag 2025-01-07 16:30:14 +01:00
Tamo
e579554c84
fmt 2025-01-07 16:30:12 +01:00
Tamo
ff49250c1a
remove useless doc 2025-01-07 16:29:09 +01:00
Tamo
8b95c6ae56
improve the description of all the settings route 2025-01-07 16:29:09 +01:00
Tamo
28162759a4
fix imports after rebase 2025-01-07 16:29:08 +01:00
Tamo
4456df5a46
fix some tests 2025-01-07 16:28:11 +01:00
Tamo
0b104b3efa
fix the list indexes 2025-01-07 16:26:06 +01:00
Tamo
ac944f0960
review all the return type 2025-01-07 16:26:06 +01:00
Tamo
5f55e88484
review all the parameters and tags 2025-01-07 16:26:06 +01:00
Tamo
aab6ffec30
fix and review all the documents route 2025-01-07 16:26:06 +01:00
Tamo
1dd33af8a3
add the batches 2025-01-07 16:26:06 +01:00
Tamo
8a2a1e4d27
add the experimental features route 2025-01-07 16:26:06 +01:00
Tamo
e2686c0fce
add the swap indexes 2025-01-07 16:26:06 +01:00
Tamo
9473a2a6ca
add the multi-search 2025-01-07 16:26:06 +01:00
Tamo
11ce3b9636
fix the settings 2025-01-07 16:26:06 +01:00
Tamo
0bf4157a75
try my best to make the sub-settings routes works, it doesn't 2025-01-07 16:26:06 +01:00
Tamo
4eaa626bca
add the similar route 2025-01-07 16:26:06 +01:00
Tamo
668b26b641
add the facet search 2025-01-07 16:26:06 +01:00
Tamo
04e4586fb3
add the searches route and fix a few broken things 2025-01-07 16:26:06 +01:00
Tamo
78f6f22a80
implement all the /indexes/documents route 2025-01-07 16:26:06 +01:00
Tamo
13afdaf393
finish rebase and update utoipa to the latest version 2025-01-07 16:26:06 +01:00
Tamo
742d0ee531
Implements the get and delete tasks route 2025-01-07 16:26:04 +01:00
Tamo
cb82b0798a
Split the index-scheduler in ~500 loc modules 2025-01-06 14:08:26 +01:00
meili-bors[bot]
baeefa4817
Merge #5166
5166: fix list indexes r=dureuill a=irevoire

# Pull Request

### Smol benchmark on a meilisearch with 1009 indexes:

**Before** this PR on my computer, it was taking 5.5s to call the `GET /indexes` route on a cold computer where all the indexes were closed.
**After** this PR it takes 0.009s to call the route on the first 20 indexes, and 0.176 for the last 20 indexes (retrieving the first or last indexes on main has no impact on performances).

If my computations are right, that's between 61111.1% and 3125% faster on this test 😂 

## Related issue
Fixes https://github.com/meilisearch/meilisearch/issues/4694

## What does this PR do?
- Add the primary key to the cache we already have in the index-mapper
- Provide a new route to retrieve the paginated indexes straight from the cache without opening them
- Fix a bug where the cache was not computed when loading a dump and was forcing us to open the indexes to compute their stats on the fly

## Is it breaking?

Since the field I added is an `Option` I think we should consider it as non-breaking and let it update itself automatically on the next operation of this index.
I also tested to run my patch over a DB generated on release-v1.12.0 and it works. The importing a dump also works.

Co-authored-by: Tamo <tamo@meilisearch.com>
2024-12-31 10:55:22 +00:00