Tamo
9ff0fe952e
split the run function in two
2022-10-27 11:33:41 +02:00
Tamo
a8b18b2c96
fix the register test
2022-10-27 11:33:40 +02:00
Tamo
5436b996ab
reduce the size of the snapshots
2022-10-27 11:33:40 +02:00
Tamo
7d0c8a3379
test the register tasks
2022-10-27 11:33:40 +02:00
Tamo
fc098022c7
start integrating the index-scheduler in the meilisearch codebase
2022-10-27 11:33:40 +02:00
Tamo
b816535e33
greatly reduce the number of warnings
2022-10-27 11:33:40 +02:00
Tamo
38e4ffe73c
fix smol typo
2022-10-27 11:33:40 +02:00
Tamo
366a344474
get rids of the horrendous spinlock in favor of synchronoise
2022-10-27 11:33:39 +02:00
Tamo
7b6673dc1d
implement the index swap in the index mapper
2022-10-27 11:33:39 +02:00
Tamo
03aca2e452
move the index mapping logic in another structure
2022-10-27 11:33:39 +02:00
Tamo
4129783019
migrate the index handling code in a different file + implements the create index
2022-10-27 11:33:39 +02:00
Tamo
1804416afa
reintroduce the uuid mapping for the indexes
2022-10-27 11:33:39 +02:00
Tamo
c97d51a624
add a bunch of tests
2022-10-27 11:33:39 +02:00
Tamo
803f2157af
split the DocumentAdditionOrUpdate in two tasks; DocumentAddition and DocumentUpdate
2022-10-27 11:33:38 +02:00
Tamo
b7c5b71a53
starts importing the real tasks
2022-10-27 11:33:38 +02:00
Tamo
5cc8f96237
get rids of the auto-generated mains
2022-10-27 11:33:38 +02:00
Tamo
94e29a9f5f
extract the index abstraction out of the index-scheduler in its own module
2022-10-27 11:33:38 +02:00
Tamo
48138c21a9
rename the update-file-store to file-store since it can store any kind of file
2022-10-27 11:33:38 +02:00
Tamo
76597fc382
import the update_file_store in the index-scheduler
2022-10-27 11:33:37 +02:00
Tamo
2afb381f95
get rids of nelson
2022-10-27 11:33:37 +02:00
Tamo
a9844bd4f6
move the update file store to another crate with as little dependencies as possible
2022-10-27 11:33:37 +02:00
Tamo
a0588d6b94
finishes the global skelton of the auto-batcher
2022-10-27 11:33:37 +02:00
Tamo
b3c9b128d9
polish the global structure of the batch creation
2022-10-27 11:33:37 +02:00
Irevoire
448f44f631
move the autobatcher logic to another file
2022-10-27 11:33:36 +02:00
Tamo
f638774764
add the document format file
2022-10-27 11:33:36 +02:00
Tamo
516860f342
fix the create_new_batch method
2022-10-27 11:33:36 +02:00
Tamo
6b9689a1c0
fix the whole batchKind thingy
2022-10-27 11:33:36 +02:00
Tamo
af0f5d6c0c
implements most operations
2022-10-27 11:33:36 +02:00
Tamo
5a7fcf2688
fix a few typos
2022-10-27 11:33:35 +02:00
Tamo
30d2b24689
implements the index deletion, creation and swap
2022-10-27 11:33:35 +02:00
Tamo
72b2e68de4
makes the updates getters smoother to uses
2022-10-27 11:33:35 +02:00
Tamo
7879189c6b
make the project compile again
2022-10-27 11:33:35 +02:00
Tamo
46b8ebcab4
fix the file store
2022-10-27 11:33:35 +02:00
Tamo
fa742f60e8
make the file store entirely synchronous, including the file deletion
2022-10-27 11:33:35 +02:00
Tamo
a7aa92df5f
fix most of the index module
2022-10-27 11:33:34 +02:00
Irevoire
d8b8e04ad1
wip porting the index back in the scheduler
2022-10-27 11:33:34 +02:00
Irevoire
fe330e1be9
add a little bit of documentation
2022-10-27 11:33:34 +02:00
Tamo
2c4e5ce8be
implements the filter query
2022-10-27 11:33:34 +02:00
Tamo
705af94fd7
add the task to the index db in the register task
2022-10-27 11:33:34 +02:00
Tamo
ed745591e1
split the scheduler into multiples files
2022-10-27 11:33:34 +02:00
Tamo
22d24dba56
implement the get_batch method
2022-10-27 11:33:33 +02:00
Tamo
1a47949063
START THE REWRITE OF THE INDEX SCHEDULER: index & register has been implemented
2022-10-27 11:33:33 +02:00
bors[bot]
ab1800551f
Merge #2922
...
2922: Add new error when using /keys without masterkey set r=ManyTheFish a=vishalsodani
# Pull Request
## Related issue
Fixes #2918
Please check if your PR fulfills the following requirements:
- [x] Does this PR fix an existing issue, or have you listed the changes applied in the PR description (and why they are needed)?
- [x] Have you read the contributing guidelines?
- [x] Have you made sure that the title is accurate and descriptive of the changes?
Co-authored-by: vishalsodani <vishalsodani@rediffmail.com>
2022-10-27 09:13:11 +00:00
vishalsodani
689bef7ad2
fmt the code
2022-10-27 14:09:38 +05:30
vishalsodani
89c40c83c3
refactor code to avoid cloning
2022-10-27 14:08:29 +05:30
vishalsodani
03ba830ab2
uncomment tests
2022-10-27 12:59:28 +05:30
vishalsodani
9cf3ff72a3
fix checking of master key as per review comment
2022-10-27 12:56:18 +05:30
bors[bot]
25ec51e783
Merge #2601
...
2601: Ease search result pagination r=Kerollmops a=ManyTheFish
# Summary
This PR is a prototype enhancing search results pagination (#2577 )
# Todo
- [x] Update the API to return the number of pages and allow users to directly choose a page instead of computing an offset
- [x] Change computation of `total_pages` in order to have an exact count
- [x] compute query tree exhaustively
- [x] compute distinct exhaustively
# Small Documentation
## Default search query
**request**:
```sh
curl \
-X POST 'http://localhost:7700/indexes/movies/search ' \
-H 'Content-Type: application/json' \
--data-binary '{ "q": "botman" }'
```
**result**:
```json
{
"hits":[...],
"query":"botman",
"processingTimeMs":5,
"hitsPerPage":20,
"page":1,
"totalPages":4,
"totalHits":66
}
```
## Search query with offset parameter
**request**:
```sh
curl \
-X POST 'http://localhost:7700/indexes/movies/search ' \
-H 'Content-Type: application/json' \
--data-binary '{ "q": "botman", "offset": 0 }'
```
**result**:
```json
{
"hits":[...],
"query":"botman",
"processingTimeMs":3,
"limit":20,
"offset":0,
"estimatedTotalHits":66
}
```
## Search query selecting page with page parameter
**request**:
```sh
curl \
-X POST 'http://localhost:7700/indexes/movies/search ' \
-H 'Content-Type: application/json' \
--data-binary '{ "q": "botman", "page": 2 }'
```
**result**:
```json
{
"hits":[...],
"query":"botman",
"processingTimeMs":5,
"hitsPerPage":20,
"page":2,
"totalPages":4,
"totalHits":66
}
```
# Related
fixes #2577
## In charge of the feature
Core: `@ManyTheFish`
Docs: `@guimachiavelli`
Integration: `@bidoubiwa`
Co-authored-by: ManyTheFish <many@meilisearch.com>
2022-10-26 16:10:58 +00:00
ManyTheFish
f4021273b8
Add is_finite_pagination method to SearchQuery
2022-10-26 18:08:29 +02:00
vishalsodani
f0ecacb58d
add implementation for no master key set and fix tests
2022-10-25 22:41:48 +05:30