meili-bors[bot]
938149f814
Merge #4042
...
4042: Implements the new replication parameters r=ManyTheFish a=irevoire
### This PR implements the necessary parameters for the High Availability
- [ ] Update the spec
Introduce a new CLI flag called `--experimental-replication-parameters` that changes a few behaviors in the engine:
- [The auto-deletion of tasks is disabled](https://specs.meilisearch.com/specifications/text/0060-tasks-api.html#_2-technical-details )
- Upon registering a task, you can choose its task ID by sending a new header: `TaskId: 456645`. It must be a valid number, which must be superior to the last task id ever seen.
- Add the ability to « dry-register » a task. That means meilisearch will answer to you with a valid task ID like everything went well, but won’t actually write anything in the database. To do that, you need to use the `DryRun: true` header.
----
Old prototype `prototype-custom-task-id-0`:
- Adds the capability to specify your own task ID via the `TaskId` http header
- Make the task IDs a u64 instead of a u32
Co-authored-by: Tamo <tamo@meilisearch.com>
2024-02-26 11:37:34 +00:00
Tamo
eb90f0b4fb
fix and remove the file-store hack of /dev/null
2024-02-26 10:19:07 +01:00
Tamo
c2e2003a80
create a test with the dry-run parameter enabled
2024-02-22 15:51:47 +01:00
Tamo
693ba8dd15
rename the cli parameter
2024-02-21 14:33:40 +01:00
Tamo
e1a3eed1eb
update the discussion link
2024-02-21 12:30:28 +01:00
Tamo
05ae291989
implement the dry run ha parameter
2024-02-21 11:21:26 +01:00
Tamo
6ba9994916
disable the auto deletion of tasks when the ha mode is enabled
2024-02-20 12:23:39 +01:00
Tamo
01ae46dd80
add an experimental cli parameter to allow specifying your task id
2024-02-20 11:24:44 +01:00
Tamo
9ee4f55e6c
let you specify your task id
2024-02-19 14:29:33 +01:00
Eric Long
c02d585f5b
Upgrade rustls to 0.21.10 and ring to 0.17
2024-02-12 14:32:29 +08:00
Tamo
285aa15d2f
make the mode camelCase instead of lowercase
2024-02-08 15:04:06 +01:00
Tamo
2c88131bb1
rename the fmt mode to human
2024-02-08 15:04:06 +01:00
Tamo
35aa9d5904
fix an error message
2024-02-08 15:04:06 +01:00
Tamo
cfb3e6b51f
update the actix-web trace
2024-02-08 15:04:06 +01:00
Tamo
1502382316
use debug instead of debug_span
2024-02-08 15:04:06 +01:00
Louis Dureuil
ef994d84d0
Change error messages and fix tests
2024-02-08 15:04:06 +01:00
Louis Dureuil
1b74010e9e
Remove "with_line_numbers"
2024-02-08 15:04:06 +01:00
Tamo
08af0e690c
Structures a bunch of logs
2024-02-08 15:04:06 +01:00
Louis Dureuil
d71b77f18b
Add panic hook to log panics
2024-02-08 15:04:06 +01:00
Louis Dureuil
91eb67e981
logs route: make memory profiling toggling usable
2024-02-08 15:04:05 +01:00
Tamo
f70a615ed9
update the github discussion links
2024-02-08 15:04:05 +01:00
Tamo
7ff722b72e
get rids of the log dependencies everywhere
2024-02-08 15:04:05 +01:00
Tamo
bcf7909bba
add a profile_memory parameter disabled by default
2024-02-08 15:04:05 +01:00
Tamo
ceb211c515
move the /logs route to the /logs/stream route
2024-02-08 15:04:05 +01:00
Tamo
4de2db6786
add back the actix-web logs
2024-02-08 15:04:05 +01:00
Louis Dureuil
661baa716b
logs route profile mode: don't barf bytes if the buffer is not empty
2024-02-08 15:04:05 +01:00
Clément Renault
b393823f36
Replace stats_alloc with procfs
2024-02-08 15:04:05 +01:00
Tamo
f158e96fe7
fix the auth
2024-02-08 15:04:05 +01:00
Tamo
e23ec4886d
fix the tests and add tests on the experimental features
2024-02-08 15:04:03 +01:00
Tamo
7793ba67a4
hide the route logs behind a feature flag
2024-02-08 15:03:33 +01:00
Tamo
80774148fd
handle and tests errors
2024-02-08 15:03:33 +01:00
Tamo
bf5cea8b10
add a test
2024-02-08 15:03:33 +01:00
Louis Dureuil
38e1c40f38
meilisearch: logs route disconnects in profile mode
2024-02-08 15:03:33 +01:00
Louis Dureuil
afc0585c1c
meilisearch: don't spawn a report everytime Meilisearch starts
2024-02-08 15:03:33 +01:00
Tamo
77254765e8
get rids of env loggegr and fix the tests
2024-02-08 15:03:33 +01:00
Tamo
ce6e6ec2c5
stops profiling in a file by default
2024-02-08 15:03:32 +01:00
Louis Dureuil
91a8f74763
Add cancel log route
2024-02-08 15:03:32 +01:00
Tamo
abaa72e2bf
start handling reloads with profiling
2024-02-08 15:03:32 +01:00
Tamo
3c3a258a22
start exposing the profiling layer
2024-02-08 15:03:32 +01:00
Louis Dureuil
73e66d5a97
Add dummy log when calling tasks
2024-02-08 15:03:32 +01:00
Louis Dureuil
b8da117b9c
Simplify stream implementation
2024-02-08 15:03:32 +01:00
Louis Dureuil
5e52107474
better than before???
2024-02-08 15:03:32 +01:00
Tamo
bcf1c4dae5
make it compile and runtime error
2024-02-08 15:03:32 +01:00
Tamo
50f84d43f5
init commit
2024-02-08 15:03:32 +01:00
Tamo
f76cc0806e
WIP: first draft at introducing a new log route
2024-02-08 15:03:32 +01:00
Louis Dureuil
6e23040464
Use with tokio channel in Meilisearch
2024-02-08 15:03:32 +01:00
Clément Renault
ca8990394e
Remove the stats_alloc from the default features
2024-02-08 15:03:31 +01:00
Clément Renault
83fb2949c3
Give the allocator to the tracer when necessary
2024-02-08 15:03:31 +01:00
Clément Renault
771861599b
Logging the memory usage over time
2024-02-08 15:03:31 +01:00
Louis Dureuil
7e47cea0c4
Add tracing to Meilisearch
2024-02-08 15:03:31 +01:00