Clément Renault
9b01506cee
Move the load snapshot step into a function
2023-09-12 16:05:02 +02:00
Clément Renault
f37fdceb15
Use slashes instead of dots for the s3 paths separators
2023-09-12 15:46:15 +02:00
Clément Renault
f544cfa444
Remove tasks and content file on the s3
2023-09-12 15:19:45 +02:00
Clément Renault
c158d03337
Fix internal error
2023-09-12 14:46:13 +02:00
Tamo
b7109c0fd2
start a script to run everything
2023-09-12 11:34:59 +02:00
Kerollmops
a53a0fdb77
Store content files into the S3
2023-09-11 18:17:22 +02:00
Clément Renault
719fdd701b
Fix and crash when the tasks path is unknown
2023-09-07 11:31:18 +02:00
Kerollmops
01c13c98ac
Mastering minio
2023-09-06 17:54:21 +02:00
Tamo
5b89276fcc
starts using s3
2023-09-05 19:25:09 +02:00
Kerollmops
41697c4d65
Introduce the zk-tasks folder
2023-09-04 18:24:34 +02:00
Kerollmops
7d85753573
Make the snapshot download work
2023-09-04 17:38:56 +02:00
Kerollmops
76657af1f9
Add the options into the IndexScheduler
2023-09-04 16:38:05 +02:00
Tamo
966cbdab69
make the tests compile again
2023-09-04 15:39:54 +02:00
Clément Renault
0c68b9ed4c
WIP making the final snapshot swap
2023-08-31 15:56:42 +02:00
Clément Renault
d7233ecdb8
Make things to compile again
2023-08-31 14:55:14 +02:00
Clément Renault
95a011af13
Wrap the IndexScheduler fields into an inner struct
2023-08-31 10:36:33 +02:00
Clément Renault
e257710961
WIP fix the tests
2023-08-30 18:03:24 +02:00
Clément Renault
9dd4423054
Fix the watcher ordering of the auth/ node
2023-08-30 17:51:22 +02:00
Clément Renault
8c3ad57ef9
React to changes towards the cluster members
2023-08-30 17:40:12 +02:00
Clément Renault
2d1434da81
Keep the ZK flow when enqueuing tasks
2023-08-30 17:15:15 +02:00
Clément Renault
c488a4a351
Fixup a lot of small issues on the ZK config
2023-08-30 16:42:55 +02:00
Kerollmops
0c7d7c68bc
WIP moving to the sync zookeeper API
2023-08-30 15:06:12 +02:00
Tamo
854745c670
wip: starts working on importing the snapshots
2023-08-16 18:41:05 +02:00
Tamo
777eebb759
starts creating snapshot, the import is still missing
2023-08-10 15:00:25 +02:00
Tamo
61ccfaf9bc
wake up after registering a task
2023-08-10 09:39:39 +02:00
Tamo
f0c4d36ff7
implement the deletion of tasks after processing a batch
...
add a lot of comments and logs
2023-08-10 09:36:43 +02:00
Tamo
8c20d6e2fe
fix the leader election
2023-08-09 17:23:13 +02:00
ManyTheFish
8e437ed76c
Start leader election and task processing (WIP)
2023-08-09 16:52:38 +02:00
Tamo
1191ec5939
fix the register task watcher
2023-08-08 13:18:55 +02:00
Tamo
0d20d08daf
fix a few warnings
2023-08-08 11:39:48 +02:00
ManyTheFish
b66bf049b5
Create a task on zookeeper side when a task is created locally
2023-08-07 17:02:51 +02:00
ManyTheFish
b2f36b9b97
Comment Meilisearch container by default
2023-08-07 17:02:00 +02:00
ManyTheFish
b311089435
Update zookeeper client
2023-08-07 14:20:01 +02:00
ManyTheFish
3d46e84d97
update docker compose as an example
2023-08-03 17:15:24 +02:00
ManyTheFish
ad7f8edff8
fix auto-synchronization with zk
2023-08-03 14:43:29 +02:00
Tamo
5ce01bcb53
add logs
2023-08-03 13:59:05 +02:00
Tamo
d5523cc6ac
fix the tests
2023-08-03 12:28:08 +02:00
Tamo
fe7a312ec6
Import the already existing api keys on startup
2023-08-03 12:25:32 +02:00
Tamo
57dc4b148c
implement the watcher for all kind of operations
2023-08-03 10:52:13 +02:00
Tamo
a325ddfe6a
Forward the key deletions to zookeeper
2023-08-03 10:36:49 +02:00
Tamo
0cd81573b4
Forward the keys update to zookeeper
2023-08-03 10:22:34 +02:00
ManyTheFish
b0ff595f60
Event Listener: delete local key if deleted on ZK
2023-08-02 18:36:36 +02:00
ManyTheFish
3eb6f4b56f
Create api keys
2023-08-02 16:52:45 +02:00
ManyTheFish
49f976c8d8
fix analitics compilation
2023-08-02 14:17:03 +02:00
Tamo
84d56f3320
send the creation of api-key to zookeeper
2023-08-02 13:57:30 +02:00
Tamo
97e3dfd99d
makes zk available inside the auth-controller with config coming from the cli, it compiles
2023-08-02 13:17:40 +02:00
ManyTheFish
dc38da95c4
WIP
2023-08-02 12:00:02 +02:00
ManyTheFish
2ce8b42757
REMOVE: add docker compôse for tests
2023-08-02 11:59:54 +02:00
meili-bors[bot]
f391039a6f
Merge #3967
...
3967: Bring back changes from `release-v1.3.0` into `main` r=ManyTheFish a=curquiza
Using a temp branch because of git conflict
Co-authored-by: Cong Chen <cong.chen@ocrlabs.com>
Co-authored-by: ManyTheFish <many@meilisearch.com>
Co-authored-by: Louis Dureuil <louis@meilisearch.com>
Co-authored-by: meili-bors[bot] <89034592+meili-bors[bot]@users.noreply.github.com>
Co-authored-by: Tamo <tamo@meilisearch.com>
Co-authored-by: Kerollmops <clement@meilisearch.com>
Co-authored-by: Clément Renault <clement@meilisearch.com>
2023-08-01 16:22:09 +00:00
curquiza
fcdd20b533
Fix README after git conflict
2023-08-01 16:06:33 +02:00