Commit Graph

  • dad78cbf8d
    Bulk facet remove deletes keys from DB when value empty Louis Dureuil 2023-10-31 09:53:55 +0100
  • 4e91707a06
    Rename test Louis Dureuil 2023-10-31 09:41:17 +0100
  • de10f20732
    Fix field distribution again Louis Dureuil 2023-10-30 16:57:08 +0100
  • ce5647e730
    Fix Dockerfile WORKDIR path prototype-meilitool-3 Clément Renault 2023-10-30 17:27:59 +0100
  • b57b818b67
    Don't use the last version of clap prototype-meilitool-2 Clément Renault 2023-10-30 16:32:32 +0100
  • 10f4c9efaf
    Don't use the last version of clap prototype-meilitool-1 Clément Renault 2023-10-30 16:32:32 +0100
  • f7ea94e5f4
    Modify the Dockerfile to compile meilisearch and meilitool Clément Renault 2023-10-30 14:17:15 +0100
  • be395c7944
    Change order of arguments to tokenizer_builder Louis Dureuil 2023-10-30 16:26:29 +0100
  • 9fedd8101a
    Fix tests Louis Dureuil 2023-10-30 14:48:41 +0100
  • 54d07a8da3
    Update field distribution taking into account both deletions and additions Louis Dureuil 2023-10-30 14:47:51 +0100
  • d6da79324b
    Modify the Dockerfile to compile meilisearch and meilitool prototype-meilitool-0 Clément Renault 2023-10-30 14:17:15 +0100
  • 53382bb1b8
    Introduce a new flag to skip dumping enqueued/processing tasks Clément Renault 2023-10-30 14:06:39 +0100
  • 5b004a2583
    Add more logs to the dump exporter Clément Renault 2023-10-30 14:23:41 +0100
  • 13416ccbf7
    Introduce a new meilitool to help the cloud team Clément Renault 2023-10-25 10:49:50 +0200
  • 58690dfb19
    Fix tests compilation after changes to ExternalDocumentsIds API Louis Dureuil 2023-10-30 13:34:07 +0100
  • abf424ebfc
    Remove unused FromIterator Louis Dureuil 2023-10-30 11:41:56 +0100
  • dfab6293c9
    Use an LMDB database to store the external documents ids Clément Renault 2023-10-28 12:56:46 +0200
  • fdf3f7f627
    Fix facet distribution test Louis Dureuil 2023-10-26 18:22:03 +0200
  • 6260cff65f
    Actually delete documents from DB when the merge function says so Louis Dureuil 2023-10-26 18:06:41 +0200
  • 8e0d9c9a5e
    Recover delete_documents tests that were too eagerly deleted Louis Dureuil 2023-10-26 12:16:16 +0200
  • ae4ec8ea55
    Add delete_document_using_wtxn to TempIndex Louis Dureuil 2023-10-26 12:15:55 +0200
  • 652ac3052d
    use new iterator in batch Louis Dureuil 2023-10-26 10:54:20 +0200
  • 9a2dccc3bc
    Add iterator to find external ids of a bitmap of internal ids Louis Dureuil 2023-10-26 10:36:34 +0200
  • a35988550c
    Fix some snapshots Louis Dureuil 2023-10-25 18:02:43 +0200
  • e78281785c
    Actually execute the transform even if there are only documents to delete Louis Dureuil 2023-10-25 17:32:45 +0200
  • 3c15881818
    Add simple delete test Louis Dureuil 2023-10-25 17:32:36 +0200
  • 73c06d31d9
    snapshot always display stuff in consistent order Louis Dureuil 2023-10-25 16:50:49 +0200
  • 290e773d23
    remove more warnings and fix some tests Louis Dureuil 2023-10-25 14:49:25 +0200
  • fa6c7f65ca
    Add TmpIndex::delete_documents Louis Dureuil 2023-10-25 14:42:09 +0200
  • 113527f466
    Remove soft-deleted related methods from Index Louis Dureuil 2023-10-25 14:14:15 +0200
  • c534a1b687
    Stop using delete documents pipeline in batch runner Louis Dureuil 2023-10-25 13:41:11 +0200
  • 2263dff02b
    Stop using removed delete pipelines almost everywhere Louis Dureuil 2023-10-25 13:40:46 +0200
  • d651b3ef01
    Remove delete documents files Louis Dureuil 2023-10-25 13:38:56 +0200
  • 762b0b47e6
    Use deladd merging function in chunks mergers ManyTheFish 2023-10-25 14:15:06 +0200
  • 01d5eedf2f
    Remove some warnings Louis Dureuil 2023-10-25 13:37:42 +0200
  • 073f89db79
    Fix facet tests Louis Dureuil 2023-10-25 11:22:30 +0200
  • 8370fbc92b
    Fix snaps Louis Dureuil 2023-10-25 11:20:01 +0200
  • 85f42fbc03
    Handle external to internal id mapping from TypedChunk::Documents Louis Dureuil 2023-10-24 17:04:48 +0200
  • c6b3c18c85
    WIP: Comment out document deletion in other pipelines than update Louis Dureuil 2023-10-24 17:04:02 +0200
  • bafeb892a7
    Modify Index after changes to ExternalDocumentsIds Louis Dureuil 2023-10-24 17:02:55 +0200
  • 8fb221dae3
    Refactor ExternalDocumentsIds Louis Dureuil 2023-10-24 17:01:45 +0200
  • 5be569e3e2
    Update obkv Louis Dureuil 2023-10-24 17:01:30 +0200
  • 946c762d28
    WIP: reset documents in TypedChunk::Documents Louis Dureuil 2023-10-24 14:26:49 +0200
  • cda6ca1ee6
    Remove TypedChunk::NewDocumentIds Louis Dureuil 2023-10-24 14:26:14 +0200
  • 696fcf4d18
    Fix document insertion into LMDB Louis Dureuil 2023-10-24 11:03:35 +0200
  • 476e4d3dbe
    Use value buffer instead of the initial value when writting the final result in the sorter ManyTheFish 2023-10-24 10:19:32 +0200
  • 576fa9c6da
    Remove useless comment Clément Renault 2023-10-24 10:21:47 +0200
  • 77dcbff6b2
    Remove and Insert the DelAdd geo points Kerollmops 2023-10-23 13:49:54 +0200
  • 544440c363
    Ignore geo fields when the Del and Add content is the same Kerollmops 2023-10-23 11:54:45 +0200
  • a3dae4db9b
    Extract the geo fields DelAdd and generate a new DelAdd obkv with it Clément Renault 2023-10-19 15:55:48 +0200
  • ba90a5ec0e
    update extract fid word count docids ManyTheFish 2023-10-23 16:34:49 +0200
  • b26dc9aabe
    Explanatory code comment Louis Dureuil 2023-10-23 16:06:06 +0200
  • 66abac9364
    Use specialized KvReaderDelAdd type Louis Dureuil 2023-10-23 15:55:35 +0200
  • 59f88c14b3
    Simplify facet update after removing Index::faceted_documents_ids Louis Dureuil 2023-10-23 15:19:33 +0200
  • 14832cb324
    Remove Index::faceted_documents_ids Louis Dureuil 2023-10-23 14:50:11 +0200
  • 04ec293024
    Facet Incremental update Louis Dureuil 2023-10-19 12:01:12 +0200
  • f67ff3a738
    Facets Bulk update Louis Dureuil 2023-10-19 11:56:42 +0200
  • 560e8f5613
    Introduce the CboRoaringBitmapCodec merge_deladd_into and use it Clément Renault 2023-10-19 11:18:30 +0200
  • 2d3f15f82c
    Introduce a function to only serialize the Add side of a DelAdd obkv Clément Renault 2023-10-19 10:47:00 +0200
  • 40186bf403
    Rename FieldIdWordCountDocids correctly Clément Renault 2023-10-19 10:38:58 +0200
  • 87e3d27878
    update extract word pair proximity to support deladd obkvs ManyTheFish 2023-10-19 14:18:14 +0200
  • 6bcf8b4f8c
    update extract word position docids ManyTheFish 2023-10-19 13:27:07 +0200
  • 46aa75abdb
    update extract word docids ManyTheFish 2023-10-19 11:58:31 +0200
  • 2597bbd107
    Make script language docids map taking a tuple of roaring bitmaps expressing the deletions and the additions ManyTheFish 2023-10-19 10:22:39 +0200
  • e2bc054604
    Update extract_facet_string_docids to support deladd obkvs Clément Renault 2023-10-18 18:06:41 +0200
  • fcd3a1434d
    Update extract_facet_number_docids to support deladd obkvs Clément Renault 2023-10-18 17:40:13 +0200
  • a82dee21e0
    Rename docid_fid into fid_docid Clément Renault 2023-10-18 13:53:58 +0200
  • bc45c1206d
    Implement all the facet extraction paths and simplify them Clément Renault 2023-10-18 11:01:02 +0200
  • 6ae4100f07
    Generate the DelAdd for is_null, is_empty, and exists Clément Renault 2023-10-17 18:15:14 +0200
  • 0c47defeee
    Work on fid docid facet values rewrite Clément Renault 2023-10-17 18:09:41 +0200
  • 313b16bec2
    Support diff indexing on extract_docid_word_positions ManyTheFish 2023-10-16 14:58:11 +0200
  • 1dd97578a8
    Make the transform struct return diff-based documents obkvs ManyTheFish 2023-10-12 11:46:56 +0200
  • f5ef69293b
    deactivate prefix dbs ManyTheFish 2023-10-10 16:17:03 +0200
  • 1c5705c164
    clean PR warnings ManyTheFish 2023-10-10 11:23:16 +0200
  • 66c2c82a18
    Split wpp in several sorters ManyTheFish 2023-09-28 10:45:25 +0200
  • 28a8d0ccda
    Fix word pair proximity ManyTheFish 2023-09-26 10:08:36 +0200
  • 96be85396d
    Use a vecDeque in wpp database ManyTheFish 2023-09-25 18:55:20 +0200
  • df9e5c8651
    Generalize usage of CboRoaringBitmap codec to ease the use ManyTheFish 2023-09-25 16:39:32 +0200
  • b541d48847
    Add buffer to the obkv writter ManyTheFish 2023-09-21 10:02:08 +0200
  • 8ccf32d1a0
    Compute word_fid_docids before word_docids and exact_word_docids ManyTheFish 2023-09-19 19:29:06 +0200
  • db1ca21231
    add puffin in sorter into reeder function ManyTheFish 2023-09-19 18:40:35 +0200
  • 11ea5acff9
    Fix ManyTheFish 2023-09-19 18:29:21 +0200
  • 8d77736a67
    Fix fid_word_docids ManyTheFish 2023-09-19 14:20:57 +0200
  • 748b333161
    Add usefull debug assert before key insertion in database ManyTheFish 2023-09-19 14:12:43 +0200
  • 17b647dfe5
    Wip ManyTheFish 2023-09-18 09:59:38 +0200
  • 2614e7d9ca
    Merge #4174 v1.5.0-rc.1 meili-bors[bot] 2023-10-30 10:12:54 +0000
  • e7244aa485 fix warnings Tamo 2023-10-30 11:00:46 +0100
  • c6645000bf
    Use an LMDB database to store the external documents ids Clément Renault 2023-10-28 12:56:46 +0200
  • 9cacc82307
    Merge #4169 meili-bors[bot] 2023-10-26 17:21:30 +0000
  • 496e1f7be4
    Fix facet distribution test Louis Dureuil 2023-10-26 18:22:03 +0200
  • e93755035b
    Actually delete documents from DB when the merge function says so Louis Dureuil 2023-10-26 18:06:41 +0200
  • 4c6fddb1cb update charabia ManyTheFish 2023-10-26 17:01:10 +0200
  • 0a34f70566 update the CI simplify-rustfmt Tamo 2023-10-26 13:39:52 +0200
  • 75d8d4f3a8 remove the use unstable in rustfmt Tamo 2023-10-26 13:38:11 +0200
  • 250ee5485b Activate only the necessary features for Japanese prototype-japanese-7 ManyTheFish 2023-07-03 18:53:59 +0200
  • 1d888d2d86
    Recover delete_documents tests that were too eagerly deleted Louis Dureuil 2023-10-26 12:16:16 +0200
  • 3a90407767
    Add delete_document_using_wtxn to TempIndex Louis Dureuil 2023-10-26 12:15:55 +0200
  • 760e30affc
    use new iterator in batch Louis Dureuil 2023-10-26 10:54:20 +0200
  • 20352a6660
    Add iterator to find external ids of a bitmap of internal ids Louis Dureuil 2023-10-26 10:36:34 +0200
  • 04a5bd0033
    Fix some snapshots Louis Dureuil 2023-10-25 18:02:43 +0200