Commit Graph

  • a94a87ee54
    Slightly changes existing error messages Louis Dureuil 2024-09-11 11:25:26 +0200
  • e098cc8320 Make comparison simpler, add IndexUid error details similarly F. Levi 2024-09-17 00:16:15 +0300
  • ec815fa368 Format F. Levi 2024-09-16 23:59:48 +0300
  • 4a922a176f Add test for > 512 byte ID F. Levi 2024-09-16 23:53:34 +0300
  • 51bc7b3173 Update tests F. Levi 2024-09-16 22:22:24 +0300
  • 75969f9f68 Add manual serde Deserialize impl F. Levi 2024-09-16 21:14:47 +0300
  • f4ab1f168e
    Prefer using Rc<str> than String when cloning a lot Clément Renault 2024-09-16 15:41:29 +0200
  • 4b55ba68bc
    Merge #4911 meili-bors[bot] 2024-09-16 13:32:32 +0000
  • 1a0e962299 Replace hashmap by vectors in wpp ManyTheFish 2024-09-16 15:01:20 +0200
  • f13e076b8a Use hashmap instead of Btree in wpp extractor ManyTheFish 2024-09-16 14:40:40 +0200
  • 96e291532f
    Merge af2b722fed into 882663bf7f Clément Renault 2024-09-16 09:40:30 +0000
  • af2b722fed
    Make the CI happy about the never type option-disable-prefixdb Clément Renault 2024-09-16 11:40:26 +0200
  • 8cb7001755
    Expose an experimental parameter to control the generation of prefix dbs prototype-control-prefixdb-1 Clément Renault 2024-09-16 10:57:52 +0200
  • 7ba49b849e Extract and write facet databases ManyTheFish 2024-09-16 09:34:10 +0200
  • 993408d3ba Change closure to fn F. Levi 2024-09-15 16:15:09 +0300
  • dcb61f8b3a Return error for primary keys with a length greater than 512 bytes F. Levi 2024-09-09 15:27:47 +0300
  • 51085206cc Misc adjustments F. Levi 2024-09-14 10:14:07 +0300
  • a2a16bf846 Move MatchPosition impl to Match, adjust counting score for phrases F. Levi 2024-09-13 21:20:06 +0300
  • cab63abc84 Improve MatchesPosition enum with an impl F. Levi 2024-09-13 14:35:28 +0300
  • 65e3d61a95 Make use of helper function in one more place F. Levi 2024-09-13 13:35:58 +0300
  • cc6a2aec06 Improve changes to Matcher F. Levi 2024-09-13 13:31:07 +0300
  • f7652186e1
    WIP geo fields Clément Renault 2024-09-12 18:01:02 +0200
  • 23e14138bb
    facet distribution: implement Display for OrderBy Louis Dureuil 2024-09-12 17:41:01 +0200
  • e44325683a
    Facet distribution: fix issue where truncated facet distribution would have a wrong order Louis Dureuil 2024-09-12 17:40:33 +0200
  • e7af499314 Improve changes to Matcher F. Levi 2024-09-12 16:58:13 +0300
  • b2f4e67c9a
    Do not store useless updates Clément Renault 2024-09-12 15:38:31 +0200
  • ff5d3b59f5
    Move the document id extraction to the primary key code Clément Renault 2024-09-12 12:01:31 +0200
  • aa69308e45 Use a bufWriter to build word FSTs ManyTheFish 2024-09-12 11:48:00 +0200
  • eb9a20ff0b Fix fid_word_docids extraction ManyTheFish 2024-09-12 11:08:18 +0200
  • edcb4c60ba Change Matcher so that phrases are counted as one instead of word by word F. Levi 2024-09-12 09:44:37 +0300
  • 0d868f36d7
    Make sure we always use a BufWriter to write the update files Clément Renault 2024-09-11 18:38:04 +0200
  • e7d9db078f
    Use the right key name when convertir from CSV to NDJSON Clément Renault 2024-09-11 18:27:00 +0200
  • 3e9198ebaa
    Support guessing primary key again Clément Renault 2024-09-11 15:59:30 +0200
  • 2a0ad0982f
    Fix the document counter Clément Renault 2024-09-11 10:20:26 +0200
  • 2b317c681b Build mergers in parallel ManyTheFish 2024-09-11 11:49:26 +0200
  • 39b5990f64 Mutualize tokenization ManyTheFish 2024-09-11 10:20:23 +0200
  • 3848adf5a2
    Improve error management and simplify JSON read Clément Renault 2024-09-11 10:10:51 +0200
  • b4de06259e
    Better CSV support Clément Renault 2024-09-11 10:02:00 +0200
  • 02c2b660f8
    Merge #4920 meili-bors[bot] 2024-09-11 07:08:39 +0000
  • 8287c2644f
    Support CSV again Clément Renault 2024-09-10 21:10:28 +0100
  • c1c44a0b81
    Impl serialize on TopLevelMap Clément Renault 2024-09-10 19:32:03 +0100
  • 04596f3616
    Move the TopLevelMap into a dedicated module Clément Renault 2024-09-10 18:01:17 +0100
  • 24cb5839ad
    Move the document changes sorting logic to a new trait Clément Renault 2024-09-10 17:37:52 +0100
  • 8d97b7b28c
    Support JSON payloads again (not perfectly though) Clément Renault 2024-09-10 17:09:49 +0100
  • f9b7a5ed93
    feat: Added Elestio as one-click deploy option Kaiwalya Koparkar 2024-09-10 13:25:50 +0530
  • f69688e8f7 Fix several warnings in extractors and remove unreachable macros ManyTheFish 2024-09-09 14:52:50 +0200
  • f18e9cb7b3
    Change openai default model Louis Dureuil 2024-09-09 13:09:35 +0200
  • 07e7ddbc5b Change Actions enum to bitflags F. Levi 2024-08-31 13:18:59 +0300
  • 0084868f8f remove await Santhosh Reddy Vootukuri (SUNNY) (from Dev Box) 2024-09-08 09:58:41 -0700
  • 31d460044b removing .await Santhosh Reddy Vootukuri (SUNNY) (from Dev Box) 2024-09-08 09:52:22 -0700
  • 8fd0afaaaa
    Make sure we iterate over the payload documents in order Clément Renault 2024-09-05 22:31:17 +0200
  • 72c6a21a30
    Use raw JSON to read the payloads Clément Renault 2024-09-05 20:08:23 +0200
  • 8412be4a7d
    Cleanup CowStr and TopLevelMap struct Clément Renault 2024-09-05 18:32:55 +0200
  • 10f09c531f
    add some commented code to read from json with raw values Louis Dureuil 2024-09-05 18:22:16 +0200
  • 8fd99b111b Add tracing timers logs ManyTheFish 2024-09-05 17:36:19 +0200
  • f6b3d1f9a5
    Increase some channel sizes Clément Renault 2024-09-05 15:12:07 +0200
  • db0cf3b2ed
    Merge #4912 prototype-upgrade-offline-v1_9-v1_10-0 meili-bors[bot] 2024-09-05 09:11:23 +0000
  • 73ce67862d
    Use the word pair proximity and fid word count docids extractors Clément Renault 2024-09-05 10:56:22 +0200
  • f6abf01d2c
    Check REST embedders before touching the DB Louis Dureuil 2024-09-05 10:49:59 +0200
  • 0fc02f7351
    Move the facet extraction to dedicated modules Clément Renault 2024-09-05 10:32:22 +0200
  • 34f11e3380 Implement word count and word pair proximity extractors ManyTheFish 2024-09-05 10:30:39 +0200
  • 28da759f11
    meilitool: Support dumpless upgrade from v1.9 to v1.10 when there are no REST embedders Louis Dureuil 2024-09-05 10:08:38 +0200
  • ea96d19525
    Change versioning in meili Louis Dureuil 2024-09-05 10:08:06 +0200
  • d352b1ee83
    Add serde to meilitool Louis Dureuil 2024-09-05 10:07:33 +0200
  • 27308eaab1
    Import the facet extractors Clément Renault 2024-09-04 17:58:15 +0200
  • b33ec9ba3f
    Introduce the FieldIdFacetIsNullDocidsExtractor Clément Renault 2024-09-04 17:50:08 +0200
  • 9c0a1cd9fd
    Introduce the FieldIdFacetExistsDocidsExtractor Clément Renault 2024-09-04 17:48:49 +0200
  • 0b061f1e70
    Introduce the FieldIdFacetIsEmptyDocidsExtractor Clément Renault 2024-09-04 17:40:24 +0200
  • 19d937ab21
    Introduce the facet extractors Clément Renault 2024-09-04 17:03:09 +0200
  • 1d59c19cd2
    Send the WordsFst by using an Mmap Clément Renault 2024-09-04 14:30:09 +0200
  • 98e48371c3
    Factorize some stuff Clément Renault 2024-09-04 12:17:13 +0200
  • 6d74fb0229
    Introduce the WordFidWordDocids database Clément Renault 2024-09-04 11:39:53 +0200
  • 1eb75a1040 remove milli/src/update/new/extract/tokenize_document.rs ManyTheFish 2024-09-04 11:40:26 +0200
  • 3b82d8b5b9
    Fix the cache to serialize entries correctly Clément Renault 2024-09-04 10:55:06 +0200
  • 781a186f75 remove milli/src/update/new/extract/extract_word_docids.rs ManyTheFish 2024-09-04 10:28:31 +0200
  • 6a399556b5 Implement more searchable extractor ManyTheFish 2024-09-04 10:20:18 +0200
  • 27b4cab857
    Extract and write the documents and words fst in the database Clément Renault 2024-09-04 09:59:19 +0200
  • 3f3cebf5f9
    Bump quinn-proto from 0.11.3 to 0.11.8 dependabot[bot] 2024-09-03 20:50:30 +0000
  • b278815617
    Merge #4908 meili-bors[bot] 2024-09-03 14:28:12 +0000
  • 52d32b4ee9
    Move the channel sender in the closure to stop the merger thread Clément Renault 2024-09-03 16:08:33 +0200
  • da61408e52 Remove unimplemented from document changes ManyTheFish 2024-09-03 15:14:16 +0200
  • fe69385bd7 Fix tokenizer test ManyTheFish 2024-09-03 14:24:37 +0200
  • 40e13ceef3
    Merge #4892 meili-bors[bot] 2024-09-03 11:50:07 +0000
  • 18a2c13e4e
    add analytics Louis Dureuil 2024-09-02 14:04:24 +0200
  • ed19b7c3c3
    Only reindex if the size increased Louis Dureuil 2024-09-02 13:52:18 +0200
  • 66bda2ce8a
    fix tests Louis Dureuil 2024-08-28 09:10:09 +0200
  • 1ac008926b
    Add maxBytes parameter Louis Dureuil 2024-08-27 17:52:09 +0200
  • c49d892c82
    Changes to prompt Louis Dureuil 2024-09-03 12:07:10 +0200
  • de962a26f3
    New error type when maxBytes is null Louis Dureuil 2024-08-27 17:47:02 +0200
  • c1557734dc
    Use the GlobalFieldsIdsMap everywhere and write it to disk Clément Renault 2024-09-03 12:01:01 +0200
  • 005204e9e5 make the code of init_web_app in common between most tests Tamo 2024-09-03 11:40:05 +0200
  • 1040e5e2b4 spawn on search queue per test Tamo 2024-09-03 11:20:25 +0200
  • c50d3edc4a Integrate first searchable exctrator ManyTheFish 2024-09-03 11:02:39 +0200
  • 7bfcd76628
    feat(prometheus): add build_info metric Nicolas Lamirault 2024-09-03 10:12:08 +0200
  • 80408c92dc
    Merge #4906 meili-bors[bot] 2024-09-03 07:14:58 +0000
  • 5369bf4a62
    Change some lifetimes Clément Renault 2024-09-02 19:51:22 +0200
  • bcb1aa3d22
    Find a temporary solution to par into iter on an HashMap Clément Renault 2024-09-02 19:39:48 +0200
  • fa1a0beb0c fix conflicts after rebase Tamo 2024-09-02 18:15:42 +0200
  • 5aefe7cd17 add the snapshots Tamo 2024-09-02 10:53:33 +0200
  • e6dd66e4a0 Do not fail the whole batch when a single document deletion by filter fails Tamo 2024-09-02 10:34:28 +0200