mirror of
https://github.com/meilisearch/MeiliSearch
synced 2025-02-28 05:01:32 +01:00

Tokenizer v0.2.7 uses chars instead of graphemes for matching bytes. `unicode-segmentation` dependency isn't needed anymore. Also, oxidised the highlight code :) Co-authored-by: many <maxime@meilisearch.com>