Jakub Jirutka 935f18efcf Allow building without specialized tokenizations ...

(Some of) these specialized tokenizations include huge dictionaries
that currently account for 90% (!) of the meilisearch binary size.

This commit adds chinese, hebrew, japanese, and thai feature flags
that are propagated via milli down to the charabia crate. To keep it
backward compatible, they are enabled by default.

Related to meilisearch/milli#632

2022-09-14 21:16:34 +02:00

..

proptest-regressions

feat(lib): auto-batching

2022-02-01 18:06:20 +01:00

src

Remove unneeded prints, format

2022-09-07 18:05:55 +02:00

Cargo.toml

Allow building without specialized tokenizations

2022-09-14 21:16:34 +02:00