many aeb676e757

skip indexation while token is not a word

2021-01-05 15:21:06 +01:00

..

examples

[fix] Remove some clippy warnings

2020-11-23 23:24:40 +01:00

src

skip indexation while token is not a word

2021-01-05 15:21:06 +01:00

Cargo.toml

update tokenizer version

2021-01-05 15:21:06 +01:00