6 Commits

Author	SHA1	Message	Date
Clément Renault	de2b8672d4	Make the tokenizer understand strange whitespaces/quotes	2019-11-04 16:41:58 +01:00
Clément Renault	1be5b0f327	Bump the meili-core/schema/tokenizer crates to 0.6.0	2019-10-31 14:05:59 +01:00
Clément Renault	b709a7a30a	Bump the meili-core/schema/tokenizer crates to 0.5.11	2019-10-30 17:40:31 +01:00
Clément Renault	a745819ddf	feat: Simplify the Tokenizer to use the LinearStrGroupBy type	2019-04-29 14:31:37 +02:00
Clément Renault	19e67dcf0b	feat: Move query splitting into the tokenizer workspace	2019-04-29 14:31:37 +02:00
Clément Renault	1897da5348	feat: Move tokenizer things into the meilidb-tokenizer workspace	2019-04-29 14:31:37 +02:00