meili-bors[bot] bd34ed01d9 Merge #4945 ... 4945: Add swedish in default pipelines r=dureuill a=ManyTheFish # Summary ## Fix Swedish support In Swedish the characters `å`/`ä`/`ö` are completely different than `a` or `o` and should not be normalized as the same character. because the Swedish specialized pipeline was not activated by default, these characters were normalized even with the settings: ```json { "localizedAttributes": [ { "locales": ["swe"], "attributePatterns": ["*"] } ] } ``` ## Update Charabia adding German support German segmentation will now be activated using the setting: ```json { "localizedAttributes": [ { "locales": ["deu"], "attributePatterns": ["*"] } ] } ``` # TODO - [x] Activate Swedish Pipeline - [x] Add a test to avoid future regressions - [x] Update Charabia Co-authored-by: ManyTheFish <many@meilisearch.com>		2024-09-19 14:42:03 +00:00
..
src	Merge #4938	2024-09-19 09:17:14 +00:00
tests	Merge #4945	2024-09-19 14:42:03 +00:00
build.rs	Factor vergen stuff to a build-info crate	2024-03-05 10:11:43 +01:00
Cargo.toml	Add german tokenization pipeline	2024-09-19 16:09:01 +02:00