]> git.openstreetmap.org Git - nominatim.git/commit
apply variants by languages
authorSarah Hoffmann <lonvia@denofr.de>
Tue, 5 Oct 2021 15:18:10 +0000 (17:18 +0200)
committerSarah Hoffmann <lonvia@denofr.de>
Wed, 6 Oct 2021 09:09:54 +0000 (11:09 +0200)
commit97a10ec2186faa9aa53a215662714c760e980a00
tree5ef7be89067947f466c834f87c2e827e7f8d7305
parentd35400a7d7655e777224db9beddb44a68f4f2949
apply variants by languages

Adds a tagger for names by language so that the analyzer of that
language is used. Thus variants are now only applied to names
in the specific language and only tag name tags, no longer to
reference-like tags.
nominatim/tokenizer/icu_rule_loader.py
nominatim/tokenizer/sanitizers/tag_analyzer_by_language.py [new file with mode: 0644]
nominatim/tokenizer/token_analysis/generic.py
nominatim/tools/country_info.py
settings/country_settings.yaml
settings/icu_tokenizer.yaml
test/bdd/db/query/normalization.feature
test/python/tokenizer/token_analysis/test_generic.py