]> git.openstreetmap.org Git - nominatim.git/commit
switch to a more flexible variant description format
authorSarah Hoffmann <lonvia@denofr.de>
Thu, 24 Jun 2021 18:02:07 +0000 (20:02 +0200)
committerSarah Hoffmann <lonvia@denofr.de>
Sun, 4 Jul 2021 08:28:20 +0000 (10:28 +0200)
commit62828fc5c11a1c332e18206b181b84928980319b
tree7919a8fbe6b14303827c66b0a919053719559f0f
parenta6aa6360e0e488b4a70e92a9cff724b951309114
switch to a more flexible variant description format

The new format combines compound splitting and abbreviation.
It also allows to restrict rules to additional conditions
(like language or region). This latter ability is not used
yet.
CMakeLists.txt
nominatim/tokenizer/icu_name_processor.py
nominatim/tokenizer/icu_rule_loader.py
nominatim/tokenizer/icu_variants.py [new file with mode: 0644]
settings/legacy_icu_tokenizer.yaml
test/python/test_tokenizer_icu_name_processor.py
test/python/test_tokenizer_icu_rule_loader.py
test/python/test_tokenizer_legacy_icu.py