]> git.openstreetmap.org Git - nominatim.git/commit
define formal public Python interface for tokenizer
authorSarah Hoffmann <lonvia@denofr.de>
Tue, 10 Aug 2021 12:51:35 +0000 (14:51 +0200)
committerSarah Hoffmann <lonvia@denofr.de>
Mon, 16 Aug 2021 09:41:54 +0000 (11:41 +0200)
commit90b40fc3e684350c4dab743cb2c0a26c8792cc39
treeb7a27bda03b1a5c55cab70c1269293cf27f62478
parente25e268e2e730a81e0bb9e4528947fdc86ca56dd
define formal public Python interface for tokenizer

This introduces an abstract class for the Tokenizer/Analyzer
for documentation purposes.
docs/develop/Tokenizers.md
docs/extra.css
docs/mkdocs.yml
nominatim/tokenizer/base.py [new file with mode: 0644]
nominatim/tokenizer/legacy_icu_tokenizer.py
nominatim/tokenizer/legacy_tokenizer.py