]> git.openstreetmap.org Git - nominatim.git/commit
introduce a separate token type for partials
authorSarah Hoffmann <lonvia@denofr.de>
Tue, 13 Jul 2021 14:54:51 +0000 (16:54 +0200)
committerSarah Hoffmann <lonvia@denofr.de>
Tue, 13 Jul 2021 14:57:12 +0000 (16:57 +0200)
commit6070c3d1d58fb8737b387e8a3ef1f17fb1eb5d54
treeccce03e5ee000a5063e9c229683d433be7a7703b
parentbc8b2d4ae0dbaef64448ddcb530de9626da9d82d
introduce a separate token type for partials

This means that the leading space can be removed as a partial
word indicator.
lib-php/TokenList.php
lib-php/TokenPartial.php [new file with mode: 0644]
lib-php/TokenWord.php
lib-php/tokenizer/legacy_icu_tokenizer.php
lib-php/tokenizer/legacy_tokenizer.php