]> git.openstreetmap.org Git - nominatim.git/log
nominatim.git
22 months agoadd type annotations to tool functions
Sarah Hoffmann [Sat, 16 Jul 2022 21:28:02 +0000 (23:28 +0200)]
add type annotations to tool functions

22 months agoadd type annotations for ICU tokenizer
Sarah Hoffmann [Sat, 16 Jul 2022 15:33:19 +0000 (17:33 +0200)]
add type annotations for ICU tokenizer

22 months agoadd type annotations for legacy tokenizer
Sarah Hoffmann [Fri, 15 Jul 2022 20:52:26 +0000 (22:52 +0200)]
add type annotations for legacy tokenizer

22 months agoadd type annotations to ICU tokenizer helper modules
Sarah Hoffmann [Wed, 13 Jul 2022 20:55:40 +0000 (22:55 +0200)]
add type annotations to ICU tokenizer helper modules

22 months agoadd typing extensions for Ubuntu22.04
Sarah Hoffmann [Wed, 13 Jul 2022 18:49:54 +0000 (20:49 +0200)]
add typing extensions for Ubuntu22.04

22 months agoadd type annotations for token analysis
Sarah Hoffmann [Wed, 13 Jul 2022 15:18:53 +0000 (17:18 +0200)]
add type annotations for token analysis

No annotations for ICU types yet.

22 months agoadd type hints for sanitizers
Sarah Hoffmann [Tue, 12 Jul 2022 21:15:19 +0000 (23:15 +0200)]
add type hints for sanitizers

22 months agoadd type annotations for indexer
Sarah Hoffmann [Tue, 12 Jul 2022 16:40:51 +0000 (18:40 +0200)]
add type annotations for indexer

22 months agoadd typing information for postcode formatter
Sarah Hoffmann [Fri, 8 Jul 2022 09:52:45 +0000 (11:52 +0200)]
add typing information for postcode formatter

22 months agoadd typing information for place_info and country_info
Sarah Hoffmann [Thu, 7 Jul 2022 15:31:20 +0000 (17:31 +0200)]
add typing information for place_info and country_info

22 months agoadd typing information for utils submodule
Sarah Hoffmann [Tue, 5 Jul 2022 15:28:02 +0000 (17:28 +0200)]
add typing information for utils submodule

22 months agotype annotations for non-blocking DB connection
Sarah Hoffmann [Tue, 5 Jul 2022 13:00:33 +0000 (15:00 +0200)]
type annotations for non-blocking DB connection

22 months agoadd type annotations for SQL preprocessor
Sarah Hoffmann [Tue, 5 Jul 2022 09:24:53 +0000 (11:24 +0200)]
add type annotations for SQL preprocessor

22 months agoadd type annotation to DB utils
Sarah Hoffmann [Tue, 5 Jul 2022 08:46:55 +0000 (10:46 +0200)]
add type annotation to DB utils

As a cursor is needed as type, make this a public type.

22 months agoadd typing information to DB properties
Sarah Hoffmann [Tue, 5 Jul 2022 08:34:55 +0000 (10:34 +0200)]
add typing information to DB properties

22 months agoadd typing annotations for DB status module
Sarah Hoffmann [Mon, 4 Jul 2022 09:29:12 +0000 (11:29 +0200)]
add typing annotations for DB status module

Requires TypedDict which is only available from Python 3.8. Require
therefore typing_extensions to make the functions available for
earlier Python versions.

22 months agoadapt use of Connection in bdd tests to name change
Sarah Hoffmann [Mon, 4 Jul 2022 06:46:07 +0000 (08:46 +0200)]
adapt use of Connection in bdd tests to name change

22 months agoadd type annotations to freeze functions
Sarah Hoffmann [Sun, 3 Jul 2022 17:04:05 +0000 (19:04 +0200)]
add type annotations to freeze functions

22 months agofix uses of config.get_path() to expect None
Sarah Hoffmann [Sun, 3 Jul 2022 16:36:33 +0000 (18:36 +0200)]
fix uses of config.get_path() to expect None

22 months agodefine type for enivronment dictionaries
Sarah Hoffmann [Sun, 3 Jul 2022 15:38:11 +0000 (17:38 +0200)]
define type for enivronment dictionaries

22 months agorestrict return type more
Sarah Hoffmann [Sun, 3 Jul 2022 15:21:46 +0000 (17:21 +0200)]
restrict return type more

22 months agoadd type annotations to exec_utils
Sarah Hoffmann [Sun, 3 Jul 2022 12:48:15 +0000 (14:48 +0200)]
add type annotations to exec_utils

22 months agoCI: install type info for psycopg2
Sarah Hoffmann [Sun, 3 Jul 2022 09:49:50 +0000 (11:49 +0200)]
CI: install type info for psycopg2

22 months agoavoid issues with Python < 3.9 and linting
Sarah Hoffmann [Sun, 3 Jul 2022 09:33:19 +0000 (11:33 +0200)]
avoid issues with Python < 3.9 and linting

22 months agomove complex typing annotations to extra file
Sarah Hoffmann [Sat, 2 Jul 2022 09:59:19 +0000 (11:59 +0200)]
move complex typing annotations to extra file

22 months agotype annotations for DB utils
Sarah Hoffmann [Sat, 2 Jul 2022 08:18:10 +0000 (10:18 +0200)]
type annotations for DB utils

22 months agotype annotations for DB connection
Sarah Hoffmann [Fri, 1 Jul 2022 11:55:24 +0000 (13:55 +0200)]
type annotations for DB connection

22 months agomypy: add psycopg2 typing info from typeshed
Sarah Hoffmann [Thu, 30 Jun 2022 13:57:44 +0000 (15:57 +0200)]
mypy: add psycopg2 typing info from typeshed

22 months agoadd type annotations to config module
Sarah Hoffmann [Thu, 30 Jun 2022 13:43:18 +0000 (15:43 +0200)]
add type annotations to config module

22 months agoadd type annotations for version.py
Sarah Hoffmann [Thu, 30 Jun 2022 12:36:19 +0000 (14:36 +0200)]
add type annotations for version.py

22 months agomypy: ignore dotenv library
Sarah Hoffmann [Thu, 30 Jun 2022 12:07:02 +0000 (14:07 +0200)]
mypy: ignore dotenv library

22 months agodocument use of mypy
Sarah Hoffmann [Thu, 30 Jun 2022 09:56:14 +0000 (11:56 +0200)]
document use of mypy

22 months agoCI: add mypy to tests
Sarah Hoffmann [Thu, 30 Jun 2022 09:52:45 +0000 (11:52 +0200)]
CI: add mypy to tests

22 months agomypy: minimal annotations to enable a clean run
Sarah Hoffmann [Thu, 30 Jun 2022 08:48:04 +0000 (10:48 +0200)]
mypy: minimal annotations to enable a clean run

22 months agoMerge pull request #2761 from lonvia/repair-index-analysis
Sarah Hoffmann [Mon, 18 Jul 2022 07:38:08 +0000 (09:38 +0200)]
Merge pull request #2761 from lonvia/repair-index-analysis

Repair `admin --analyse-indexing`

22 months agoMerge pull request #2764 from otbutz/patch-4
Sarah Hoffmann [Wed, 13 Jul 2022 13:51:47 +0000 (15:51 +0200)]
Merge pull request #2764 from otbutz/patch-4

Remove legacy Postgres options

22 months agoRemove legacy Postgres options
otbutz [Tue, 12 Jul 2022 07:49:10 +0000 (09:49 +0200)]
Remove legacy Postgres options

22 months agoMerge pull request #2691 from mtmail/ubuntu-22
Sarah Hoffmann [Mon, 11 Jul 2022 13:37:51 +0000 (15:37 +0200)]
Merge pull request #2691 from mtmail/ubuntu-22

Vagrant and CI tests for Ubuntu 22.04

22 months agoIn tests for PHP 8 disable Just-in-time, it conflicts with tools that determine coverage
marc tobias [Mon, 4 Jul 2022 21:52:36 +0000 (23:52 +0200)]
In tests for PHP 8 disable Just-in-time, it conflicts with tools that determine coverage

22 months agoVagrant and CI tests for Ubuntu 22.04
Marc Tobias [Mon, 2 May 2022 16:16:08 +0000 (18:16 +0200)]
Vagrant and CI tests for Ubuntu 22.04

22 months agodecode_json() always create arrays instead of objects
Sarah Hoffmann [Sat, 9 Jul 2022 07:10:21 +0000 (09:10 +0200)]
decode_json() always create arrays instead of objects

22 months agoconvert admin --analyse-indexing to new indexing method
Sarah Hoffmann [Thu, 7 Jul 2022 09:23:14 +0000 (11:23 +0200)]
convert admin --analyse-indexing to new indexing method

A proper run of indexing requires the place information from the
analyzer. Add the pre-processing of place data, so the right
information is handed into the update function.

22 months agoMerge pull request #2760 from lonvia/reorganize-data-classes
Sarah Hoffmann [Thu, 7 Jul 2022 14:12:11 +0000 (16:12 +0200)]
Merge pull request #2760 from lonvia/reorganize-data-classes

Code cleanup: move some common code into the data submodule

22 months agoremove analyze() from PlaceInfo class
Sarah Hoffmann [Wed, 6 Jul 2022 09:33:07 +0000 (11:33 +0200)]
remove analyze() from PlaceInfo class

The function creates circular dependencies.

22 months agomove country_info into data submodule
Sarah Hoffmann [Wed, 6 Jul 2022 09:08:36 +0000 (11:08 +0200)]
move country_info into data submodule

22 months agomove PlaceInfo into data submodule
Sarah Hoffmann [Wed, 6 Jul 2022 08:54:47 +0000 (10:54 +0200)]
move PlaceInfo into data submodule

This data structure is shared between indexer and tokenizer.

22 months agotest: avoid column names with upper-case letters
Sarah Hoffmann [Tue, 5 Jul 2022 07:12:55 +0000 (09:12 +0200)]
test: avoid column names with upper-case letters

This may cause problems when the column names get quoted.

22 months agoCI: remove unneed stuff to make space for DB
Sarah Hoffmann [Sun, 3 Jul 2022 12:52:16 +0000 (14:52 +0200)]
CI: remove unneed stuff to make space for DB

22 months agoMerge pull request #2706 from mtmail/php-fixes-php7-vs-php8
Sarah Hoffmann [Sun, 3 Jul 2022 09:28:52 +0000 (11:28 +0200)]
Merge pull request #2706 from mtmail/php-fixes-php7-vs-php8

PHP 8 behaves slightly different with in_array and usort

22 months agoPHP 8 behaves slightly different with in_array and usort
Marc Tobias [Tue, 10 May 2022 16:30:49 +0000 (18:30 +0200)]
PHP 8 behaves slightly different with in_array and usort

22 months agofix syntax error with tablespaces
Sarah Hoffmann [Thu, 30 Jun 2022 07:19:16 +0000 (09:19 +0200)]
fix syntax error with tablespaces

22 months agodocs: replace deprecated pages option
Sarah Hoffmann [Sat, 25 Jun 2022 19:29:00 +0000 (21:29 +0200)]
docs: replace deprecated pages option

Fixes #2661.

22 months agofix handling of zero importance
Sarah Hoffmann [Wed, 29 Jun 2022 15:54:30 +0000 (17:54 +0200)]
fix handling of zero importance

To avoid importance becoming zero and cancelling out other weights,
df008d99f549d850d07580b4592435388e44387c introduced a minimum value
for importance. That broke importances for interpolated addresses,
which are less than zero.

Instead of setting a minimum, set zero importances to a very small
value.

Fixes #2753.

23 months agoMerge pull request #2757 from lonvia/filter-postcodes
Sarah Hoffmann [Fri, 24 Jun 2022 19:09:41 +0000 (21:09 +0200)]
Merge pull request #2757 from lonvia/filter-postcodes

Add filtering, normalisation and variants for postcodes

23 months agoignore 5+ postcodes in the US for now
Sarah Hoffmann [Thu, 23 Jun 2022 14:17:47 +0000 (16:17 +0200)]
ignore 5+ postcodes in the US for now

Hierarchical postcodes need a different treatment.

23 months agobdd: correctly skip postcode tests for legacy
Sarah Hoffmann [Wed, 22 Jun 2022 09:38:23 +0000 (11:38 +0200)]
bdd: correctly skip postcode tests for legacy

23 months agobdd: do not expect legacy word table to be without empty tokens
Sarah Hoffmann [Wed, 22 Jun 2022 08:47:08 +0000 (10:47 +0200)]
bdd: do not expect legacy word table to be without empty tokens

It can happen for bogus names and this will not get fixed anymore.

23 months agoadapt search algorithm to new postcode format in word
Sarah Hoffmann [Wed, 22 Jun 2022 07:54:47 +0000 (09:54 +0200)]
adapt search algorithm to new postcode format in word

23 months agohandle postcodes properly on word table updates
Sarah Hoffmann [Tue, 21 Jun 2022 20:05:35 +0000 (22:05 +0200)]
handle postcodes properly on word table updates

update_postcodes_from_db() needs to do the full postcode treatment
in order to derive the correct word table entries.

23 months agoadd documentation for postcode customization
Sarah Hoffmann [Mon, 20 Jun 2022 15:42:12 +0000 (17:42 +0200)]
add documentation for postcode customization

23 months agofix linting issue
Sarah Hoffmann [Fri, 17 Jun 2022 16:14:23 +0000 (18:14 +0200)]
fix linting issue

23 months agofix up BDD tests for postcode changes
Sarah Hoffmann [Fri, 17 Jun 2022 15:28:51 +0000 (17:28 +0200)]
fix up BDD tests for postcode changes

Includes smaller code fixes found by the tests.

23 months agoport legacy tokenizer to new postcode handling
Sarah Hoffmann [Wed, 8 Jun 2022 06:19:55 +0000 (08:19 +0200)]
port legacy tokenizer to new postcode handling

Also documents the changes to the SQL functions of the tokenizer.

23 months agofix postcode pattern for Mozambique
Sarah Hoffmann [Wed, 8 Jun 2022 05:42:35 +0000 (07:42 +0200)]
fix postcode pattern for Mozambique

Optional groups are not implemented yet.

23 months agoadd tests for discarding bad postcodes
Sarah Hoffmann [Wed, 8 Jun 2022 05:24:53 +0000 (07:24 +0200)]
add tests for discarding bad postcodes

23 months agofix liniting problems
Sarah Hoffmann [Wed, 8 Jun 2022 04:33:11 +0000 (06:33 +0200)]
fix liniting problems

23 months agocache postcode normalization
Sarah Hoffmann [Tue, 7 Jun 2022 10:08:22 +0000 (12:08 +0200)]
cache postcode normalization

23 months agoonly add well-formatted postcodes to location table
Sarah Hoffmann [Mon, 6 Jun 2022 21:44:51 +0000 (23:44 +0200)]
only add well-formatted postcodes to location table

23 months agomove postcode matcher in a separate file
Sarah Hoffmann [Mon, 6 Jun 2022 21:37:04 +0000 (23:37 +0200)]
move postcode matcher in a separate file

23 months agomove postcode centroid computation to Python
Sarah Hoffmann [Mon, 6 Jun 2022 08:46:48 +0000 (10:46 +0200)]
move postcode centroid computation to Python

23 months agoadd class for online centroid computation
Sarah Hoffmann [Mon, 6 Jun 2022 07:49:00 +0000 (09:49 +0200)]
add class for online centroid computation

23 months agoicu: switch postcodes to using the pre-formatted one
Sarah Hoffmann [Fri, 3 Jun 2022 15:12:01 +0000 (17:12 +0200)]
icu: switch postcodes to using the pre-formatted one

23 months agointroduce and use analyzer for postcodes
Sarah Hoffmann [Tue, 24 May 2022 19:45:06 +0000 (21:45 +0200)]
introduce and use analyzer for postcodes

23 months agopostcodes: introduce a default pattern for countries without postcodes
Sarah Hoffmann [Tue, 24 May 2022 16:25:37 +0000 (18:25 +0200)]
postcodes: introduce a default pattern for countries without postcodes

23 months agopostcode: generate a generic form
Sarah Hoffmann [Tue, 24 May 2022 15:11:40 +0000 (17:11 +0200)]
postcode: generate a generic form

23 months agoadd postcodes for most of the remaining countries
Sarah Hoffmann [Mon, 23 May 2022 14:11:16 +0000 (16:11 +0200)]
add postcodes for most of the remaining countries

Now includes all postcodes that have optional parts.

23 months agopostcodes: add support for optional spaces
Sarah Hoffmann [Mon, 23 May 2022 12:04:22 +0000 (14:04 +0200)]
postcodes: add support for optional spaces

23 months agoadd postcode formats with optional country code
Sarah Hoffmann [Mon, 23 May 2022 09:10:35 +0000 (11:10 +0200)]
add postcode formats with optional country code

If the country code is not part of the mandatory output, the
country code filter will do the correct handling.

23 months agopostcodes: strip leading country codes
Sarah Hoffmann [Mon, 23 May 2022 09:01:57 +0000 (11:01 +0200)]
postcodes: strip leading country codes

23 months agoadd postcodes patterns without optional spaces
Sarah Hoffmann [Thu, 19 May 2022 14:26:51 +0000 (16:26 +0200)]
add postcodes patterns without optional spaces

23 months agoinitial postcode cleaner for simple patterns
Sarah Hoffmann [Thu, 19 May 2022 13:49:36 +0000 (15:49 +0200)]
initial postcode cleaner for simple patterns

Moves postcodes that are either in countries without a postcode
system or don't correspond to the local pattern for postcodes into
a field for a normal address part. Makes them searchable but not as
a special address. This has two consequences: they are no longer a
skippable part of the address and the postcodes cannot be searched
on their own.

23 months agoadd postcode patterns for numeric postcodes
Sarah Hoffmann [Thu, 19 May 2022 10:03:26 +0000 (12:03 +0200)]
add postcode patterns for numeric postcodes

Adds patterns for countries that have simple numeric-only postcodes.

23 months agoremove postcodes from countries that don't have them
Sarah Hoffmann [Thu, 12 May 2022 09:43:47 +0000 (11:43 +0200)]
remove postcodes from countries that don't have them

The postcodes will only be removed as a 'computed postcode' they
are still searchable for the given object.

23 months agoadd info about countries without a postcode
Sarah Hoffmann [Wed, 11 May 2022 15:23:28 +0000 (17:23 +0200)]
add info about countries without a postcode

23 months agoavoid near searches in very large areas
Sarah Hoffmann [Thu, 23 Jun 2022 20:06:48 +0000 (22:06 +0200)]
avoid near searches in very large areas

At some point the contains call becomes too expensive.

23 months agoMerge pull request #2755 from Luflosi/fix-typo
Sarah Hoffmann [Mon, 20 Jun 2022 20:23:36 +0000 (22:23 +0200)]
Merge pull request #2755 from Luflosi/fix-typo

Fix typo

23 months agoFix typo
Luflosi [Mon, 20 Jun 2022 18:41:00 +0000 (20:41 +0200)]
Fix typo

23 months agoMerge pull request #2751 from mtmail/issue-2750
Sarah Hoffmann [Mon, 20 Jun 2022 08:21:06 +0000 (10:21 +0200)]
Merge pull request #2751 from mtmail/issue-2750

Documentation fix: should be "nominatim refresh"

23 months agoDocumentation fix: should be "nominatim refresh"
marc tobias [Mon, 20 Jun 2022 00:32:23 +0000 (02:32 +0200)]
Documentation fix: should be "nominatim refresh"

23 months agoMerge pull request #2746 from bgo-eiu/patch-2
Sarah Hoffmann [Sat, 18 Jun 2022 07:40:47 +0000 (09:40 +0200)]
Merge pull request #2746 from bgo-eiu/patch-2

Added additional languages for Pakistan in country settings

23 months agoMerge pull request #2749 from stefkiourk/patch-1
Sarah Hoffmann [Fri, 17 Jun 2022 20:11:55 +0000 (22:11 +0200)]
Merge pull request #2749 from stefkiourk/patch-1

Typos and syntax on Reverse.md

23 months agoTypos and syntax on Reverse.md
Stef Ki [Fri, 17 Jun 2022 19:01:38 +0000 (21:01 +0200)]
Typos and syntax on Reverse.md

23 months agoMerge pull request #2748 from lonvia/bdd-grid-origin
Sarah Hoffmann [Fri, 17 Jun 2022 13:25:29 +0000 (15:25 +0200)]
Merge pull request #2748 from lonvia/bdd-grid-origin

BDD tests: remove support for scenes

23 months agobdd: remove support for scenes
Sarah Hoffmann [Fri, 17 Jun 2022 08:06:56 +0000 (10:06 +0200)]
bdd: remove support for scenes

Only keep support for the special point geometry 'country:xx'.

23 months agobdd: move query tests from scene to grid description
Sarah Hoffmann [Thu, 16 Jun 2022 20:08:30 +0000 (22:08 +0200)]
bdd: move query tests from scene to grid description

23 months agobdd: remove step for scene setup
Sarah Hoffmann [Thu, 16 Jun 2022 19:59:35 +0000 (21:59 +0200)]
bdd: remove step for scene setup

23 months agobdd: move update tests from scenes to grid descriptions
Sarah Hoffmann [Thu, 16 Jun 2022 19:56:39 +0000 (21:56 +0200)]
bdd: move update tests from scenes to grid descriptions

23 months agobdd: move import tests from scenes to grid descriptions
Sarah Hoffmann [Wed, 15 Jun 2022 20:22:13 +0000 (22:22 +0200)]
bdd: move import tests from scenes to grid descriptions

23 months agobdd: clear lof buffer after a successful import run
Sarah Hoffmann [Mon, 13 Jun 2022 09:49:38 +0000 (11:49 +0200)]
bdd: clear lof buffer after a successful import run

23 months agobdd: allow to set an origin of the grid
Sarah Hoffmann [Mon, 13 Jun 2022 07:44:37 +0000 (09:44 +0200)]
bdd: allow to set an origin of the grid