]> git.openstreetmap.org Git - nominatim.git/log
nominatim.git
18 months agofix: 705 Status Code Documenation
Romeo [Fri, 4 Nov 2022 16:59:36 +0000 (17:59 +0100)]
fix: 705 Status Code Documenation

18 months agoMerge pull request #2862 from mtmail/remove-version-from-fpm-sock-file
Sarah Hoffmann [Fri, 4 Nov 2022 16:32:50 +0000 (17:32 +0100)]
Merge pull request #2862 from mtmail/remove-version-from-fpm-sock-file

Install scripts: remove version from /var/run/php-fpm filenames

18 months agoMerge pull request #2863 from lonvia/add-support-for-postgresql-15
Sarah Hoffmann [Fri, 4 Nov 2022 16:32:06 +0000 (17:32 +0100)]
Merge pull request #2863 from lonvia/add-support-for-postgresql-15

Update CI tests to postgresql 15

18 months agoupdate CI tests to postgresql 15
Sarah Hoffmann [Fri, 4 Nov 2022 14:23:06 +0000 (15:23 +0100)]
update CI tests to postgresql 15

18 months agoInstall scripts: remove version from /var/run/php-fpm filenames
marc tobias [Thu, 3 Nov 2022 22:29:58 +0000 (23:29 +0100)]
Install scripts: remove version from /var/run/php-fpm filenames

18 months agoactions: pin pyicu to 2.9
Sarah Hoffmann [Mon, 24 Oct 2022 12:21:44 +0000 (14:21 +0200)]
actions: pin pyicu to 2.9

18 months agoMerge pull request #2836 from mtmail/tiger2022
Sarah Hoffmann [Mon, 24 Oct 2022 09:21:55 +0000 (11:21 +0200)]
Merge pull request #2836 from mtmail/tiger2022

Documentation: remove year from TIGER filename, new 2022 data

19 months agoMerge pull request #2838 from lonvia/update-osm2pgsql
Sarah Hoffmann [Wed, 5 Oct 2022 16:59:13 +0000 (18:59 +0200)]
Merge pull request #2838 from lonvia/update-osm2pgsql

Update osm2pgsql to latest 1.7.1 release

19 months agofix flaky API test
Sarah Hoffmann [Wed, 5 Oct 2022 13:16:14 +0000 (15:16 +0200)]
fix flaky API test

The search 'landstr' produces many duplicates so that with
some bad luck 4 or less results may appear. Disable deduplication
to make it more predictable.

19 months agoupdate osm2pgsql to 1.7.1
Sarah Hoffmann [Tue, 4 Oct 2022 19:16:57 +0000 (21:16 +0200)]
update osm2pgsql to 1.7.1

19 months agoMerge pull request #2835 from lonvia/secondary-importance
Sarah Hoffmann [Tue, 4 Oct 2022 14:25:47 +0000 (16:25 +0200)]
Merge pull request #2835 from lonvia/secondary-importance

Secondary importance

19 months agoDocumentation: remove year from TIGER filename
marc tobias [Tue, 4 Oct 2022 12:19:36 +0000 (14:19 +0200)]
Documentation: remove year from TIGER filename

19 months agodocs: add customization hints for secondary importance
Sarah Hoffmann [Thu, 29 Sep 2022 12:55:46 +0000 (14:55 +0200)]
docs: add customization hints for secondary importance

Removing the download links for now as the tile importance
is still too experimental.

19 months agodo not run unit test when postgis_raster is not available
Sarah Hoffmann [Thu, 29 Sep 2022 08:01:49 +0000 (10:01 +0200)]
do not run unit test when postgis_raster is not available

19 months agoadapt unit tests to changed function names
Sarah Hoffmann [Wed, 28 Sep 2022 15:41:16 +0000 (17:41 +0200)]
adapt unit tests to changed function names

19 months agoadd secondary importance to API BDD tests
Sarah Hoffmann [Tue, 27 Sep 2022 21:13:29 +0000 (23:13 +0200)]
add secondary importance to API BDD tests

Also fixes a path issue during API test DB creation that could
never possibly have worked.

19 months agosimplify use of secondary importance
Sarah Hoffmann [Tue, 27 Sep 2022 20:12:48 +0000 (22:12 +0200)]
simplify use of secondary importance

The values in the raster are already normalized between 0 and 2**16,
so a simple conversion to [0, 1] will do.

Check for existance of secondary_importance table statically when
creating the SQL function. For that to work importance tables need
to be created before the functions.

19 months agoload views as a SQL file and rename to 'secondary importance'
Sarah Hoffmann [Tue, 27 Sep 2022 19:08:15 +0000 (21:08 +0200)]
load views as a SQL file and rename to 'secondary importance'

The only requirement for secondary importance is that a raster table
comes out of it. The generic name leaves open where the data comes
from.

19 months agoIntegrated OSM views into importance computation
Tareq Al-Ahdal [Thu, 25 Aug 2022 07:45:18 +0000 (09:45 +0200)]
Integrated OSM views into importance computation

19 months agoEnhanced the implementation of OSM views GeoTIFF import functionality
Tareq Al-Ahdal [Sun, 24 Jul 2022 11:04:23 +0000 (19:04 +0800)]
Enhanced the implementation of OSM views GeoTIFF import functionality

19 months agoInitial implementation of GeoTIFF import functionality
Tareq Al-Ahdal [Wed, 6 Jul 2022 06:16:41 +0000 (08:16 +0200)]
Initial implementation of GeoTIFF import functionality

19 months agoMerge pull request #2832 from lonvia/conditional-analyze-on-indexing
Sarah Hoffmann [Wed, 28 Sep 2022 13:17:40 +0000 (15:17 +0200)]
Merge pull request #2832 from lonvia/conditional-analyze-on-indexing

Only run analyze on indexing when work was done

19 months agoonly run analyze on indexing when work was done
Sarah Hoffmann [Wed, 28 Sep 2022 08:22:54 +0000 (10:22 +0200)]
only run analyze on indexing when work was done

This speeds up processing when continuing indexing after it was
interrupted.

19 months agoMerge pull request #2829 from lonvia/optimize-indexes
Sarah Hoffmann [Mon, 26 Sep 2022 08:02:51 +0000 (10:02 +0200)]
Merge pull request #2829 from lonvia/optimize-indexes

Further optimize indexes

19 months agomake sure indexes are used
Sarah Hoffmann [Sun, 25 Sep 2022 12:09:45 +0000 (14:09 +0200)]
make sure indexes are used

19 months agofurther split up the big geometry index
Sarah Hoffmann [Wed, 21 Sep 2022 12:25:07 +0000 (14:25 +0200)]
further split up the big geometry index

Adds partial indexes for all geometry queries used during import.
A full index is not necessary anymore at that point. Still create
the index afterwards for use in queries.

Also adds documentation for all indexes on where they are used.

19 months agoconsolidate indexes over geometry_sectors
Sarah Hoffmann [Wed, 21 Sep 2022 08:38:58 +0000 (10:38 +0200)]
consolidate indexes over geometry_sectors

The index over geometry_sectors are mainly used for ordering
the places which need indexing. That means they function effectively
as a TODO list. Consolodate them so that they always only contain
the places which are still to do. Also add the appropriate index
for the boundary indexing phase.

19 months agosplit up large osmid index on placex
Sarah Hoffmann [Tue, 20 Sep 2022 16:44:37 +0000 (18:44 +0200)]
split up large osmid index on placex

This doesn't do anything in terms of lookup speeds but the resulting
indexes are quite a bit smaller.

19 months agofix funding link
Sarah Hoffmann [Mon, 19 Sep 2022 13:39:58 +0000 (15:39 +0200)]
fix funding link

19 months agoadd Github Sponsering to funding page
Sarah Hoffmann [Mon, 19 Sep 2022 13:38:56 +0000 (15:38 +0200)]
add Github Sponsering to funding page

19 months agorun final index creation in parallel
Sarah Hoffmann [Wed, 14 Sep 2022 13:37:39 +0000 (15:37 +0200)]
run final index creation in parallel

19 months agoadd function for parallel execution of SQL scripts
Sarah Hoffmann [Mon, 19 Sep 2022 09:52:17 +0000 (11:52 +0200)]
add function for parallel execution of SQL scripts

19 months agoadd link to funding page
Sarah Hoffmann [Mon, 19 Sep 2022 08:30:58 +0000 (10:30 +0200)]
add link to funding page

19 months agoMerge pull request #2818 from lonvia/better-geometry-index
Sarah Hoffmann [Mon, 19 Sep 2022 08:18:43 +0000 (10:18 +0200)]
Merge pull request #2818 from lonvia/better-geometry-index

Add index for lookup of addressable areas

19 months agoadd indexes for lookup of addressable areas
Sarah Hoffmann [Sun, 18 Sep 2022 14:50:18 +0000 (16:50 +0200)]
add indexes for lookup of addressable areas

The generic geometry index has become to slow for that purpose.

19 months agoupdate security policy for 4.1 version
Sarah Hoffmann [Tue, 13 Sep 2022 06:58:31 +0000 (08:58 +0200)]
update security policy for 4.1 version

20 months agomypy: fix new warnings due to external type updates
Sarah Hoffmann [Mon, 5 Sep 2022 15:38:48 +0000 (17:38 +0200)]
mypy: fix new warnings due to external type updates

20 months agoMerge pull request #2812 from mausch/patch-1
Sarah Hoffmann [Mon, 5 Sep 2022 15:27:09 +0000 (17:27 +0200)]
Merge pull request #2812 from mausch/patch-1

docs: fix links to rank docs

20 months agodocs: fix links to rank docs
Mauricio Scheffer [Mon, 5 Sep 2022 10:11:13 +0000 (11:11 +0100)]
docs: fix links to rank docs

20 months agoMerge pull request #2799 from lonvia/fix-inclusions-with-extratags
Sarah Hoffmann [Sat, 13 Aug 2022 17:02:27 +0000 (19:02 +0200)]
Merge pull request #2799 from lonvia/fix-inclusions-with-extratags

Ignore irrelevant extra tags on address interpolations

20 months agoMerge pull request #2739 from tareqpi/collect_os_info.sh
Sarah Hoffmann [Sat, 13 Aug 2022 17:02:14 +0000 (19:02 +0200)]
Merge pull request #2739 from tareqpi/collect_os_info.sh

integration of host system information script into Nominatim CLI tool

20 months agoignore irrelevant extra tags on address interpolations
Sarah Hoffmann [Sat, 13 Aug 2022 08:42:46 +0000 (10:42 +0200)]
ignore irrelevant extra tags on address interpolations

When deciding if an address interpolation has address information, only
look for addr:street and addr:place. If they are not there go looking
for the address on the address nodes. Ignores irrelevant tags like
addr:inclusion.

Fixes #2797.

20 months agoAdded the feature of collecting host system information to the CI tests
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:22:13 +0000 (06:22 +0800)]
Added the feature of collecting host system information to the CI tests

20 months agoIntegrated 'collect_os_info.py' into Nominatim's CLI tool
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:18:10 +0000 (06:18 +0800)]
Integrated 'collect_os_info.py' into Nominatim's CLI tool

20 months agoEnhanced and refactored 'collect_os_info.py'
Tareq Al-Ahdal [Fri, 12 Aug 2022 22:13:05 +0000 (06:13 +0800)]
Enhanced and refactored 'collect_os_info.py'

Changed the script to functional programming paradigm to remove the big number of local attributes to decrease memory usage when running it. Additional OS info are now included.

20 months agoMerge remote-tracking branch 'upstream/master' into collect_os_info.sh
Tareq Al-Ahdal [Fri, 12 Aug 2022 21:53:39 +0000 (05:53 +0800)]
Merge remote-tracking branch 'upstream/master' into collect_os_info.sh

20 months agoMerge pull request #2798 from lonvia/more-rank-change-fixes
Sarah Hoffmann [Fri, 12 Aug 2022 09:42:03 +0000 (11:42 +0200)]
Merge pull request #2798 from lonvia/more-rank-change-fixes

Invalidations when boundaries and places change their rank

20 months agomore invalidations when boundary changes rank
Sarah Hoffmann [Thu, 11 Aug 2022 21:44:09 +0000 (23:44 +0200)]
more invalidations when boundary changes rank

When a boundary or place changes its address rank, all places where
it participates as address need to be potentially reindexed.
Also use the computed rank when testing place nodes against
boundaries. Boundaries are computed earlier.

Fixes #2794.

21 months agoMerge pull request #2793 from lonvia/increase-minimum-results
Sarah Hoffmann [Tue, 9 Aug 2022 18:08:45 +0000 (20:08 +0200)]
Merge pull request #2793 from lonvia/increase-minimum-results

Fix minimum number of results that are searched for

21 months agofix base number of returned results
Sarah Hoffmann [Tue, 9 Aug 2022 07:40:37 +0000 (09:40 +0200)]
fix base number of returned results

The intent was to always search for at least 10 results.

Improves on #882.

21 months agoMerge pull request #2792 from lonvia/new-type-annotations
Sarah Hoffmann [Tue, 9 Aug 2022 11:52:20 +0000 (13:52 +0200)]
Merge pull request #2792 from lonvia/new-type-annotations

Adapt to new type annotations from typeshed

21 months agoadapt to new type annotations from typeshed
Sarah Hoffmann [Tue, 9 Aug 2022 09:06:54 +0000 (11:06 +0200)]
adapt to new type annotations from typeshed

Some more functions frrom psycopg are now properly annotated.
No ignoring necessary anymore.

21 months agodocs: add types-psutil requirement
Sarah Hoffmann [Mon, 8 Aug 2022 07:46:25 +0000 (09:46 +0200)]
docs: add types-psutil requirement

21 months agoremove mypy ignore for psutil.virtual_memory()
Sarah Hoffmann [Mon, 8 Aug 2022 07:44:45 +0000 (09:44 +0200)]
remove mypy ignore for psutil.virtual_memory()

Now available in typeshed.

21 months agoMerge pull request #2789 from lonvia/update-osm2pgsql
Sarah Hoffmann [Mon, 8 Aug 2022 07:15:58 +0000 (09:15 +0200)]
Merge pull request #2789 from lonvia/update-osm2pgsql

Update osm2pgsql (fixes admin_level parsing)

21 months agoupdate osm2pgsql (fix admin_level parsing)
Sarah Hoffmann [Sun, 7 Aug 2022 16:34:47 +0000 (18:34 +0200)]
update osm2pgsql (fix admin_level parsing)

21 months agodocs: fix dangling links v4.1.0
Sarah Hoffmann [Fri, 5 Aug 2022 13:29:43 +0000 (15:29 +0200)]
docs: fix dangling links

21 months agodocs: update links to vagrant instructions
Sarah Hoffmann [Fri, 5 Aug 2022 13:27:11 +0000 (15:27 +0200)]
docs: update links to vagrant instructions

21 months agoprepare release 4.1.0
Sarah Hoffmann [Fri, 5 Aug 2022 12:33:11 +0000 (14:33 +0200)]
prepare release 4.1.0

21 months agoMerge pull request #2786 from lonvia/export-centroid-for-tokenizer
Sarah Hoffmann [Mon, 1 Aug 2022 09:38:24 +0000 (11:38 +0200)]
Merge pull request #2786 from lonvia/export-centroid-for-tokenizer

Export centroid to tokenizer

21 months agoexport centroid to tokenizer
Sarah Hoffmann [Sun, 31 Jul 2022 20:10:58 +0000 (22:10 +0200)]
export centroid to tokenizer

May come in handy when developping sanitizers for an area smaller
than country size.

21 months agoMerge pull request #2784 from lonvia/doscs-customizing-icu-tokenizer
Sarah Hoffmann [Sun, 31 Jul 2022 17:15:50 +0000 (19:15 +0200)]
Merge pull request #2784 from lonvia/doscs-customizing-icu-tokenizer

Document the public API of sanitizers and token analysis modules

21 months agofix various typos
Sarah Hoffmann [Sun, 31 Jul 2022 15:10:35 +0000 (17:10 +0200)]
fix various typos

21 months agoadd simple examples of sanitizers and token analysis
Sarah Hoffmann [Fri, 29 Jul 2022 15:15:25 +0000 (17:15 +0200)]
add simple examples of sanitizers and token analysis

21 months agooverhaul the token analysis interface
Sarah Hoffmann [Fri, 29 Jul 2022 13:14:11 +0000 (15:14 +0200)]
overhaul the token analysis interface

The functional split betweenthe two functions is now that the
first one creates the ID that is used in the word table and
the second one creates the variants. There no longer is a
requirement that the ID is the normalized version. We might
later reintroduce the requirement that a normalized version be available
but it doesn't necessarily need to be through the ID.

The function that creates the ID now gets the full PlaceName. That way
it might take into account attributes that were set by the sanitizers.

Finally rename both functions to something more sane.

21 months agomove PlaceName into the generic data module
Sarah Hoffmann [Fri, 29 Jul 2022 09:39:55 +0000 (11:39 +0200)]
move PlaceName into the generic data module

21 months agoharmonize spelling
Sarah Hoffmann [Fri, 29 Jul 2022 08:52:01 +0000 (10:52 +0200)]
harmonize spelling

Stick with the American spelling of Analyze.

21 months agoharmonize interface of token analysis module
Sarah Hoffmann [Fri, 29 Jul 2022 08:43:07 +0000 (10:43 +0200)]
harmonize interface of token analysis module

The configure() function now receives a Transliterator object instead
of the ICU rules. This harmonizes the parameters with the create
function.

21 months agoadd documentation for custom token analysis
Sarah Hoffmann [Fri, 29 Jul 2022 07:41:28 +0000 (09:41 +0200)]
add documentation for custom token analysis

21 months agoadd documentation for sanitizer interface
Sarah Hoffmann [Thu, 28 Jul 2022 20:00:29 +0000 (22:00 +0200)]
add documentation for sanitizer interface

Also switches mkdocstrings to 0.18 with the rather unfortunate
consequence that now mkdocstrings-python-legacy is needed as well.

21 months agoMerge pull request #2780 from lonvia/python-modules-in-project-directory
Sarah Hoffmann [Thu, 28 Jul 2022 19:58:04 +0000 (21:58 +0200)]
Merge pull request #2780 from lonvia/python-modules-in-project-directory

Support for external sanitizer and token analysis modules

21 months agoadd support for external token analysis modules
Sarah Hoffmann [Mon, 25 Jul 2022 14:27:22 +0000 (16:27 +0200)]
add support for external token analysis modules

21 months agoadd support for external sanitizer modules
Sarah Hoffmann [Mon, 25 Jul 2022 14:10:19 +0000 (16:10 +0200)]
add support for external sanitizer modules

21 months agoadd function for loading plugin modules
Sarah Hoffmann [Mon, 25 Jul 2022 13:17:20 +0000 (15:17 +0200)]
add function for loading plugin modules

Loads modules for configurable code like tokenizers, sanitizers, etc.
Supports internal modules, external libraries and code from the
project directory.

21 months agoMerge pull request #2775 from lonvia/remove-centos-instructions
Sarah Hoffmann [Mon, 25 Jul 2022 08:29:32 +0000 (10:29 +0200)]
Merge pull request #2775 from lonvia/remove-centos-instructions

Remove vagrant scripts for CentOS

21 months agovagrant: remove proj dependency and only require php-cli
Sarah Hoffmann [Sun, 24 Jul 2022 08:24:18 +0000 (10:24 +0200)]
vagrant: remove proj dependency and only require php-cli

21 months agoremove CentOS installation instructions
Sarah Hoffmann [Sun, 24 Jul 2022 08:22:22 +0000 (10:22 +0200)]
remove CentOS installation instructions

Fixes #2601.

21 months agoMerge pull request #2774 from lonvia/parameter-arrays
Sarah Hoffmann [Sat, 23 Jul 2022 21:56:32 +0000 (23:56 +0200)]
Merge pull request #2774 from lonvia/parameter-arrays

Ignore URL parameters in array notation

21 months agoignore API parameters in array notation
Sarah Hoffmann [Sat, 23 Jul 2022 08:51:44 +0000 (10:51 +0200)]
ignore API parameters in array notation

PHP automatically parses parameters in an array notation(foo[]) into
array types. Ignore these parameters as 'unknown'.

Fixes #2763.

21 months agoMerge pull request #2772 from kianmeng/fix-typos
Sarah Hoffmann [Wed, 20 Jul 2022 15:13:30 +0000 (17:13 +0200)]
Merge pull request #2772 from kianmeng/fix-typos

docs: fix typos

21 months agodocs: fix typos
Kian-Meng Ang [Wed, 20 Jul 2022 14:05:25 +0000 (22:05 +0800)]
docs: fix typos

21 months agodocs: slightly increase recommended hardware requirements
Sarah Hoffmann [Wed, 20 Jul 2022 08:16:23 +0000 (10:16 +0200)]
docs: slightly increase recommended hardware requirements

21 months agoMerge pull request #2770 from lonvia/typed-python
Sarah Hoffmann [Tue, 19 Jul 2022 07:03:30 +0000 (09:03 +0200)]
Merge pull request #2770 from lonvia/typed-python

Type annotations for Python code

21 months agoCI: remove installation of pip on Ubuntu 20
Sarah Hoffmann [Mon, 18 Jul 2022 10:19:04 +0000 (12:19 +0200)]
CI: remove installation of pip on Ubuntu 20

21 months agoadd explicit cast for fetchone
Sarah Hoffmann [Mon, 18 Jul 2022 08:18:51 +0000 (10:18 +0200)]
add explicit cast for fetchone

21 months agoCIL use psutil type stubs
Sarah Hoffmann [Sun, 17 Jul 2022 22:16:33 +0000 (00:16 +0200)]
CIL use psutil type stubs

21 months agoremove typing_extensions requirement
Sarah Hoffmann [Sun, 17 Jul 2022 21:18:55 +0000 (23:18 +0200)]
remove typing_extensions requirement

The typing_extensions package is only necessary now when running mypy.
It won't be used at runtime anymore.

21 months agoCI: make type checking strict
Sarah Hoffmann [Sun, 17 Jul 2022 21:20:21 +0000 (23:20 +0200)]
CI: make type checking strict

21 months agoadd type annotations for command line functions
Sarah Hoffmann [Sun, 17 Jul 2022 16:31:51 +0000 (18:31 +0200)]
add type annotations for command line functions

21 months agoadd type annotations for Tiger import function
Sarah Hoffmann [Sun, 17 Jul 2022 09:01:44 +0000 (11:01 +0200)]
add type annotations for Tiger import function

21 months agoadd type annotations to special phrase importer
Sarah Hoffmann [Sun, 17 Jul 2022 08:46:59 +0000 (10:46 +0200)]
add type annotations to special phrase importer

21 months agoadd type annotations to database check functions
Sarah Hoffmann [Sun, 17 Jul 2022 07:59:51 +0000 (09:59 +0200)]
add type annotations to database check functions

21 months agoadd type annotations for database import functions
Sarah Hoffmann [Sat, 16 Jul 2022 22:29:34 +0000 (00:29 +0200)]
add type annotations for database import functions

21 months agoadd type annotations for migrations
Sarah Hoffmann [Sat, 16 Jul 2022 21:44:36 +0000 (23:44 +0200)]
add type annotations for migrations

21 months agoadd type annotations to tool functions
Sarah Hoffmann [Sat, 16 Jul 2022 21:28:02 +0000 (23:28 +0200)]
add type annotations to tool functions

21 months agoadd type annotations for ICU tokenizer
Sarah Hoffmann [Sat, 16 Jul 2022 15:33:19 +0000 (17:33 +0200)]
add type annotations for ICU tokenizer

21 months agoadd type annotations for legacy tokenizer
Sarah Hoffmann [Fri, 15 Jul 2022 20:52:26 +0000 (22:52 +0200)]
add type annotations for legacy tokenizer

21 months agoadd type annotations to ICU tokenizer helper modules
Sarah Hoffmann [Wed, 13 Jul 2022 20:55:40 +0000 (22:55 +0200)]
add type annotations to ICU tokenizer helper modules

21 months agoadd typing extensions for Ubuntu22.04
Sarah Hoffmann [Wed, 13 Jul 2022 18:49:54 +0000 (20:49 +0200)]
add typing extensions for Ubuntu22.04

21 months agoadd type annotations for token analysis
Sarah Hoffmann [Wed, 13 Jul 2022 15:18:53 +0000 (17:18 +0200)]
add type annotations for token analysis

No annotations for ICU types yet.