]> git.openstreetmap.org Git - nominatim.git/log
nominatim.git
7 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Sun, 8 Oct 2023 07:33:50 +0000 (09:33 +0200)]
Merge remote-tracking branch 'upstream/master'

7 months agoreduce influence of viewbox
Sarah Hoffmann [Sat, 7 Oct 2023 15:30:01 +0000 (17:30 +0200)]
reduce influence of viewbox

Perfectly matching city names should still get priority.

7 months agoMerge pull request #3212 from lonvia/more-tests
Sarah Hoffmann [Thu, 5 Oct 2023 14:36:53 +0000 (16:36 +0200)]
Merge pull request #3212 from lonvia/more-tests

Add more unit tests for search

7 months agoswitch back meaning of reverse and search in warm
Sarah Hoffmann [Wed, 4 Oct 2023 13:19:24 +0000 (15:19 +0200)]
switch back meaning of reverse and search in warm

Also do'n try to warm up searches on reverse-only databases.

Fixes #3213.

8 months agomore unit tests for search
Sarah Hoffmann [Tue, 26 Sep 2023 07:40:30 +0000 (09:40 +0200)]
more unit tests for search

8 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Tue, 26 Sep 2023 19:29:50 +0000 (21:29 +0200)]
Merge remote-tracking branch 'upstream/master'

8 months agoMerge pull request #3211 from lonvia/replace-get-addressdata
Sarah Hoffmann [Tue, 26 Sep 2023 19:29:15 +0000 (21:29 +0200)]
Merge pull request #3211 from lonvia/replace-get-addressdata

Move get_addressdata() implementation to Python

8 months agomove get_addressdata() implementation to Python
Sarah Hoffmann [Sat, 23 Sep 2023 08:44:37 +0000 (10:44 +0200)]
move get_addressdata() implementation to Python

The pgsql function get_addressdata() does a lookup of a lot of data
that is already available in Python.

8 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Thu, 21 Sep 2023 07:49:55 +0000 (09:49 +0200)]
Merge remote-tracking branch 'upstream/master'

8 months agoMerge pull request #3206 from lonvia/rerank-by-locale
Sarah Hoffmann [Thu, 21 Sep 2023 07:24:18 +0000 (09:24 +0200)]
Merge pull request #3206 from lonvia/rerank-by-locale

Reintroduce result reranking

8 months agoadapt tests to improved search
Sarah Hoffmann [Wed, 20 Sep 2023 12:48:00 +0000 (14:48 +0200)]
adapt tests to improved search

8 months agofilter duplicate results after DB query
Sarah Hoffmann [Wed, 20 Sep 2023 09:39:18 +0000 (11:39 +0200)]
filter duplicate results after DB query

8 months agorerank results by query
Sarah Hoffmann [Tue, 19 Sep 2023 14:18:09 +0000 (16:18 +0200)]
rerank results by query

The algorithm is similar to the PHP reranking and uses the terms from
the display name to check against the query terms. However instead of
exact matching it uses a per-word-edit-distance, so that it is less
strict when it comes to mismatching accents or other one letter
differences.

Country names get a higher penalty because they don't receive a
penalty during token matching right now.

This will work badly with the legacy tokenizer. Given that it is
marked for removal, it is simply not worth optimising for it.

8 months agomove localization into add_result_details
Sarah Hoffmann [Tue, 19 Sep 2023 09:17:04 +0000 (11:17 +0200)]
move localization into add_result_details

This means that the locale now needs to be handed in into the search
functions already. At least search needs them for reranking.

8 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Sun, 17 Sep 2023 15:10:35 +0000 (17:10 +0200)]
Merge remote-tracking branch 'upstream/master'

8 months agoMerge pull request #3201 from lonvia/tweak-expected-count
Sarah Hoffmann [Sun, 17 Sep 2023 15:04:27 +0000 (17:04 +0200)]
Merge pull request #3201 from lonvia/tweak-expected-count

Reduce expected count for multi-part words

8 months ago'fix' issues with recent changes to psycopg2 typing
Sarah Hoffmann [Sun, 17 Sep 2023 13:09:34 +0000 (15:09 +0200)]
'fix' issues with recent changes to psycopg2 typing

Some of the changes just make the warnings go away. The typing info
is still incorrect on the stub side, as far as I can determine.

8 months agoreduce expected count for multi-part words
Sarah Hoffmann [Mon, 11 Sep 2023 15:45:34 +0000 (17:45 +0200)]
reduce expected count for multi-part words

Fixes #3196.

8 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Mon, 11 Sep 2023 07:48:58 +0000 (09:48 +0200)]
Merge remote-tracking branch 'upstream/master'

8 months agoadd changelog for 4.2.3 v4.3.0
Sarah Hoffmann [Thu, 7 Sep 2023 08:07:16 +0000 (10:07 +0200)]
add changelog for 4.2.3

8 months agoprepare release 4.3.0
Sarah Hoffmann [Wed, 6 Sep 2023 18:08:28 +0000 (20:08 +0200)]
prepare release 4.3.0

8 months agoreenable logging of details calls
Sarah Hoffmann [Wed, 6 Sep 2023 09:35:53 +0000 (11:35 +0200)]
reenable logging of details calls

8 months agorestrict deduplication to results from placex
Sarah Hoffmann [Wed, 6 Sep 2023 08:43:55 +0000 (10:43 +0200)]
restrict deduplication to results from placex

All other sources do not have deduplicatable entries.

8 months agoadd bbox output to lookup results
Sarah Hoffmann [Wed, 6 Sep 2023 08:27:03 +0000 (10:27 +0200)]
add bbox output to lookup results

Fixes #3149.

8 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Tue, 5 Sep 2023 15:30:16 +0000 (17:30 +0200)]
Merge remote-tracking branch 'upstream/master'

8 months agodocumentation: fix a broken link, typos
marc tobias [Wed, 30 Aug 2023 23:11:54 +0000 (01:11 +0200)]
documentation: fix a broken link, typos

8 months agoMerge pull request #3190 from lonvia/fix-internal-server-errors
Sarah Hoffmann [Tue, 5 Sep 2023 15:00:31 +0000 (17:00 +0200)]
Merge pull request #3190 from lonvia/fix-internal-server-errors

Fix more failing queries

8 months agoMerge pull request #3189 from lonvia/add-country-area-restriction
Sarah Hoffmann [Tue, 5 Sep 2023 12:29:44 +0000 (14:29 +0200)]
Merge pull request #3189 from lonvia/add-country-area-restriction

Implement NOMINATIM_SEARCH_WITHIN_COUNTRIES for Python frontend

8 months agoactions: update to checkout v4
Sarah Hoffmann [Tue, 5 Sep 2023 09:44:12 +0000 (11:44 +0200)]
actions: update to checkout v4

8 months agorestrict range for interpolated housenumbers
Sarah Hoffmann [Tue, 5 Sep 2023 09:41:41 +0000 (11:41 +0200)]
restrict range for interpolated housenumbers

Interpolations are only supported up to 2^32 by the database.
Limit to 8 digits, which is still more than should be needed.

8 months agoavoid interpreting integral numbers as coordinates
Sarah Hoffmann [Tue, 5 Sep 2023 09:26:47 +0000 (11:26 +0200)]
avoid interpreting integral numbers as coordinates

There are addresses of type '123 W 345 N, Reigh', where 'W 345 N' is
the actual name of the street.

8 months agoMerge pull request #3188 from lonvia/update-osm2pgsql
Sarah Hoffmann [Tue, 5 Sep 2023 08:44:32 +0000 (10:44 +0200)]
Merge pull request #3188 from lonvia/update-osm2pgsql

Update osm2pgsql to 1.9.2

8 months agoupdate osm2pgsql to 1.9.2
Sarah Hoffmann [Mon, 4 Sep 2023 12:53:46 +0000 (14:53 +0200)]
update osm2pgsql to 1.9.2

8 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Mon, 4 Sep 2023 12:52:15 +0000 (14:52 +0200)]
Merge remote-tracking branch 'upstream/master'

8 months agoallow lower case OSM types in lookup query
Sarah Hoffmann [Mon, 4 Sep 2023 12:39:35 +0000 (14:39 +0200)]
allow lower case OSM types in lookup query

8 months agoMerge pull request #3186 from lonvia/tablespaces-for-flex
Sarah Hoffmann [Mon, 4 Sep 2023 12:25:45 +0000 (14:25 +0200)]
Merge pull request #3186 from lonvia/tablespaces-for-flex

Make tablespace arguments work again for flex tables

8 months agoimplement NOMINATIM_SEARCH_WITHIN_COUNTRIES setting
Sarah Hoffmann [Mon, 4 Sep 2023 12:10:36 +0000 (14:10 +0200)]
implement NOMINATIM_SEARCH_WITHIN_COUNTRIES setting

8 months agoreenable tablespace arguments for flex tables
Sarah Hoffmann [Mon, 4 Sep 2023 08:45:52 +0000 (10:45 +0200)]
reenable tablespace arguments for flex tables

8 months agoadd a shutdown handler for falcon server closing DB connections
Sarah Hoffmann [Thu, 31 Aug 2023 07:40:56 +0000 (09:40 +0200)]
add a shutdown handler for falcon server closing DB connections

8 months agoremove alias where it does not work with lambdas
Sarah Hoffmann [Wed, 30 Aug 2023 19:52:51 +0000 (21:52 +0200)]
remove alias where it does not work with lambdas

Fixes #3177.

8 months agoswitch to newest osm2pgsql version
Sarah Hoffmann [Wed, 30 Aug 2023 17:40:36 +0000 (19:40 +0200)]
switch to newest osm2pgsql version

8 months agofix parameter name for layer filter
Sarah Hoffmann [Wed, 30 Aug 2023 07:54:50 +0000 (09:54 +0200)]
fix parameter name for layer filter

8 months agoMerge pull request #3178 from lonvia/library-documentation
Sarah Hoffmann [Wed, 30 Aug 2023 07:17:24 +0000 (09:17 +0200)]
Merge pull request #3178 from lonvia/library-documentation

Update documentation for new Python frontend

9 months agofix typos and grammar issues
Sarah Hoffmann [Tue, 29 Aug 2023 10:14:44 +0000 (12:14 +0200)]
fix typos and grammar issues

9 months agorename documentation to 'Nominatim Manual'
Sarah Hoffmann [Mon, 28 Aug 2023 08:59:26 +0000 (10:59 +0200)]
rename documentation to 'Nominatim Manual'

9 months agoadapt installation instruction for different frontends
Sarah Hoffmann [Mon, 28 Aug 2023 08:48:34 +0000 (10:48 +0200)]
adapt installation instruction for different frontends

9 months agoupdate API documentation
Sarah Hoffmann [Mon, 28 Aug 2023 08:31:58 +0000 (10:31 +0200)]
update API documentation

9 months agoadd deployment documentation for Python frontend
Sarah Hoffmann [Sun, 27 Aug 2023 19:27:16 +0000 (21:27 +0200)]
add deployment documentation for Python frontend

9 months agoupdate documentation for configuration
Sarah Hoffmann [Sun, 27 Aug 2023 14:08:06 +0000 (16:08 +0200)]
update documentation for configuration

9 months agoadd getting started section for library docs
Sarah Hoffmann [Sun, 27 Aug 2023 12:42:04 +0000 (14:42 +0200)]
add getting started section for library docs

9 months agorevert to osm2pgsql 1.8.1
Sarah Hoffmann [Sun, 27 Aug 2023 08:58:54 +0000 (10:58 +0200)]
revert to osm2pgsql 1.8.1

9 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Sun, 27 Aug 2023 08:56:43 +0000 (10:56 +0200)]
Merge remote-tracking branch 'upstream/master'

9 months agoswitch to material theme
Sarah Hoffmann [Fri, 25 Aug 2023 20:47:07 +0000 (22:47 +0200)]
switch to material theme

Needed for tabbed code blocks.

9 months agopreliminary library reference finished
Sarah Hoffmann [Wed, 23 Aug 2023 13:34:07 +0000 (15:34 +0200)]
preliminary library reference finished

9 months agomore library documentation
Sarah Hoffmann [Tue, 22 Aug 2023 22:23:40 +0000 (00:23 +0200)]
more library documentation

9 months agofinish configuration section
Sarah Hoffmann [Tue, 22 Aug 2023 20:16:34 +0000 (22:16 +0200)]
finish configuration section

9 months agorestructure library documentation
Sarah Hoffmann [Tue, 22 Aug 2023 19:46:10 +0000 (21:46 +0200)]
restructure library documentation

9 months agoinitial configuration documentation
Sarah Hoffmann [Sun, 20 Aug 2023 08:42:33 +0000 (10:42 +0200)]
initial configuration documentation

9 months agodocs: documentation of API classes
Sarah Hoffmann [Sat, 19 Aug 2023 13:36:57 +0000 (15:36 +0200)]
docs: documentation of API classes

9 months agomore adaptions for mkdocstrings griffin plugin
Sarah Hoffmann [Sat, 19 Aug 2023 07:34:31 +0000 (09:34 +0200)]
more adaptions for mkdocstrings griffin plugin

9 months agoadd base framework for library reference
Sarah Hoffmann [Fri, 18 Aug 2023 16:05:57 +0000 (18:05 +0200)]
add base framework for library reference

9 months agoupdate to modern mkdocstrings python handler
Sarah Hoffmann [Fri, 18 Aug 2023 15:28:45 +0000 (17:28 +0200)]
update to modern mkdocstrings python handler

9 months agoMerge pull request #3174 from lonvia/osm2pgsql-update-fix
Sarah Hoffmann [Fri, 25 Aug 2023 19:26:23 +0000 (21:26 +0200)]
Merge pull request #3174 from lonvia/osm2pgsql-update-fix

Be more precise on what is deleted on updates

9 months agobe more strict about removal from place_to_be_deleted
Sarah Hoffmann [Fri, 25 Aug 2023 12:20:27 +0000 (14:20 +0200)]
be more strict about removal from place_to_be_deleted

If the type of a place is changed and then the same insert issued
again, the old data will effectively remain in the table.

Fixed #3168.

9 months agoadd test case for bad update
Sarah Hoffmann [Fri, 25 Aug 2023 06:45:47 +0000 (08:45 +0200)]
add test case for bad update

9 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Fri, 25 Aug 2023 08:01:06 +0000 (10:01 +0200)]
Merge remote-tracking branch 'upstream/master'

9 months agoMerge pull request #3172 from lonvia/query-timeout
Sarah Hoffmann [Fri, 25 Aug 2023 08:00:22 +0000 (10:00 +0200)]
Merge pull request #3172 from lonvia/query-timeout

Introduce timeouts for queries

9 months agoadd additional timeout for entire request
Sarah Hoffmann [Fri, 25 Aug 2023 07:16:53 +0000 (09:16 +0200)]
add additional timeout for entire request

9 months agouse backwards-compatible asyncio timeout implementation
Sarah Hoffmann [Thu, 24 Aug 2023 14:29:21 +0000 (16:29 +0200)]
use backwards-compatible asyncio timeout implementation

9 months agotranslate query timeouts into proper HTTP responses
Sarah Hoffmann [Thu, 24 Aug 2023 13:55:05 +0000 (15:55 +0200)]
translate query timeouts into proper HTTP responses

Need to use a 503 here because a 408 (Request timeout) will motivate
browsers to immediately resent the request.

9 months agoadd a timeout for DB queries
Sarah Hoffmann [Thu, 24 Aug 2023 12:57:33 +0000 (14:57 +0200)]
add a timeout for DB queries

9 months agoapply adjusted counts only to final result
Sarah Hoffmann [Thu, 24 Aug 2023 19:37:02 +0000 (21:37 +0200)]
apply adjusted counts only to final result

9 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Thu, 24 Aug 2023 12:24:16 +0000 (14:24 +0200)]
Merge remote-tracking branch 'upstream/master'

9 months agoMerge pull request #3169 from lonvia/tweak-search-with-frequent-names
Sarah Hoffmann [Thu, 24 Aug 2023 12:22:35 +0000 (14:22 +0200)]
Merge pull request #3169 from lonvia/tweak-search-with-frequent-names

Further tweak detection of queries that would return a massive amount of results

9 months agoallow terms with frequent searches together with viewbox
Sarah Hoffmann [Thu, 24 Aug 2023 07:21:09 +0000 (09:21 +0200)]
allow terms with frequent searches together with viewbox

9 months agoMerge pull request #3167 from lonvia/explicit-encoding
Sarah Hoffmann [Thu, 24 Aug 2023 06:53:11 +0000 (08:53 +0200)]
Merge pull request #3167 from lonvia/explicit-encoding

Send explicit charset in content-type when returning json

9 months agoMerge pull request #3139 from mtmail/update-search-examples
Sarah Hoffmann [Wed, 23 Aug 2023 21:41:30 +0000 (23:41 +0200)]
Merge pull request #3139 from mtmail/update-search-examples

Search.md - update XML and JSON example output

9 months agofurther tweak search containing very frequent tokens
Sarah Hoffmann [Wed, 23 Aug 2023 21:04:12 +0000 (23:04 +0200)]
further tweak search containing very frequent tokens

Excluding non-rare full names is not really possible because it makes
addresses with street names like 'main st' unsearchable. This tries to
leav all names in but refrain from ordering results by accuracy
when too many results are expected. This means that the DB will simply
get the first n results without any particular order.

9 months agosend charset again in content-type when returning json
Sarah Hoffmann [Wed, 23 Aug 2023 18:55:57 +0000 (20:55 +0200)]
send charset again in content-type when returning json

There are quite a few applications out there that will use some local
encoding when the charset is not explicitly given.

9 months agoMerge pull request #3165 from lonvia/update-osm2pgsql
Sarah Hoffmann [Wed, 23 Aug 2023 13:57:55 +0000 (15:57 +0200)]
Merge pull request #3165 from lonvia/update-osm2pgsql

Update osm2pgsql to 1.9.1

9 months agovagrant scripts: add missing yaml library
Sarah Hoffmann [Wed, 23 Aug 2023 06:34:12 +0000 (08:34 +0200)]
vagrant scripts: add missing yaml library

9 months agoadd new required json library for osm2pgsql
Sarah Hoffmann [Tue, 22 Aug 2023 18:05:25 +0000 (20:05 +0200)]
add new required json library for osm2pgsql

9 months agoupdate osm2pgsql to 1.9.1
Sarah Hoffmann [Tue, 22 Aug 2023 13:04:50 +0000 (15:04 +0200)]
update osm2pgsql to 1.9.1

9 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Sun, 20 Aug 2023 13:54:09 +0000 (15:54 +0200)]
Merge remote-tracking branch 'upstream/master'

9 months agoMerge pull request #3159 from lonvia/fix-name-lookup-for-housenames
Sarah Hoffmann [Sun, 20 Aug 2023 13:52:20 +0000 (15:52 +0200)]
Merge pull request #3159 from lonvia/fix-name-lookup-for-housenames

Fix name lookup for housenames

9 months agofix parameter use for ST_Project
Sarah Hoffmann [Sun, 20 Aug 2023 11:52:03 +0000 (13:52 +0200)]
fix parameter use for ST_Project

Before postgis 3.4 ST_Project required a geography as input and seemed
to have implicitly converted to geography. Since 3.4 geometry input
is supported but leads to a completely different result.

9 months agofix tag name for housename addresses in layer selection
Sarah Hoffmann [Sat, 19 Aug 2023 13:57:33 +0000 (15:57 +0200)]
fix tag name for housename addresses in layer selection

Fixes #3156.

9 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Wed, 16 Aug 2023 21:01:25 +0000 (23:01 +0200)]
Merge remote-tracking branch 'upstream/master'

9 months agoMerge pull request #3155 from lonvia/caching-of-transliterators
Sarah Hoffmann [Wed, 16 Aug 2023 20:55:54 +0000 (22:55 +0200)]
Merge pull request #3155 from lonvia/caching-of-transliterators

Cache ICU transliterators between calls

9 months agocache ICU transliterators and reuse them
Sarah Hoffmann [Tue, 15 Aug 2023 21:08:44 +0000 (23:08 +0200)]
cache ICU transliterators and reuse them

9 months agoMerge pull request #3150 from alfmarcua/allow_neg_id_details
Sarah Hoffmann [Mon, 14 Aug 2023 09:41:42 +0000 (11:41 +0200)]
Merge pull request #3150 from alfmarcua/allow_neg_id_details

Allow negative osm_id in details page by setting default parameter to 0

9 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Sun, 13 Aug 2023 16:35:25 +0000 (18:35 +0200)]
Merge remote-tracking branch 'upstream/master'

9 months agofix regression in default setting for details linkedplaces
Sarah Hoffmann [Sun, 13 Aug 2023 13:30:04 +0000 (15:30 +0200)]
fix regression in default setting for details linkedplaces

9 months agoprefer name-only searches more
Sarah Hoffmann [Sun, 13 Aug 2023 13:24:16 +0000 (15:24 +0200)]
prefer name-only searches more

9 months agoreturn bbox of full country for country searches
Sarah Hoffmann [Sun, 13 Aug 2023 12:37:28 +0000 (14:37 +0200)]
return bbox of full country for country searches

Fixes #3149.

9 months agofix application of label to wrong expression
Sarah Hoffmann [Sun, 13 Aug 2023 09:59:01 +0000 (11:59 +0200)]
fix application of label to wrong expression

9 months agoavoid lambda SQL in connection with alias tables
Sarah Hoffmann [Sun, 13 Aug 2023 09:40:49 +0000 (11:40 +0200)]
avoid lambda SQL in connection with alias tables

9 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Sat, 12 Aug 2023 19:13:36 +0000 (21:13 +0200)]
Merge remote-tracking branch 'upstream/master'

9 months agouse coalsce() instead of indexless postgis functions
Sarah Hoffmann [Sat, 12 Aug 2023 17:14:13 +0000 (19:14 +0200)]
use coalsce() instead of indexless postgis functions

ST_Intersects is deemed too expensive by the query planer which
leads to odd plans when index use is avoided.

9 months agoMerge remote-tracking branch 'upstream/master'
Sarah Hoffmann [Sat, 12 Aug 2023 15:06:38 +0000 (17:06 +0200)]
Merge remote-tracking branch 'upstream/master'