]> git.openstreetmap.org Git - nominatim.git/log
nominatim.git
4 years agoMerge pull request #1678 from lonvia/early-drop
Sarah Hoffmann [Thu, 13 Feb 2020 21:50:41 +0000 (22:50 +0100)]
Merge pull request #1678 from lonvia/early-drop

Clean up intermediate tables earlier with --drop

4 years agofix duplicate keys in tests
Sarah Hoffmann [Wed, 12 Feb 2020 10:29:33 +0000 (11:29 +0100)]
fix duplicate keys in tests

The tests suddenly failed because the unique key constraint
is more strict and does no longer include the type.

4 years agoclean up intermediate tables earlier with --drop
Sarah Hoffmann [Wed, 12 Feb 2020 10:03:20 +0000 (11:03 +0100)]
clean up intermediate tables earlier with --drop

When --drop is given, we can remove all node geometry information
already after the import with osm2pgsql. Also drop all unnecessary
tables before creating the final indices.

4 years agoMerge pull request #1675 from lonvia/refresh-connection-while-indexing
Sarah Hoffmann [Wed, 12 Feb 2020 07:18:09 +0000 (08:18 +0100)]
Merge pull request #1675 from lonvia/refresh-connection-while-indexing

Fix a couple of issues with the new Python nominatim script

4 years agoMerge pull request #1674 from mtmail/testdb-how-to-select-tiger-data
Sarah Hoffmann [Tue, 11 Feb 2020 21:57:39 +0000 (22:57 +0100)]
Merge pull request #1674 from mtmail/testdb-how-to-select-tiger-data

document how to extract subset of TIGER data needed for API tests

4 years agoMerge pull request #1673 from mtmail/wikidata-wget-incomplete
Sarah Hoffmann [Tue, 11 Feb 2020 21:56:45 +0000 (22:56 +0100)]
Merge pull request #1673 from mtmail/wikidata-wget-incomplete

wikipedia: wget didnt download, skip index generation

4 years agopsycopg 2.6 is now usable on ubuntu 16
Sarah Hoffmann [Tue, 11 Feb 2020 21:49:03 +0000 (22:49 +0100)]
psycopg 2.6 is now usable on ubuntu 16

4 years agonominatim.py: use async in connect() function
Sarah Hoffmann [Tue, 11 Feb 2020 21:08:04 +0000 (22:08 +0100)]
nominatim.py: use async in connect() function

The _async parameter name is only supported since psycopg 2.7.
However, async is a keyword in Python >= 3.7, so using this
gives us a syntax error. Working around this by defining the
parameters in a dict and handing that into the connect function.

4 years agonominatim.py: also catch deadlocks on final wait
Sarah Hoffmann [Tue, 11 Feb 2020 21:00:24 +0000 (22:00 +0100)]
nominatim.py: also catch deadlocks on final wait

4 years agoregularly close connection while indexing
Sarah Hoffmann [Sun, 9 Feb 2020 12:57:36 +0000 (13:57 +0100)]
regularly close connection while indexing

Postgres sooner or later runs out of memory when the connection
is used for too long.

4 years agodocument how to extract subset of TIGER data needed for API tests
marc tobias [Tue, 11 Feb 2020 17:50:27 +0000 (18:50 +0100)]
document how to extract subset of TIGER data needed for API tests

4 years agowikipedia: wget didnt download, skip index generation
marc tobias [Mon, 10 Feb 2020 16:20:11 +0000 (17:20 +0100)]
wikipedia: wget didnt download, skip index generation

4 years agoMerge pull request #1670 from lonvia/permalinks-for-tiger-and-interpolation
Sarah Hoffmann [Sun, 9 Feb 2020 20:07:19 +0000 (21:07 +0100)]
Merge pull request #1670 from lonvia/permalinks-for-tiger-and-interpolation

Enable Permalinks to dtails for tiger and interpolation

4 years agofix formatting
Sarah Hoffmann [Sun, 9 Feb 2020 15:57:55 +0000 (16:57 +0100)]
fix formatting

4 years agodetails: also look for interpolations when way id is given
Sarah Hoffmann [Sun, 9 Feb 2020 15:50:04 +0000 (16:50 +0100)]
details: also look for interpolations when way id is given

4 years agouse detailsPermaLink function on main website as well
Sarah Hoffmann [Sun, 9 Feb 2020 15:05:22 +0000 (16:05 +0100)]
use detailsPermaLink function on main website as well

4 years agoreturn place_id link to details when not an OSM object
Sarah Hoffmann [Sun, 9 Feb 2020 14:45:38 +0000 (15:45 +0100)]
return place_id link to details when not an OSM object

Stop-gap solution to find the right object for Tiger and
interpolation objects.

4 years agoMerge pull request #1667 from mtmail/setup-delete-invalid-indices
Sarah Hoffmann [Sun, 9 Feb 2020 13:21:17 +0000 (14:21 +0100)]
Merge pull request #1667 from mtmail/setup-delete-invalid-indices

setup: delete invalid indices in create-search-indices step

4 years agoRemove hack that changes the class/type of cities
Sarah Hoffmann [Sun, 9 Feb 2020 11:14:32 +0000 (12:14 +0100)]
Remove hack that changes the class/type of cities

This interferes badly with the details view.

Fixes #1668.

4 years agosetup: delete invalid indices in create-search-indices step
marc tobias [Sat, 8 Feb 2020 14:16:20 +0000 (15:16 +0100)]
setup: delete invalid indices in create-search-indices step

4 years agoMerge pull request #1665 from mtmail/centos7-php7
Sarah Hoffmann [Fri, 7 Feb 2020 19:43:49 +0000 (20:43 +0100)]
Merge pull request #1665 from mtmail/centos7-php7

CentOS7: update from PHP 5.4 to 7.2, add psycopg2

4 years agoMerge pull request #1666 from mtmail/ubuntu-installs-add-psycopg2
Sarah Hoffmann [Fri, 7 Feb 2020 19:42:38 +0000 (20:42 +0100)]
Merge pull request #1666 from mtmail/ubuntu-installs-add-psycopg2

Vagrant Ubuntu: psycopg2 is required

4 years agoVagrant Ubuntu: psycopg2 is required
marc tobias [Fri, 7 Feb 2020 14:26:09 +0000 (15:26 +0100)]
Vagrant Ubuntu: psycopg2 is required

4 years agoCentOS7: update from PHP 5.4 to 7.2
marc tobias [Fri, 7 Feb 2020 14:18:46 +0000 (15:18 +0100)]
CentOS7: update from PHP 5.4 to 7.2

4 years agoMerge pull request #1663 from mtmail/vagrant-centos-8
Sarah Hoffmann [Thu, 6 Feb 2020 20:12:28 +0000 (21:12 +0100)]
Merge pull request #1663 from mtmail/vagrant-centos-8

Vagrant setup for CentOS 8

4 years agoMerge pull request #1664 from mtmail/check-import-finished-for-reverse-only
Sarah Hoffmann [Thu, 6 Feb 2020 20:07:04 +0000 (21:07 +0100)]
Merge pull request #1664 from mtmail/check-import-finished-for-reverse-only

check_import_finished.php - reverse_only mode has less indices

4 years agocheck_import_finished.php - reverse_only mode has less indices
marc tobias [Thu, 6 Feb 2020 15:46:54 +0000 (16:46 +0100)]
check_import_finished.php - reverse_only mode has less indices

4 years agoVagrant setup for CentOS 8
marc tobias [Mon, 3 Feb 2020 12:13:46 +0000 (13:13 +0100)]
Vagrant setup for CentOS 8

4 years agodetails html page: no longer use place_id in URLs
marc tobias [Sun, 2 Feb 2020 00:16:31 +0000 (01:16 +0100)]
details html page: no longer use place_id in URLs

4 years agofix verboseness of nominiatim script during updates
Sarah Hoffmann [Fri, 31 Jan 2020 17:17:42 +0000 (18:17 +0100)]
fix verboseness of nominiatim script during updates

4 years agoMerge pull request #1648 from lonvia/nominatim-as-python-script
Sarah Hoffmann [Fri, 31 Jan 2020 16:53:49 +0000 (17:53 +0100)]
Merge pull request #1648 from lonvia/nominatim-as-python-script

Replace C Nominatim indexer with Python script

4 years agoremove libxml dependency for travis as well
Sarah Hoffmann [Wed, 29 Jan 2020 10:54:20 +0000 (11:54 +0100)]
remove libxml dependency for travis as well

4 years agofix typo
Sarah Hoffmann [Wed, 29 Jan 2020 10:50:30 +0000 (11:50 +0100)]
fix typo

4 years agoalso adapt indexing command in update script
Sarah Hoffmann [Wed, 29 Jan 2020 10:36:12 +0000 (11:36 +0100)]
also adapt indexing command in update script

4 years agoupdate cMake build documentation
Sarah Hoffmann [Fri, 24 Jan 2020 21:53:26 +0000 (22:53 +0100)]
update cMake build documentation

Remove the dependency on libxml, no longer needed.

4 years agoforgot to index last rank
Sarah Hoffmann [Wed, 22 Jan 2020 10:18:21 +0000 (11:18 +0100)]
forgot to index last rank

4 years agoreplace nominatim C program
Sarah Hoffmann [Tue, 21 Jan 2020 20:57:07 +0000 (21:57 +0100)]
replace nominatim C program

4 years agofix log levels
Sarah Hoffmann [Mon, 20 Jan 2020 22:34:56 +0000 (23:34 +0100)]
fix log levels

4 years agoadd time display for nominatim.py
Sarah Hoffmann [Mon, 20 Jan 2020 22:17:52 +0000 (23:17 +0100)]
add time display for nominatim.py

4 years agoclean up and document script
Sarah Hoffmann [Mon, 20 Jan 2020 21:19:33 +0000 (22:19 +0100)]
clean up and document script

4 years agofix SQL and some other stuff
Sarah Hoffmann [Sun, 19 Jan 2020 23:05:28 +0000 (00:05 +0100)]
fix SQL and some other stuff

4 years agoRevert "switch to threading"
Sarah Hoffmann [Sun, 19 Jan 2020 20:56:37 +0000 (21:56 +0100)]
Revert "switch to threading"

This reverts commit 8b1c2181be5aa5335c68d36a49cab9c4e2cd8bef.

4 years agoswitch to threading
Sarah Hoffmann [Sun, 19 Jan 2020 20:56:20 +0000 (21:56 +0100)]
switch to threading

4 years agouse generator for thread choice
Sarah Hoffmann [Sun, 19 Jan 2020 13:51:15 +0000 (14:51 +0100)]
use generator for thread choice

4 years agoadd prepared statement
Sarah Hoffmann [Sun, 19 Jan 2020 13:06:48 +0000 (14:06 +0100)]
add prepared statement

4 years agosimple implementation
Sarah Hoffmann [Sun, 19 Jan 2020 12:37:45 +0000 (13:37 +0100)]
simple implementation

4 years agoMerge pull request #1647 from lonvia/split-out-linking
Sarah Hoffmann [Fri, 24 Jan 2020 20:55:19 +0000 (21:55 +0100)]
Merge pull request #1647 from lonvia/split-out-linking

Split up placex update trigger code

4 years agofix indent
Sarah Hoffmann [Fri, 24 Jan 2020 20:16:26 +0000 (21:16 +0100)]
fix indent

4 years agorename functions where return parameter changed
Sarah Hoffmann [Thu, 23 Jan 2020 21:24:41 +0000 (22:24 +0100)]
rename functions where return parameter changed

Postgresql cannot cleanly reimport these functions when
upgrading, so simply rename to avoid errors.

4 years agoforgot new trigger sql
Sarah Hoffmann [Sat, 18 Jan 2020 22:49:38 +0000 (23:49 +0100)]
forgot new trigger sql

4 years agoadapt index for changes name lookup
Sarah Hoffmann [Fri, 17 Jan 2020 16:47:10 +0000 (17:47 +0100)]
adapt index for changes name lookup

4 years agomove trigger creation later in setup
Sarah Hoffmann [Thu, 16 Jan 2020 21:53:52 +0000 (22:53 +0100)]
move trigger creation later in setup

4 years agoclean up get_word_id function
Sarah Hoffmann [Thu, 16 Jan 2020 21:08:37 +0000 (22:08 +0100)]
clean up get_word_id function

Replaced by addr_ids_from_name() which also normalises the
string.

4 years agogetNearestNamed*Feature functions better return values
Sarah Hoffmann [Thu, 16 Jan 2020 20:43:26 +0000 (21:43 +0100)]
getNearestNamed*Feature functions better return values

4 years agofactor out parent search from addr:street/addr:place
Sarah Hoffmann [Thu, 16 Jan 2020 20:17:19 +0000 (21:17 +0100)]
factor out parent search from addr:street/addr:place

4 years agofactor out searching for parent road for pois
Sarah Hoffmann [Thu, 16 Jan 2020 19:26:17 +0000 (20:26 +0100)]
factor out searching for parent road for pois

4 years agoremove unused function
Sarah Hoffmann [Thu, 16 Jan 2020 16:31:31 +0000 (17:31 +0100)]
remove unused function

4 years agofactor out computation of default names
Sarah Hoffmann [Wed, 15 Jan 2020 23:11:32 +0000 (00:11 +0100)]
factor out computation of default names

Also moves the computation down the line so that we never
have to do it twice.

4 years agofactor out place linking sql
Sarah Hoffmann [Wed, 15 Jan 2020 21:01:33 +0000 (22:01 +0100)]
factor out place linking sql

4 years agoadapt test to change in hamlet classification
Sarah Hoffmann [Thu, 23 Jan 2020 21:26:47 +0000 (22:26 +0100)]
adapt test to change in hamlet classification

4 years agodoc: clarify the influence of autovacuum on memory
Sarah Hoffmann [Wed, 22 Jan 2020 11:02:38 +0000 (12:02 +0100)]
doc: clarify the influence of autovacuum on memory

4 years agodocs: add a note that the faltnode file is needed for updates
Sarah Hoffmann [Wed, 22 Jan 2020 10:44:05 +0000 (11:44 +0100)]
docs: add a note that the faltnode file is needed for updates

Fixes #1644.

4 years agoMerge pull request #1638 from mtmail/check-for-invalid-indices
Sarah Hoffmann [Tue, 14 Jan 2020 20:34:35 +0000 (21:34 +0100)]
Merge pull request #1638 from mtmail/check-for-invalid-indices

check_import_finished: check for invalid indices

4 years agohint that invalid indices must be manually deleted
Sarah Hoffmann [Tue, 14 Jan 2020 20:33:09 +0000 (21:33 +0100)]
hint that invalid indices must be manually deleted

4 years agoMerge pull request #1637 from mtmail/fix-warnings-in-verbose-warm
Sarah Hoffmann [Tue, 14 Jan 2020 20:30:46 +0000 (21:30 +0100)]
Merge pull request #1637 from mtmail/fix-warnings-in-verbose-warm

warm.php verbose mode was printing errors

4 years agoMerge pull request #1636 from lonvia/update-introduction
Sarah Hoffmann [Tue, 14 Jan 2020 20:29:25 +0000 (21:29 +0100)]
Merge pull request #1636 from lonvia/update-introduction

Update help text on website

4 years agocheck_import_finished: check for invalid indices
marc tobias [Tue, 14 Jan 2020 18:36:40 +0000 (19:36 +0100)]
check_import_finished: check for invalid indices

4 years agowarm.php verbose mode was printing errors
marc tobias [Tue, 14 Jan 2020 17:24:49 +0000 (18:24 +0100)]
warm.php verbose mode was printing errors

4 years agoupdate report a problem page
Sarah Hoffmann [Mon, 13 Jan 2020 21:42:49 +0000 (22:42 +0100)]
update report a problem page

4 years agoupdate help links
Sarah Hoffmann [Mon, 13 Jan 2020 21:20:53 +0000 (22:20 +0100)]
update help links

All links should go to nominatim.org now. Also add links
to Help OSM and the Github repository.

4 years agoremove special handling of rail
Sarah Hoffmann [Wed, 8 Jan 2020 22:53:23 +0000 (23:53 +0100)]
remove special handling of rail

Skip railway=rail in the style, so that installations can remove
it if they wish.

4 years agoupdate place address levels
Sarah Hoffmann [Wed, 8 Jan 2020 21:44:56 +0000 (22:44 +0100)]
update place address levels

Adds province and allotments and downgrades hamlet.

4 years agoMerge pull request #1628 from lonvia/split-sql-functions
Sarah Hoffmann [Wed, 8 Jan 2020 20:36:40 +0000 (21:36 +0100)]
Merge pull request #1628 from lonvia/split-sql-functions

Split monstrous functions.sql

4 years agoremove remaining sql functions into function/ directory
Sarah Hoffmann [Wed, 8 Jan 2020 10:45:51 +0000 (11:45 +0100)]
remove remaining sql functions into function/ directory

4 years agomove postcode table triggers to own file
Sarah Hoffmann [Wed, 8 Jan 2020 10:22:23 +0000 (11:22 +0100)]
move postcode table triggers to own file

4 years agomove placex triggers into own file
Sarah Hoffmann [Wed, 8 Jan 2020 10:18:42 +0000 (11:18 +0100)]
move placex triggers into own file

4 years agomove place triggers into own file
Sarah Hoffmann [Tue, 7 Jan 2020 22:54:42 +0000 (23:54 +0100)]
move place triggers into own file

4 years agomove functions for interpolation table in own file
Sarah Hoffmann [Sun, 5 Jan 2020 15:32:12 +0000 (16:32 +0100)]
move functions for interpolation table in own file

4 years agomove functions for address lookup into own file
Sarah Hoffmann [Sun, 5 Jan 2020 15:16:21 +0000 (16:16 +0100)]
move functions for address lookup into own file

4 years agomove creation function for aux data into own file
Sarah Hoffmann [Sun, 5 Jan 2020 15:04:04 +0000 (16:04 +0100)]
move creation function for aux data into own file

This function is currently unused, so don't even load it.

4 years agomove importance/wikipedia functions into separate file
Sarah Hoffmann [Sun, 5 Jan 2020 14:55:39 +0000 (15:55 +0100)]
move importance/wikipedia functions into separate file

4 years agomove SQL functions for normalisation in separate file
Sarah Hoffmann [Sun, 5 Jan 2020 14:38:20 +0000 (15:38 +0100)]
move SQL functions for normalisation in separate file

4 years agoMerge pull request #1627 from lonvia/cleanup-setup-scripts
Sarah Hoffmann [Sun, 5 Jan 2020 13:17:39 +0000 (14:17 +0100)]
Merge pull request #1627 from lonvia/cleanup-setup-scripts

Minor cleanup of setup scripts

4 years agosetup: factor out parameter replacement in SQL scripts
Sarah Hoffmann [Sat, 4 Jan 2020 22:41:55 +0000 (23:41 +0100)]
setup: factor out parameter replacement in SQL scripts

Put all into a single function and use for all SQL
templates.

4 years agofix osm link in polygon error view
Sarah Hoffmann [Sat, 4 Jan 2020 20:50:22 +0000 (21:50 +0100)]
fix osm link in polygon error view

4 years agoMerge pull request #1626 from lonvia/move-tests-to-osm2pgsql
Sarah Hoffmann [Sat, 4 Jan 2020 19:08:35 +0000 (20:08 +0100)]
Merge pull request #1626 from lonvia/move-tests-to-osm2pgsql

Move tests to osm2pgsql

4 years agoremove osm2pgsql tag tests
Sarah Hoffmann [Sat, 4 Jan 2020 15:23:29 +0000 (16:23 +0100)]
remove osm2pgsql tag tests

These tests are now part of the osm2pgsql test suite.

4 years agoupdate osm2pgsql (gazetteer output tests)
Sarah Hoffmann [Sat, 4 Jan 2020 15:20:52 +0000 (16:20 +0100)]
update osm2pgsql (gazetteer output tests)

4 years agoMerge pull request #1624 from lonvia/add-extratags-style
Sarah Hoffmann [Fri, 3 Jan 2020 09:06:47 +0000 (10:06 +0100)]
Merge pull request #1624 from lonvia/add-extratags-style

Add new extratags style

4 years agoadd new extratags style
Sarah Hoffmann [Sun, 29 Dec 2019 10:47:10 +0000 (11:47 +0100)]
add new extratags style

This is the same as the full style but also adds all unused tags
except for a couple of internal tags to the extratags column.

4 years agoMerge pull request #1622 from mtmail/clang-faq-entry
Sarah Hoffmann [Thu, 2 Jan 2020 13:14:00 +0000 (14:14 +0100)]
Merge pull request #1622 from mtmail/clang-faq-entry

Documentation: add FAQ entry about clang not found

4 years agoupdate osm2pgsql (exclude country and postcode from address tags)
Sarah Hoffmann [Mon, 23 Dec 2019 14:17:04 +0000 (15:17 +0100)]
update osm2pgsql (exclude country and postcode from address tags)

4 years agoDocumentation: add FAQ entry about clang not found
marc tobias [Sat, 28 Dec 2019 20:21:39 +0000 (21:21 +0100)]
Documentation: add FAQ entry about clang not found

4 years agoMerge pull request #1612 from mtmail/cleanup-wiki-scripts
Sarah Hoffmann [Mon, 23 Dec 2019 21:05:39 +0000 (22:05 +0100)]
Merge pull request #1612 from mtmail/cleanup-wiki-scripts

refactor import_wiki* script for readability

4 years agoMerge pull request #1619 from mtmail/document-check-import-script
Sarah Hoffmann [Mon, 23 Dec 2019 21:04:25 +0000 (22:04 +0100)]
Merge pull request #1619 from mtmail/document-check-import-script

Use check_import_finished in test suite, document

4 years agorefactor import_wiki* script for readability
marc tobias [Wed, 18 Dec 2019 18:18:39 +0000 (19:18 +0100)]
refactor import_wiki* script for readability

4 years agoUse check_import_finished in test suite, document
marc tobias [Mon, 23 Dec 2019 20:25:06 +0000 (21:25 +0100)]
Use check_import_finished in test suite, document

4 years agonew script utils/check_import_finished.php
marc tobias [Mon, 2 Dec 2019 13:02:05 +0000 (14:02 +0100)]
new script utils/check_import_finished.php

4 years agoMerge pull request #1596 from mtmail/remove-obsolete-wikidata-scripts
Sarah Hoffmann [Wed, 18 Dec 2019 20:55:17 +0000 (21:55 +0100)]
Merge pull request #1596 from mtmail/remove-obsolete-wikidata-scripts

remove old wikidata script. See data-sources/wikipedia-wikidata/ for new process

4 years agoMerge pull request #1601 from mtmail/spheric-distance-on-details-page
Sarah Hoffmann [Wed, 18 Dec 2019 20:54:06 +0000 (21:54 +0100)]
Merge pull request #1601 from mtmail/spheric-distance-on-details-page

details page: differentiate between spheric distance and distance in meters