From: Sarah Hoffmann Date: Tue, 14 Dec 2021 14:52:34 +0000 (+0100) Subject: Merge pull request #2553 from lonvia/revert-street-matching-to-full-names X-Git-Tag: v4.1.0~104 X-Git-Url: https://git.openstreetmap.org/nominatim.git/commitdiff_plain/ab6f35d83a350ead4eb12b59c4cbc050e48f93ee?hp=f9b56a8581be3663239d23ee1194891dde9a3857 Merge pull request #2553 from lonvia/revert-street-matching-to-full-names Revert street matching to full names --- diff --git a/codecov.yml b/codecov.yml deleted file mode 100644 index 0404bdb5..00000000 --- a/codecov.yml +++ /dev/null @@ -1,14 +0,0 @@ -codecov: - require_ci_to_pass: yes - -coverage: - status: - project: off - patch: off - -comment: - require_changes: true - after_n_builds: 2 - -fixes: - - "Nominatim/::" \ No newline at end of file diff --git a/docs/CMakeLists.txt b/docs/CMakeLists.txt index 191c221c..3b9a316b 100644 --- a/docs/CMakeLists.txt +++ b/docs/CMakeLists.txt @@ -23,7 +23,6 @@ foreach (src ${DOC_SOURCES}) endforeach() ADD_CUSTOM_TARGET(doc - COMMAND ${CMAKE_CURRENT_SOURCE_DIR}/bash2md.sh ${PROJECT_SOURCE_DIR}/vagrant/Install-on-Centos-7.sh ${CMAKE_CURRENT_BINARY_DIR}/appendix/Install-on-Centos-7.md COMMAND ${CMAKE_CURRENT_SOURCE_DIR}/bash2md.sh ${PROJECT_SOURCE_DIR}/vagrant/Install-on-Centos-8.sh ${CMAKE_CURRENT_BINARY_DIR}/appendix/Install-on-Centos-8.md COMMAND ${CMAKE_CURRENT_SOURCE_DIR}/bash2md.sh ${PROJECT_SOURCE_DIR}/vagrant/Install-on-Ubuntu-18.sh ${CMAKE_CURRENT_BINARY_DIR}/appendix/Install-on-Ubuntu-18.md COMMAND ${CMAKE_CURRENT_SOURCE_DIR}/bash2md.sh ${PROJECT_SOURCE_DIR}/vagrant/Install-on-Ubuntu-20.sh ${CMAKE_CURRENT_BINARY_DIR}/appendix/Install-on-Ubuntu-20.md diff --git a/docs/admin/Faq.md b/docs/admin/Faq.md index 6d901e86..d933a84d 100644 --- a/docs/admin/Faq.md +++ b/docs/admin/Faq.md @@ -106,11 +106,6 @@ If you are using a flatnode file, then it may also be that the underlying filesystem does not fully support 'mmap'. A notable candidate is virtualbox's vboxfs. -### I see the error: "clang: Command not found" on CentOS - -On CentOS 7 users reported `/opt/rh/llvm-toolset-7/root/usr/bin/clang: Command not found`. -Double-check clang is installed. Instead of `make` try running `make CLANG=true`. - ### nominatim UPDATE failed: ERROR: buffer 179261 is not owned by resource owner Portal Several users [reported this](https://github.com/openstreetmap/Nominatim/issues/1168) @@ -126,22 +121,6 @@ The server cannot access your database. Add `&debug=1` to your URL to get the full error message. -### On CentOS the website shows "Could not connect to server" - -`could not connect to server: No such file or directory` - -On CentOS v7 the PostgreSQL server is started with `systemd`. Check if -`/usr/lib/systemd/system/httpd.service` contains a line `PrivateTmp=true`. If -so then Apache cannot see the `/tmp/.s.PGSQL.5432` file. It's a good security -feature, so use the -[preferred solution](../appendix/Install-on-Centos-7.md#adding-selinux-security-settings). - -However, you can solve this the quick and dirty way by commenting out that line and then run - - sudo systemctl daemon-reload - sudo systemctl restart httpd - - ### Website reports "DB Error: insufficient permissions" The user the webserver, e.g. Apache, runs under needs to have access to the @@ -182,7 +161,7 @@ by everybody, e.g. Try `chmod a+r nominatim.so; chmod a+x nominatim.so`. When running SELinux, make sure that the -[context is set up correctly](../appendix/Install-on-Centos-7.md#adding-selinux-security-settings). +[context is set up correctly](../appendix/Install-on-Centos-8.md#adding-selinux-security-settings). When you recently updated your operating system, updated PostgreSQL to a new version or moved files (e.g. the build directory) you should diff --git a/docs/admin/Installation.md b/docs/admin/Installation.md index 2ae594ba..6b63b0d3 100644 --- a/docs/admin/Installation.md +++ b/docs/admin/Installation.md @@ -7,7 +7,6 @@ the following operating systems: * [Ubuntu 20.04](../appendix/Install-on-Ubuntu-20.md) * [Ubuntu 18.04](../appendix/Install-on-Ubuntu-18.md) * [CentOS 8](../appendix/Install-on-Centos-8.md) - * [CentOS 7.2](../appendix/Install-on-Centos-7.md) These OS-specific instructions can also be found in executable form in the `vagrant/` directory. diff --git a/docs/develop/Development-Environment.md b/docs/develop/Development-Environment.md index 2840095b..eba87c09 100644 --- a/docs/develop/Development-Environment.md +++ b/docs/develop/Development-Environment.md @@ -30,7 +30,7 @@ unit tests (using PHPUnit for PHP code and pytest for Python code). It has the following additional requirements: * [behave test framework](https://behave.readthedocs.io) >= 1.2.6 -* [phpunit](https://phpunit.de) >= 7.3 +* [phpunit](https://phpunit.de) (9.5 is known to work) * [PHP CodeSniffer](https://github.com/squizlabs/PHP_CodeSniffer) * [Pylint](https://pylint.org/) (2.6.0 is used for the CI) * [pytest](https://pytest.org) diff --git a/docs/mkdocs.yml b/docs/mkdocs.yml index 3fae95b7..c25ae0ad 100644 --- a/docs/mkdocs.yml +++ b/docs/mkdocs.yml @@ -42,7 +42,6 @@ pages: - 'Testing' : 'develop/Testing.md' - 'External Data Sources': 'develop/data-sources.md' - 'Appendix': - - 'Installation on CentOS 7' : 'appendix/Install-on-Centos-7.md' - 'Installation on CentOS 8' : 'appendix/Install-on-Centos-8.md' - 'Installation on Ubuntu 18' : 'appendix/Install-on-Ubuntu-18.md' - 'Installation on Ubuntu 20' : 'appendix/Install-on-Ubuntu-20.md' diff --git a/test/bdd/steps/cgi-with-coverage.php b/test/bdd/steps/cgi-with-coverage.php index 6f0d79bb..15e05007 100644 --- a/test/bdd/steps/cgi-with-coverage.php +++ b/test/bdd/steps/cgi-with-coverage.php @@ -10,9 +10,21 @@ function coverage_shutdown($oCoverage) } $covfilter = new SebastianBergmann\CodeCoverage\Filter(); -$covfilter->addDirectoryToWhitelist($_SERVER['COV_PHP_DIR'].'/lib-php'); -$covfilter->addDirectoryToWhitelist($_SERVER['COV_PHP_DIR'].'/website'); -$coverage = new SebastianBergmann\CodeCoverage\CodeCoverage(null, $covfilter); +if (method_exists($covfilter, 'addDirectoryToWhitelist')) { + // pre PHPUnit 9 + $covfilter->addDirectoryToWhitelist($_SERVER['COV_PHP_DIR'].'/lib-php'); + $covfilter->addDirectoryToWhitelist($_SERVER['COV_PHP_DIR'].'/website'); + $coverage = new SebastianBergmann\CodeCoverage\CodeCoverage(null, $covfilter); +} else { + // since PHP Uit 9 + $covfilter->includeDirectory($_SERVER['COV_PHP_DIR'].'/lib-php'); + $covfilter->includeDirectory($_SERVER['COV_PHP_DIR'].'/website'); + $coverage = new SebastianBergmann\CodeCoverage\CodeCoverage( + (new SebastianBergmann\CodeCoverage\Driver\Selector)->forLineCoverage($covfilter), + $covfilter + ); +} + $coverage->start($_SERVER['COV_TEST_NAME']); register_shutdown_function('coverage_shutdown', $coverage); diff --git a/test/bdd/steps/steps_api_queries.py b/test/bdd/steps/steps_api_queries.py index fc0a2156..99469587 100644 --- a/test/bdd/steps/steps_api_queries.py +++ b/test/bdd/steps/steps_api_queries.py @@ -82,6 +82,7 @@ def send_api_query(endpoint, params, fmt, context): cmd = ['/usr/bin/env', 'php-cgi', '-f'] if context.nominatim.code_coverage_path: + env['XDEBUG_MODE'] = 'coverage' env['COV_SCRIPT_FILENAME'] = env['SCRIPT_FILENAME'] env['COV_PHP_DIR'] = context.nominatim.src_dir env['COV_TEST_NAME'] = '%s:%s' % (context.scenario.filename, context.scenario.line) diff --git a/test/php/Nominatim/DBTest.php b/test/php/Nominatim/DBTest.php index 1a2ecc86..b1ff957b 100644 --- a/test/php/Nominatim/DBTest.php +++ b/test/php/Nominatim/DBTest.php @@ -132,12 +132,6 @@ class DBTest extends \PHPUnit\Framework\TestCase getenv('UNIT_TEST_DSN') : 'pgsql:dbname=nominatim_unit_tests'; - $this->assertRegExp( - '/unit_test/', - $unit_test_dsn, - 'Test database will get destroyed, thus should have a name like unit_test to be safe' - ); - ## Create the database. { $aDSNParsed = \Nominatim\DB::parseDSN($unit_test_dsn); diff --git a/test/php/Nominatim/DatabaseErrorTest.php b/test/php/Nominatim/DatabaseErrorTest.php index da156493..6e70ac25 100644 --- a/test/php/Nominatim/DatabaseErrorTest.php +++ b/test/php/Nominatim/DatabaseErrorTest.php @@ -26,6 +26,6 @@ class DatabaseErrorTest extends \PHPUnit\Framework\TestCase public function testSqlObjectDump() { $oErr = new DatabaseError('Sql error', 123, null, array('one' => 'two')); - $this->assertRegExp('/two/', $oErr->getSqlDebugDump()); + $this->assertStringContainsString('two', $oErr->getSqlDebugDump()); } } diff --git a/test/php/Nominatim/TokenListTest.php b/test/php/Nominatim/TokenListTest.php index f0139d76..fdee3723 100644 --- a/test/php/Nominatim/TokenListTest.php +++ b/test/php/Nominatim/TokenListTest.php @@ -5,7 +5,7 @@ namespace Nominatim; require_once(CONST_LibDir.'/TokenList.php'); -class TokenTest extends \PHPUnit\Framework\TestCase +class TokenListTest extends \PHPUnit\Framework\TestCase { protected function setUp(): void { diff --git a/vagrant/Install-on-Centos-7.sh b/vagrant/Install-on-Centos-7.sh deleted file mode 100755 index d3fd9ef0..00000000 --- a/vagrant/Install-on-Centos-7.sh +++ /dev/null @@ -1,204 +0,0 @@ -#!/bin/bash -# -# *Note:* these installation instructions are also available in executable -# form for use with vagrant under `vagrant/Install-on-Centos-7.sh`. -# -# Installing the Required Software -# ================================ -# -# These instructions expect that you have a freshly installed CentOS version 7. -# Make sure all packages are up-to-date by running: -# - sudo yum update -y - -# The standard CentOS repositories don't contain all the required packages, -# you need to enable the EPEL repository as well. To enable it on CentOS, -# install the epel-release RPM by running: - - sudo yum install -y epel-release - -# More repositories for postgresql 11 (CentOS default 'postgresql' is 9.2), postgis -# and llvm-toolset (https://github.com/theory/pg-semver/issues/35) - - sudo yum install -y https://download.postgresql.org/pub/repos/yum/11/redhat/rhel-7-x86_64/pgdg-redhat-repo-latest.noarch.rpm - sudo yum install -y centos-release-scl-rh - -# More repositories for PHP 7 (default is PHP 5.4) - - sudo yum install -y http://rpms.remirepo.net/enterprise/remi-release-7.rpm - sudo yum-config-manager --enable remi-php72 - sudo yum update -y - -# Now you can install all packages needed for Nominatim: - -#DOCS: :::sh - - sudo yum install -y postgresql11-server postgresql11-contrib postgresql11-devel \ - postgis25_11 postgis25_11-utils \ - wget git cmake make gcc gcc-c++ libtool policycoreutils-python \ - devtoolset-7 llvm-toolset-7 \ - php-pgsql php php-intl libpqxx-devel \ - proj-epsg bzip2-devel proj-devel boost-devel \ - python3-pip python3-setuptools python3-devel \ - expat-devel zlib-devel libicu-dev - - pip3 install --user psycopg2 python-dotenv psutil Jinja2 PyICU datrie pyyaml - - -# -# System Configuration -# ==================== -# -# The following steps are meant to configure a fresh CentOS installation -# for use with Nominatim. You may skip some of the steps if you have your -# OS already configured. -# -# Creating Dedicated User Accounts -# -------------------------------- -# -# Nominatim will run as a global service on your machine. It is therefore -# best to install it under its own separate user account. In the following -# we assume this user is called nominatim and the installation will be in -# /srv/nominatim. To create the user and directory run: -# -sudo mkdir -p /srv/nominatim #DOCS: sudo useradd -d /srv/nominatim -s /bin/bash -m nominatim -sudo chown vagrant /srv/nominatim #DOCS: -# -# You may find a more suitable location if you wish. -# -# To be able to copy and paste instructions from this manual, export -# user name and home directory now like this: -# - export USERNAME=vagrant #DOCS: export USERNAME=nominatim - export USERHOME=/srv/nominatim -# -# **Never, ever run the installation as a root user.** You have been warned. -# -# Make sure that system servers can read from the home directory: - - chmod a+x $USERHOME - -# Setting up PostgreSQL -# --------------------- -# -# CentOS does not automatically create a database cluster. Therefore, start -# with initializing the database, then enable the server to start at boot: - - sudo /usr/pgsql-11/bin/postgresql-11-setup initdb - sudo systemctl enable postgresql-11 - -# -# Next tune the postgresql configuration, which is located in -# `/var/lib/pgsql/data/postgresql.conf`. See section *Postgres Tuning* in -# [the installation page](../admin/Installation.md#postgresql-tuning) -# for the parameters to change. -# -# Now start the postgresql service after updating this config file. - - sudo systemctl restart postgresql-11 - -# -# Finally, we need to add two postgres users: one for the user that does -# the import and another for the webserver which should access the database -# only for reading: -# - - sudo -u postgres createuser -s $USERNAME - sudo -u postgres createuser apache - -# -# Installing Nominatim -# ==================== -# -# Building and Configuration -# -------------------------- -# -# Get the source code from Github and change into the source directory -# -if [ "x$1" == "xyes" ]; then #DOCS: :::sh - cd $USERHOME - git clone --recursive git://github.com/openstreetmap/Nominatim.git - cd Nominatim -else #DOCS: - cd $USERHOME/Nominatim #DOCS: -fi #DOCS: - -# When installing the latest source from github, you also need to -# download the country grid: - -if [ ! -f data/country_osm_grid.sql.gz ]; then #DOCS: :::sh - wget --no-verbose -O data/country_osm_grid.sql.gz https://www.nominatim.org/data/country_grid.sql.gz -fi #DOCS: - -# The code must be built in a separate directory. Create this directory, -# then configure and build Nominatim in there: - -#DOCS: :::sh - mkdir $USERHOME/build - cd $USERHOME/build - cmake $USERHOME/Nominatim - make - sudo make install - -# -# Setting up the Apache Webserver -# ------------------------------- -# -# The webserver should serve the php scripts from the website directory of your -# [project directory](../admin/Import.md#creating-the-project-directory). -# Therefore set up a project directory and populate the website directory: -# - mkdir $USERHOME/nominatim-project - cd $USERHOME/nominatim-project - nominatim refresh --website -# -# You need to create an alias to the website directory in your apache -# configuration. Add a separate nominatim configuration to your webserver: - -#DOCS:```sh -sudo tee /etc/httpd/conf.d/nominatim.conf << EOFAPACHECONF - - Options FollowSymLinks MultiViews - AddType text/html .php - DirectoryIndex search.php - Require all granted - - -Alias /nominatim $USERHOME/nominatim-project/website -EOFAPACHECONF -#DOCS:``` - -sudo sed -i 's:#.*::' /etc/httpd/conf.d/nominatim.conf #DOCS: - -# -# Then reload apache -# - - sudo systemctl enable httpd - sudo systemctl restart httpd - -# -# Adding SELinux Security Settings -# -------------------------------- -# -# It is a good idea to leave SELinux enabled and enforcing, particularly -# with a web server accessible from the Internet. At a minimum the -# following SELinux labeling should be done for Nominatim: - - sudo semanage fcontext -a -t httpd_sys_content_t "/usr/local/nominatim/lib/lib-php(/.*)?" - sudo semanage fcontext -a -t httpd_sys_content_t "$USERHOME/nominatim-project/website(/.*)?" - sudo semanage fcontext -a -t lib_t "$USERHOME/nominatim-project/module/nominatim.so" - sudo restorecon -R -v /usr/local/lib/nominatim - sudo restorecon -R -v $USERHOME/nominatim-project - - -# You need to create a minimal configuration file that tells nominatim -# the name of your webserver user: - -#DOCS:```sh -echo NOMINATIM_DATABASE_WEBUSER="apache" | tee .env -#DOCS:``` - - -# Nominatim is now ready to use. Continue with -# [importing a database from OSM data](../admin/Import.md).