chef.git
15 months agonginx: cleanup historical cache dir
Grant Slater [Tue, 31 Mar 2020 20:47:57 +0000 (21:47 +0100)]
nginx: cleanup historical cache dir

15 months agoUpdate rhaegal to postgres 12, postgis 3 and carto 5.0.0
Tom Hughes [Tue, 31 Mar 2020 07:10:08 +0000 (08:10 +0100)]
Update rhaegal to postgres 12, postgis 3 and carto 5.0.0

16 months agoDisable the postgres JIT on tile servers
Tom Hughes [Mon, 30 Mar 2020 18:11:38 +0000 (19:11 +0100)]
Disable the postgres JIT on tile servers

16 months agoimagery: fix vdl_light6_deflate source filename
Grant Slater [Sun, 29 Mar 2020 17:38:23 +0000 (18:38 +0100)]
imagery: fix vdl_light6_deflate source filename

16 months agoimagery: remove broken vdl-light6 layer
Grant Slater [Sun, 29 Mar 2020 17:33:41 +0000 (18:33 +0100)]
imagery: remove broken vdl-light6 layer

16 months agoimagery: remove broken vdl_light6-deflate layer
Grant Slater [Sun, 29 Mar 2020 17:29:05 +0000 (18:29 +0100)]
imagery: remove broken vdl_light6-deflate layer

16 months agoFix imager layer deletion
Tom Hughes [Sun, 29 Mar 2020 16:31:08 +0000 (17:31 +0100)]
Fix imager layer deletion

16 months agodelete lidar-hillshade-2019 deletion to re-create it right away
Guillaume RISCHARD [Sun, 29 Mar 2020 16:27:20 +0000 (18:27 +0200)]
delete lidar-hillshade-2019 deletion to re-create it right away

16 months agodelete lidar-hillshade-2019 deletion to re-create it
Guillaume RISCHARD [Sun, 29 Mar 2020 16:14:10 +0000 (18:14 +0200)]
delete lidar-hillshade-2019 deletion to re-create it

16 months agoMerge branch 'master' of ssh://git.openstreetmap.org/var/lib/git/public/chef
Guillaume RISCHARD [Sun, 29 Mar 2020 16:11:39 +0000 (18:11 +0200)]
Merge branch 'master' of ssh://git.openstreetmap.org/var/lib/git/public/chef

16 months agodelete lidar-hillshade-2019 to delete vdl_light6 layer
Guillaume RISCHARD [Sun, 29 Mar 2020 16:09:59 +0000 (18:09 +0200)]
delete lidar-hillshade-2019 to delete vdl_light6 layer

16 months agoMerge remote-tracking branch 'github/pull/291'
Tom Hughes [Sun, 29 Mar 2020 16:04:31 +0000 (17:04 +0100)]
Merge remote-tracking branch 'github/pull/291'

16 months agoLuxembourg lidar test, rename deflate, delete jpeg
Guillaume RISCHARD [Sun, 29 Mar 2020 16:01:29 +0000 (18:01 +0200)]
Luxembourg lidar test, rename deflate, delete jpeg

16 months agoLuxembourg lidar test, use deflate instead of jpeg
Guillaume RISCHARD [Sun, 29 Mar 2020 15:17:12 +0000 (17:17 +0200)]
Luxembourg lidar test, use deflate instead of jpeg

16 months agoLuxembourg lidar test
Guillaume RISCHARD [Sun, 29 Mar 2020 14:18:04 +0000 (16:18 +0200)]
Luxembourg lidar test

16 months agoAdd email for MWG osmf-talk owner queue
Paul Norman [Sat, 28 Mar 2020 20:10:36 +0000 (13:10 -0700)]
Add email for MWG osmf-talk owner queue

16 months agoUpdate pyrene to postgres 12, postgis 3 and carto 5.0.0
Tom Hughes [Sat, 28 Mar 2020 15:18:17 +0000 (15:18 +0000)]
Update pyrene to postgres 12, postgis 3 and carto 5.0.0

16 months agoUpdate odin to postgres 12, postgis 3 and carto 5.0.0
Tom Hughes [Fri, 27 Mar 2020 17:57:40 +0000 (17:57 +0000)]
Update odin to postgres 12, postgis 3 and carto 5.0.0

16 months agoFix typo
Tom Hughes [Fri, 27 Mar 2020 10:53:08 +0000 (10:53 +0000)]
Fix typo

16 months agoAdd mailto directive to DNS update cron job
Tom Hughes [Fri, 27 Mar 2020 10:38:03 +0000 (10:38 +0000)]
Add mailto directive to DNS update cron job

16 months agoRemove bytemark credentials from DNS scripts
Tom Hughes [Fri, 27 Mar 2020 09:44:30 +0000 (09:44 +0000)]
Remove bytemark credentials from DNS scripts

16 months agoMake sure dnscontrol is on the path in DNS update scripts
Tom Hughes [Fri, 27 Mar 2020 09:42:34 +0000 (09:42 +0000)]
Make sure dnscontrol is on the path in DNS update scripts

16 months agoRemove pingdom credentials from DNS scripts
Tom Hughes [Fri, 27 Mar 2020 09:41:41 +0000 (09:41 +0000)]
Remove pingdom credentials from DNS scripts

16 months agoBlock apps that were notified on the 20th
Paul Norman [Fri, 27 Mar 2020 04:40:21 +0000 (21:40 -0700)]
Block apps that were notified on the 20th

16 months agoRevert "imagery: re-run ana_dtm_2017.openstreetmap.lu delete"
Grant Slater [Thu, 26 Mar 2020 21:39:17 +0000 (21:39 +0000)]
Revert "imagery: re-run ana_dtm_2017.openstreetmap.lu delete"

This reverts commit fa741e4951ecf0d56e78f2b10c8e41503a42e881.

16 months agoimagery: re-run ana_dtm_2017.openstreetmap.lu delete
Grant Slater [Thu, 26 Mar 2020 21:36:03 +0000 (21:36 +0000)]
imagery: re-run ana_dtm_2017.openstreetmap.lu delete

16 months agoimagery: fix delete service action to match create
Grant Slater [Thu, 26 Mar 2020 21:35:36 +0000 (21:35 +0000)]
imagery: fix delete service action to match create

16 months agoMerge branch 'master' of ssh://git.openstreetmap.org/var/lib/git/public/chef
Guillaume RISCHARD [Thu, 26 Mar 2020 14:36:36 +0000 (15:36 +0100)]
Merge branch 'master' of ssh://git.openstreetmap.org/var/lib/git/public/chef

16 months agoUnderscores to dashes in layer name
Guillaume RISCHARD [Thu, 26 Mar 2020 14:36:28 +0000 (15:36 +0100)]
Underscores to dashes in layer name

16 months agoRemove attempt to force geodns rebuilds with --assume-new
Tom Hughes [Thu, 26 Mar 2020 14:14:40 +0000 (14:14 +0000)]
Remove attempt to force geodns rebuilds with --assume-new

16 months agoMade lu_ngl_dtm recipe ascii
Guillaume RISCHARD [Thu, 26 Mar 2020 13:34:13 +0000 (14:34 +0100)]
Made lu_ngl_dtm recipe ascii

16 months agoRemove nginx options that break on >1 virtual hosts
Guillaume RISCHARD [Thu, 26 Mar 2020 13:06:02 +0000 (14:06 +0100)]
Remove nginx options that break on >1 virtual hosts

16 months agoUse same http options as tile servers, i.a. enable http2
Guillaume RISCHARD [Thu, 26 Mar 2020 12:03:19 +0000 (13:03 +0100)]
Use same http options as tile servers, i.a. enable http2

16 months agoAttribution for lu_ngl_dtm
Guillaume RISCHARD [Thu, 26 Mar 2020 11:50:34 +0000 (12:50 +0100)]
Attribution for lu_ngl_dtm

16 months agoAdded Luxembourg 2019 lidar hillshade
Guillaume RISCHARD [Thu, 26 Mar 2020 11:49:55 +0000 (12:49 +0100)]
Added Luxembourg 2019 lidar hillshade

16 months agoUse colour DTM in Luxembourg
Guillaume RISCHARD [Thu, 26 Mar 2020 11:41:37 +0000 (12:41 +0100)]
Use colour DTM in Luxembourg

16 months agoMake sure tile cookbook only requests the required postgres version
Tom Hughes [Wed, 25 Mar 2020 22:57:33 +0000 (22:57 +0000)]
Make sure tile cookbook only requests the required postgres version

16 months agoUpdate IPv6 address for meraxes
Tom Hughes [Wed, 25 Mar 2020 16:51:50 +0000 (16:51 +0000)]
Update IPv6 address for meraxes

16 months agoUse reprojected LU hillshade
Guillaume RISCHARD [Wed, 25 Mar 2020 12:58:16 +0000 (13:58 +0100)]
Use reprojected LU hillshade

16 months agoUpdate scorch to postgres 12, postgis 3 and carto 5.0.0
Tom Hughes [Wed, 25 Mar 2020 09:34:55 +0000 (09:34 +0000)]
Update scorch to postgres 12, postgis 3 and carto 5.0.0

16 months agoUpdate piwik to 3.13.4
Tom Hughes [Wed, 25 Mar 2020 00:14:54 +0000 (00:14 +0000)]
Update piwik to 3.13.4

16 months agoimagery: give dmlu + stereo accounts
Grant Slater [Tue, 24 Mar 2020 22:42:14 +0000 (22:42 +0000)]
imagery: give dmlu + stereo accounts

16 months agoimagery: remove old lu site cleanup
Grant Slater [Tue, 24 Mar 2020 22:05:22 +0000 (22:05 +0000)]
imagery: remove old lu site cleanup

16 months agoimagery: delete old lu site
Grant Slater [Tue, 24 Mar 2020 22:04:09 +0000 (22:04 +0000)]
imagery: delete old lu site

16 months agoimagery: fix lu site domain
Grant Slater [Tue, 24 Mar 2020 22:01:49 +0000 (22:01 +0000)]
imagery: fix lu site domain

16 months agoimagery: enable lu imagery
Grant Slater [Tue, 24 Mar 2020 21:49:32 +0000 (21:49 +0000)]
imagery: enable lu imagery

16 months agoimagery: Add initial lu ngl dtm
Grant Slater [Tue, 24 Mar 2020 21:45:40 +0000 (21:45 +0000)]
imagery: Add initial lu ngl dtm

16 months agoAdd test for docker cookbook
Tom Hughes [Tue, 24 Mar 2020 19:23:39 +0000 (19:23 +0000)]
Add test for docker cookbook

16 months agoAdd dmlu as a user on dev
Tom Hughes [Tue, 24 Mar 2020 18:16:54 +0000 (18:16 +0000)]
Add dmlu as a user on dev

16 months agoAdd stereo as a user on dev
Tom Hughes [Tue, 24 Mar 2020 17:28:51 +0000 (17:28 +0000)]
Add stereo as a user on dev

16 months agotilecache: rate limit Browser UA not sending a referer
Grant Slater [Tue, 24 Mar 2020 17:03:18 +0000 (17:03 +0000)]
tilecache: rate limit Browser UA not sending a referer

Rate limit Browsers which do not send a referer.
Without a referer we are unable to say who is accessing our server.

No referer could be due to some of the following options:
* https accessing http tiles (we have STS is place to avoid)
* Browser Extension blocking referer (eg: uMatrix)
* Site with Referrer-Policy set

16 months agoMerge remote-tracking branch 'github/pull/288'
Tom Hughes [Tue, 24 Mar 2020 15:03:48 +0000 (15:03 +0000)]
Merge remote-tracking branch 'github/pull/288'

16 months agotilecache: block clustrmaps.com referer
Grant Slater [Tue, 24 Mar 2020 11:40:59 +0000 (11:40 +0000)]
tilecache: block clustrmaps.com referer

16 months agotilecache: block 9db.jp referer
Grant Slater [Tue, 24 Mar 2020 11:33:12 +0000 (11:33 +0000)]
tilecache: block 9db.jp referer

16 months agoAdd fake MS referer to block list
Paul Norman [Tue, 24 Mar 2020 05:45:23 +0000 (22:45 -0700)]
Add fake MS referer to block list

16 months agotilecache: block staticmaps UA
Grant Slater [Mon, 23 Mar 2020 17:05:23 +0000 (17:05 +0000)]
tilecache: block staticmaps UA

16 months agoTilecache: block more fake google UA
Grant Slater [Mon, 23 Mar 2020 12:53:09 +0000 (12:53 +0000)]
Tilecache: block more fake google UA

16 months agotilecache: add faked referer
Grant Slater [Mon, 23 Mar 2020 12:35:57 +0000 (12:35 +0000)]
tilecache: add faked referer

16 months agotilecache: block Wget UA
Grant Slater [Mon, 23 Mar 2020 12:23:09 +0000 (12:23 +0000)]
tilecache: block Wget UA

16 months agoUpdate bowser to postgres 12, postgis 3 and carto 5.0.0
Tom Hughes [Mon, 23 Mar 2020 11:06:58 +0000 (11:06 +0000)]
Update bowser to postgres 12, postgis 3 and carto 5.0.0

16 months agoMake sure periodic DNS updates rebuild all geo maps
Tom Hughes [Mon, 23 Mar 2020 10:28:29 +0000 (10:28 +0000)]
Make sure periodic DNS updates rebuild all geo maps

16 months agohardware: fix lint error
Grant Slater [Sun, 22 Mar 2020 23:20:27 +0000 (23:20 +0000)]
hardware: fix lint error

16 months agoAdd basic docker cookbook
Grant Slater [Sun, 22 Mar 2020 23:15:41 +0000 (23:15 +0000)]
Add basic docker cookbook

16 months agoUpdate dnscontrol to 3.0.0
Tom Hughes [Sun, 22 Mar 2020 19:27:40 +0000 (19:27 +0000)]
Update dnscontrol to 3.0.0

16 months agoFix shared memory limit on idris
Tom Hughes [Sun, 22 Mar 2020 14:22:19 +0000 (14:22 +0000)]
Fix shared memory limit on idris

16 months agoUpdate ysera to postgres 12, postgis 3 and carto 5.0.0
Tom Hughes [Sun, 22 Mar 2020 10:10:58 +0000 (10:10 +0000)]
Update ysera to postgres 12, postgis 3 and carto 5.0.0

16 months agoMake postgres 12 and postgis 3 the default for tile servers
Tom Hughes [Sat, 21 Mar 2020 14:48:29 +0000 (14:48 +0000)]
Make postgres 12 and postgis 3 the default for tile servers

16 months agoAdd additional interfaces to bond on karm
Tom Hughes [Sat, 21 Mar 2020 12:46:07 +0000 (12:46 +0000)]
Add additional interfaces to bond on karm

16 months agoRe-enable installation of Intel SSD tool
Tom Hughes [Sat, 21 Mar 2020 12:39:08 +0000 (12:39 +0000)]
Re-enable installation of Intel SSD tool

16 months agoAvoid notifying from a log resource
Tom Hughes [Sat, 21 Mar 2020 11:58:59 +0000 (11:58 +0000)]
Avoid notifying from a log resource

16 months agoUpdate rubocop configuration for COP renames
Tom Hughes [Sat, 21 Mar 2020 11:54:09 +0000 (11:54 +0000)]
Update rubocop configuration for COP renames

16 months agoUpdate bundle
Tom Hughes [Sat, 21 Mar 2020 11:52:34 +0000 (11:52 +0000)]
Update bundle

16 months agoMerge remote-tracking branch 'github/pull/287'
Tom Hughes [Sat, 21 Mar 2020 11:46:23 +0000 (11:46 +0000)]
Merge remote-tracking branch 'github/pull/287'

16 months agoDisable JIT and parallel workers for replication with postgres 12
Tom Hughes [Sat, 21 Mar 2020 11:11:17 +0000 (11:11 +0000)]
Disable JIT and parallel workers for replication with postgres 12

16 months agoAdd Nginx totals to tile.openstreetmap.org munin
Paul Norman [Sat, 21 Mar 2020 01:26:10 +0000 (18:26 -0700)]
Add Nginx totals to tile.openstreetmap.org munin

16 months agotilecache: obvious peers back
Grant Slater [Fri, 20 Mar 2020 20:45:30 +0000 (20:45 +0000)]
tilecache: obvious peers back

16 months agotilecache: remove redundant squid config
Grant Slater [Fri, 20 Mar 2020 19:59:24 +0000 (19:59 +0000)]
tilecache: remove redundant squid config

16 months agoConfigure albi as a tile server
Tom Hughes [Thu, 19 Mar 2020 17:27:59 +0000 (17:27 +0000)]
Configure albi as a tile server

16 months agoimagery: update leafletjs
Grant Slater [Thu, 19 Mar 2020 16:25:41 +0000 (16:25 +0000)]
imagery: update leafletjs

16 months agoFix comment for unneeded package
Grant Slater [Thu, 19 Mar 2020 16:14:57 +0000 (16:14 +0000)]
Fix comment for unneeded package

16 months agoimagery: do not install python-gdal for now
Grant Slater [Thu, 19 Mar 2020 16:09:07 +0000 (16:09 +0000)]
imagery: do not install python-gdal for now

16 months agoNo longer set default irqbalance config
Grant Slater [Thu, 19 Mar 2020 16:08:39 +0000 (16:08 +0000)]
No longer set default irqbalance config

16 months agoAdd role for albi
Tom Hughes [Thu, 19 Mar 2020 08:42:38 +0000 (08:42 +0000)]
Add role for albi

16 months agoUpdated sha ref of veda-consulting/uk.co.vedaconsulting.mailchimp
Michal Migurski [Thu, 19 Mar 2020 04:11:58 +0000 (21:11 -0700)]
Updated sha ref of veda-consulting/uk.co.vedaconsulting.mailchimp

See https://github.com/openstreetmap/chef/pull/259#issuecomment-600422643

16 months agoAdd role for glaedr
Tom Hughes [Wed, 18 Mar 2020 20:43:20 +0000 (20:43 +0000)]
Add role for glaedr

16 months agoFix tile parents
Tom Hughes [Wed, 18 Mar 2020 20:36:03 +0000 (20:36 +0000)]
Fix tile parents

16 months agoAdd verifiers for wiki cookbook test
Tom Hughes [Wed, 18 Mar 2020 20:11:47 +0000 (20:11 +0000)]
Add verifiers for wiki cookbook test

16 months agoFix mediawiki cookbook dependencies
Tom Hughes [Wed, 18 Mar 2020 20:11:34 +0000 (20:11 +0000)]
Fix mediawiki cookbook dependencies

16 months agoUpdate bundle
Tom Hughes [Wed, 18 Mar 2020 19:11:54 +0000 (19:11 +0000)]
Update bundle

16 months agoMerge remote-tracking branch 'github/pull/259'
Tom Hughes [Wed, 18 Mar 2020 18:11:55 +0000 (18:11 +0000)]
Merge remote-tracking branch 'github/pull/259'

16 months agoUpdate jQuery and switch to a better CDN for it
Tom Hughes [Wed, 18 Mar 2020 14:25:35 +0000 (14:25 +0000)]
Update jQuery and switch to a better CDN for it

16 months agoCorrect spelling
Tom Hughes [Wed, 18 Mar 2020 14:19:51 +0000 (14:19 +0000)]
Correct spelling

16 months agoAdd roles for fuchur and idris
Tom Hughes [Wed, 18 Mar 2020 13:05:58 +0000 (13:05 +0000)]
Add roles for fuchur and idris

16 months agoIncrease memory cache on gorwen
Tom Hughes [Wed, 18 Mar 2020 12:30:56 +0000 (12:30 +0000)]
Increase memory cache on gorwen

16 months agoPointed back to master MW CheckUser with changes in-place
Michal Migurski [Wed, 18 Mar 2020 04:09:10 +0000 (21:09 -0700)]
Pointed back to master MW CheckUser with changes in-place

16 months agoPointed to a new version of MW CheckUser extension after code review
Michal Migurski [Fri, 28 Feb 2020 18:01:23 +0000 (10:01 -0800)]
Pointed to a new version of MW CheckUser extension after code review

16 months agoPointed to a version of MW CheckUser extension that works with a new wiki install
Michal Migurski [Fri, 14 Feb 2020 02:17:04 +0000 (18:17 -0800)]
Pointed to a version of MW CheckUser extension that works with a new wiki install

Fixes CheckUser failure logged at https://travis-ci.org/openstreetmap/chef/jobs/650204578

    Wikimedia\Rdbms\DBQueryError from line 1587 of /srv/wiki.openstreetmap.org/w/includes/libs/rdbms/database/Database.php: A database query error has occurred. Did you forget to run your application's database schema updater after upgrading?
    Query: INSERT  INTO `cu_changes` (cuc_timestamp,cuc_user,cuc_user_text,cuc_namespace,cuc_title,cuc_comment,cuc_minor,cuc_page_id,cuc_this_oldid,cuc_last_oldid,cuc_type,cuc_ip,cuc_ip_hex) VALUES ('20200203011622',NULL,'MediaWiki default','0','Main_Page','','0','1','1','0','1','127.0.0.1','7F000001')
    Function: PopulateCheckUserTable::doDBUpdates
    Error: 1048 Column 'cuc_user' cannot be null (localhost)
    Backtrace:
    #0 /srv/wiki.openstreetmap.org/w/includes/libs/rdbms/database/Database.php(1556): Wikimedia\Rdbms\Database->getQueryExceptionAndLog(string, integer, string, string)
    #1 /srv/wiki.openstreetmap.org/w/includes/libs/rdbms/database/Database.php(1274): Wikimedia\Rdbms\Database->reportQueryError(string, integer, string, string, boolean)
    #2 /srv/wiki.openstreetmap.org/w/includes/libs/rdbms/database/Database.php(2149): Wikimedia\Rdbms\Database->query(string, string)
    #3 /srv/wiki.openstreetmap.org/w/extensions/CheckUser/maintenance/populateCheckUserTable.php(98): Wikimedia\Rdbms\Database->insert(string, array, string)
    #4 /srv/wiki.openstreetmap.org/w/maintenance/Maintenance.php(1719): PopulateCheckUserTable->doDBUpdates()
    #5 /srv/wiki.openstreetmap.org/w/maintenance/update.php(215): LoggedUpdateMaintenance->execute()
    #6 /srv/wiki.openstreetmap.org/w/maintenance/doMaintenance.php(96): UpdateMediaWiki->execute()
    #7 /srv/wiki.openstreetmap.org/w/maintenance/update.php(275): require_once(string)
    #8 {main}

16 months agoAdded wiki test to Github Actions configuration
Michal Migurski [Fri, 14 Feb 2020 02:19:10 +0000 (18:19 -0800)]
Added wiki test to Github Actions configuration

16 months agoUpdated wiki configuration to run under Test-Kitchen
Michal Migurski [Wed, 15 Jan 2020 01:43:57 +0000 (17:43 -0800)]
Updated wiki configuration to run under Test-Kitchen

- Added missing databags to fix transient errors
- Added wiki test suite with appropriate cookbooks

16 months agoFix memory cache limit for naga
Tom Hughes [Wed, 18 Mar 2020 00:51:30 +0000 (00:51 +0000)]
Fix memory cache limit for naga