From: Tom Hughes Date: Sun, 19 May 2019 10:56:47 +0000 (+0100) Subject: Exclude per-user diary pages from indexing X-Git-Tag: live~2601 X-Git-Url: https://git.openstreetmap.org/rails.git/commitdiff_plain/71cbb003f8a8db1b077ebeefb776033a3e31ee9a?ds=sidebyside Exclude per-user diary pages from indexing --- diff --git a/public/robots.txt b/public/robots.txt index dd8a42123..169c5a9dc 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,7 +1,7 @@ Sitemap: http://www.openstreetmap.org/sitemap.xml.gz User-agent: * -Disallow: /user/*/diary/ +Disallow: /user/*/diary Disallow: /user/*/traces/ Allow: /user/ Disallow: /traces/tag/