From: Grant Date: Wed, 24 Oct 2012 09:33:55 +0000 (+0200) Subject: Add /user_blocks/ to robots.txt disallow X-Git-Tag: live~5270 X-Git-Url: https://git.openstreetmap.org/rails.git/commitdiff_plain/57938f78c7a5f3643560565e98f4e9d2b31aa40b Add /user_blocks/ to robots.txt disallow Add Disallow: /user_blocks/ as the content is not suitable for indexing. --- diff --git a/public/robots.txt b/public/robots.txt index c0e70dfd8..e4dc2e0d2 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -2,6 +2,7 @@ Sitemap: http://www.openstreetmap.org/sitemap.xml.gz User-agent: * Disallow: /user/ +Disallow: /user_blocks/ Disallow: /traces/tag/ Disallow: /traces/page/ Disallow: /api/