X-Git-Url: https://git.openstreetmap.org/rails.git/blobdiff_plain/d36fab2913d10bef4eae2cee7c34875f20311af9..babefbba6c9c6d7d2ed944bda7aa3634d0b917e6:/public/robots.txt diff --git a/public/robots.txt b/public/robots.txt index 496aa201e..e4dc2e0d2 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -2,6 +2,7 @@ Sitemap: http://www.openstreetmap.org/sitemap.xml.gz User-agent: * Disallow: /user/ +Disallow: /user_blocks/ Disallow: /traces/tag/ Disallow: /traces/page/ Disallow: /api/ @@ -22,7 +23,7 @@ Disallow: /*relation= User-agent: Slurp Disallow: /user/*/traces/ -Disallow: /user/*/edits/ +Disallow: /user/*/edits Disallow: /user/*/diary/ Allow: /user/ Disallow: /traces/tag/ @@ -48,7 +49,7 @@ Disallow: /*relation= User-agent: Googlebot Disallow: /user/*/traces/ -Disallow: /user/*/edits/ +Disallow: /user/*/edits Disallow: /user/*/diary/ Allow: /user/ Disallow: /traces/tag/