From: Tom Hughes Date: Tue, 20 Apr 2010 21:40:32 +0000 (+0100) Subject: Don't allow robots to fetch user edit lists X-Git-Tag: live~6457^2 X-Git-Url: https://git.openstreetmap.org/rails.git/commitdiff_plain/7a8fe086cdbd6fddf2d842827bd7c2bb4ad439f6?ds=sidebyside Don't allow robots to fetch user edit lists --- diff --git a/public/robots.txt b/public/robots.txt index 496aa201e..c0e70dfd8 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -22,7 +22,7 @@ Disallow: /*relation= User-agent: Slurp Disallow: /user/*/traces/ -Disallow: /user/*/edits/ +Disallow: /user/*/edits Disallow: /user/*/diary/ Allow: /user/ Disallow: /traces/tag/ @@ -48,7 +48,7 @@ Disallow: /*relation= User-agent: Googlebot Disallow: /user/*/traces/ -Disallow: /user/*/edits/ +Disallow: /user/*/edits Disallow: /user/*/diary/ Allow: /user/ Disallow: /traces/tag/