From: Tom Hughes Date: Fri, 6 Feb 2009 10:12:50 +0000 (+0000) Subject: Stop robots crawling the object browser. X-Git-Tag: live~7642 X-Git-Url: https://git.openstreetmap.org/rails.git/commitdiff_plain/53d30d70af5cf87120953ad22a580ea48d39a6f1?hp=554614723a94ca05ae8dc3a23fa7a8fa8419ff08;ds=inline Stop robots crawling the object browser. --- diff --git a/public/robots.txt b/public/robots.txt index f7cd6923a..ec6712596 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,5 +1,6 @@ User-agent: * Disallow: /api/ +Disallow: /browse/ Disallow: /trace/ Disallow: /edit -Disallow: /login \ No newline at end of file +Disallow: /login