projects
/
rails.git
/ commitdiff
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
| commitdiff |
tree
raw
|
patch
| inline |
side by side
(parent:
5ae3328
)
Remove redundant robot rules
author
Tom Hughes
<tom@compton.nu>
Tue, 17 Jun 2014 21:14:36 +0000
(22:14 +0100)
committer
Tom Hughes
<tom@compton.nu>
Tue, 17 Jun 2014 21:14:36 +0000
(22:14 +0100)
public/robots.txt
patch
|
blob
|
history
diff --git
a/public/robots.txt
b/public/robots.txt
index d2801eab961fa7206fd2978480e6dccc3b2d6f4b..f248bb1edd4410342e837ee3a0da79ecee82cd10 100644
(file)
--- a/
public/robots.txt
+++ b/
public/robots.txt
@@
-2,18
+2,11
@@
Sitemap: http://www.openstreetmap.org/sitemap.xml.gz
User-agent: *
Disallow: /user/*/traces/
-Disallow: /user/*/edits
Allow: /user/
Disallow: /traces/tag/
Disallow: /traces/page/
Disallow: /api/
Disallow: /edit
-Disallow: /browse/node/*/history
-Disallow: /browse/way/*/history
-Disallow: /browse/relation/*/history
-Allow: /browse/node/
-Allow: /browse/way/
-Allow: /browse/relation/
Disallow: /browse
Disallow: /login
Disallow: /geocoder