]> git.openstreetmap.org Git - chef.git/blob - cookbooks/planet/files/default/html/robots.txt
projects / chef.git / blob
? search:
summary | shortlog | log | commit | commitdiff | tree
history | raw | HEAD
Manage static content for planet.openstreetmap.org
[chef.git] / cookbooks / planet / files / default / html / robots.txt
1 #No bz2 chomping bots please
2
3 User-agent: wget
4 Allow: /
5
6 User-agent: *
7 Disallow: /
8
Chef configuration management public repo for configuring & maintaining the OpenStreetMap servers.