X-Git-Url: https://git.openstreetmap.org/rails.git/blobdiff_plain/b4c0bfd8fa324a4c9d8b24e8753d134524ea61c7..28864d8fec554746b191236f8c627753e8f9a344:/public/robots.txt diff --git a/public/robots.txt b/public/robots.txt index d34624918..b21e7a06e 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,2 +1,21 @@ +Sitemap: http://www.openstreetmap.org/sitemap.xml.gz + User-agent: * +Disallow: /user/*/traces/ +Allow: /user/ +Disallow: /traces/tag/ +Disallow: /traces/page/ Disallow: /api/ +Disallow: /edit +Disallow: /browse +Disallow: /login +Disallow: /geocoder +Disallow: /history +Disallow: /message +Disallow: /trace/ +Disallow: /*lat= +Disallow: /*node= +Disallow: /*way= +Disallow: /*relation= + +Host: www.openstreetmap.org