From: Grant Slater <github@firefishy.com>
Date: Fri, 23 May 2025 10:27:16 +0000 (+0100)
Subject: wiki: update bots in robots.txt
X-Git-Url: https://git.openstreetmap.org/chef.git/commitdiff_plain/HEAD?hp=--cc

wiki: update bots in robots.txt
---

7d6eddbe9e8217e6596f068c61b80d9183a2e56c
diff --git a/cookbooks/wiki/templates/default/robots.txt.erb b/cookbooks/wiki/templates/default/robots.txt.erb
index 45c43d8ff..d8612d6f7 100644
--- a/cookbooks/wiki/templates/default/robots.txt.erb
+++ b/cookbooks/wiki/templates/default/robots.txt.erb
@@ -8,10 +8,13 @@ Allow: /
 User-agent: 008
 Disallow: /
 
-User-agent: ZvonilBot
+User-agent: HTTrack
 Disallow: /
 
-User-agent: HTTrack
+User-agent: DataForSeoBot
+Disallow: /
+
+User-agent: SeznamBot
 Disallow: /
 
 User-agent: *