Update robots.txt to prevent crawling of domain blocks (#26470)

Co-authored-by: Claire <claire.github-309c@sitedethib.com>
3 months ago · a98a8ee93f
parent a17e7d10fc
commit a98a8ee93f
1 changed files with 1 additions and 0 deletions
--- a/public/robots.txt
+++ b/public/robots.txt
@ -6,3 +6,4 @@ Disallow: /
 User-agent: *
 Disallow: /media_proxy/
 Disallow: /interact/
+Disallow: /api/v1/instance/domain_blocks