deblan/journalduhacker
1
0
Fork 0
Code Issues Pull requests Releases Wiki Activity
journalduhacker/public/robots.txt

6 lines
89 B
Plaintext
Raw Normal View History

block archivers
2012-10-24 18:53:21 +02:00
# no caching
User-agent: ia_archiver
Disallow: /
User-agent: archive.org_bot
Disallow: /
Reference in a new issue Copy permalink