shruub
/
no-js.club
mirror of https://git.habedieeh.re/shruub/no-js.club.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
no-js.club/layouts/robots.txt

12 lines
232 B
Plaintext
Raw Permalink Blame History

User-Agent: *
# blocking some nasty "SEO" bots down here:
User-agent: AhrefsBot
Disallow: /
User-agent: PetalBot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: barkrowler
Disallow: /
Sitemap: {{ "sitemap.xml" | absURL }}
Reference in New Issue View Git Blame Copy Permalink