# AI Data Scrapers [https://darkvisitors.com/agents]
User-Agent: Applebot-Extended
User-Agent: Bytespider
User-Agent: CCBot
User-Agent: ClaudeBot
User-Agent: Diffbot
User-Agent: Facebookbot
User-Agent: Google-Extended
User-Agent: GPTBot
User-Agent: ImagesiftBot
User-Agent: Meta-ExternalAgent
User-Agent: omgili
User-Agent: Timpibot
Disallow: /

# AI Search Crawlers [https://darkvisitors.com/agents]
User-Agent: Amazonbot
User-Agent: Applebot
User-Agent: OAI-SearchBot
User-Agent: PerplexityBot
User-Agent: Youbot
Disallow: /

# Undocumented AI Agents [https://darkvisitors.com/agents]
User-Agent: anthropic-ai
User-Agent: Claude-Web
User-Agent: cohere-ai
Disallow: /

User-agent: *
Disallow: /tags/*
Disallow: /bugs/*
Disallow: /bugzilla/*
Disallow: /cgi-bin/*
Disallow: /dist/*
Disallow: /ftp/*
Disallow: /gallery/*
Disallow: /gallery2/*
Disallow: /gallery3/*
Disallow: /mktemp/*
Disallow: /newsyslog/*
Disallow: /pub/*
Disallow: /repos/*
Disallow: /smokeping/*

Sitemap: https://www.sudo.ws/sitemap.xml