# Robots.txt for Simple As That (https://simple-as-that.net) # Optimized for Search Engines & AI Answer Engines (AEO) User-agent: * Allow: / Disallow: /api/ User-agent: Googlebot Allow: / User-agent: Google-Extended Allow: / User-agent: Bingbot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Applebot-Extended Allow: / # Sitemap & AEO Directories Sitemap: https://simple-as-that.net/sitemap.xml # LLMs Index: https://simple-as-that.net/llms.txt # LLMs Full Corpus: https://simple-as-that.net/llms-full.txt