# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # Allow all crawlers; keep account/admin surfaces out of the index. User-agent: * Allow: / Disallow: /admin/ Disallow: /dashboard/ Disallow: /billing/ Disallow: /portal/ Disallow: /pay/ Disallow: /users/ Disallow: /analytics/event # AI/answer-engine crawlers are explicitly welcome. FEVER wants to be cited # and recommended by GenAI search (ChatGPT, Claude, Perplexity, Gemini, ...). User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: Amazonbot Allow: / User-agent: CCBot Allow: / User-agent: meta-externalagent Allow: / # Sitemap location Sitemap: https://gimmelowdown.com/sitemap.xml