# aimless.io welcomes search engines and AI crawlers, including AI answer # engines and model training (policy set 2026-09-13). # # Cloudflare's "managed robots.txt" / "block AI bots" setting on the aimless.io # zone PREPENDS its own Disallow groups to this file at the edge. It must stay # off, or the groups below are overridden for the bots it names. User-agent: * Allow: / # Named explicitly, so a crawler that only reads its own group still finds an # allow rather than falling back to whatever an edge layer added. User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Googlebot User-agent: Bingbot User-agent: Applebot User-agent: Applebot-Extended User-agent: Amazonbot User-agent: meta-externalagent User-agent: DuckAssistBot User-agent: MistralAI-User User-agent: cohere-ai User-agent: CCBot User-agent: Bytespider Allow: / Sitemap: https://aimless.io/sitemap-index.xml