# Standard crawlers User-agent: * Allow: / Sitemap: https://dashbuilds.dev/sitemap.xml # AI Search Crawlers (ALLOW — we want to appear in AI search results) User-agent: OAI-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ChatGPT-User Allow: / # AI Training Crawlers (BLOCK — don't use our content for training) User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CCBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Bytespider Disallow: / User-agent: cohere-ai Disallow: /