User-agent: * Disallow: /admin Disallow: /auth Disallow: /dev Disallow: /device Disallow: /projection Disallow: /forgot-password Disallow: /reset-password Disallow: /verify-email Disallow: /profile Disallow: /my-tournaments Disallow: /subscription/ Disallow: /trial/ Disallow: /quick-match/ Disallow: /multiplayer-match/ Disallow: /clubs Disallow: /clubs/ Allow: / # AI Search & LLM Bots — explicitly allowed for citation and indexing # User-agent: * above already covers all bots; explicit entries are for clarity. # OpenAI / ChatGPT User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic / Claude User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / # Google — Gemini, AI Overviews, Bard User-agent: Google-Extended Allow: / User-agent: Googlebot Allow: / # Microsoft — Copilot, Bing AI User-agent: Bingbot Allow: / User-agent: msnbot Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Meta AI User-agent: FacebookBot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Meta-ExternalFetcher Allow: / # Apple / Siri User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Amazon / Alexa User-agent: Amazonbot Allow: / # You.com User-agent: YouBot Allow: / # ByteDance / Doubao User-agent: Bytespider Allow: / # Cohere User-agent: cohere-ai Allow: / # Allen Institute for AI (Semantic Scholar) User-agent: AI2Bot Allow: / # Diffbot (AI data extraction) User-agent: DiffBot Allow: / # Brave Search User-agent: BraveBot Allow: / # DuckDuckGo User-agent: DuckDuckBot Allow: / # Quora / Poe User-agent: QuoraBot Allow: / # Huawei PetalBot User-agent: PetalBot Allow: / # Timpi Search User-agent: Timpibot Allow: / # Common Crawl (training data scraping only, NOT citation) — blocked User-agent: CCBot Disallow: / Sitemap: https://smartdart.app/sitemap.xml