User-agent: * Allow: / Sitemap: https://oakvillechiropractor.com/sitemap.xml # LLM/AI crawler information # See llms.txt for structured information about this site # https://oakvillechiropractor.com/llms.txt # Machine-readable brand data: https://oakvillechiropractor.com/.well-known/brand-facts.json # Crawl-delay for polite crawling Crawl-delay: 1 # Block unwanted SEO/scraper bots (waste crawl budget, feed competitor tools) User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: PetalBot Disallow: / # AI Crawlers — explicitly allowed (AEO strategy) User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: anthropic-ai Allow: / User-agent: Bytespider Allow: /