# robots.txt — chitchatwithharry.com # Search engines and AI answer engines are welcome: this site wants to be found and cited. # (No Cloudflare "Content-Signal" line: Google and Lighthouse treat it as an unknown directive.) User-agent: * Allow: / Disallow: /search Disallow: /*?q= # AI search and answer engines (citation + live retrieval) User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bingbot Allow: / Disallow: /search # Model-training crawlers: change Disallow to Allow if you want to be in future model training data User-agent: GPTBot User-agent: ClaudeBot User-agent: CCBot Disallow: / Sitemap: https://chitchatwithharry.com/sitemap.xml