User-Agent: * Allow: /?display=wide Allow: /wp-content/uploads/ Disallow: /wp-content/plugins/ Disallow: /readme.html Disallow: /search Disallow: /?s= Sitemap: https://www.descary.com/sitemap.xml User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no Allow: / # === AI CRAWLERS - ALLOWED FOR RESPONSES === User-agent: Google-Extended # Google AI Overviews / Gemini Allow: / User-agent: GPTBot # ChatGPT Search Allow: / User-agent: PerplexityBot # Perplexity AI Allow: / User-agent: Applebot-Extended # Apple Intelligence / Siri Allow: / # === BLOCKED CRAWLERS (training / scraping) === User-agent: Amazonbot Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: meta-externalagent Disallow: /