# ========================================== # saiboyy.com # AI Search Allowed / AI Training Disallowed # ========================================== # 1. Default: allow search, reference and AI discovery User-agent: * Content-Signal: search=yes,ai-train=no,use=reference Allow: / # WordPress security and low-value pages Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /wp-login.php # Low-value duplicate pages Disallow: /?s= Disallow: /search/ Disallow: /author/ Disallow: /tag/ Disallow: /*?replytocom= Disallow: /*?preview= Disallow: /trackback/ Disallow: /feed/ Disallow: /comments/feed/ # ========================================== # 2. AI model training crawlers: BLOCK # ========================================== User-agent: GPTBot User-agent: ClaudeBot User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: cohere-ai User-agent: MistralAI-Training User-agent: Bytespider Disallow: / # ========================================== # 3. Sitemap # ========================================== Sitemap: https://www.saiboyy.com/sitemap.xml