# AI Crawlers — explicitly allow (CK wants AI engines to read content) User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: anthropic-ai Allow: / User-agent: cohere-ai Allow: / User-agent: Bytespider Allow: / # Block bad bots User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / # Disallow admin/wp-includes Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/plugins/ Disallow: /wp-content/themes/ Disallow: /xmlrpc.php Disallow: /readme.html Disallow: /seo-dashboard/ # Allow critical paths Allow: /wp-admin/admin-ajax.php Allow: /wp-content/uploads/ # Sitemap Sitemap: https://ckdigital360.co.il/sitemap_index.xml Sitemap: https://ckdigital360.co.il/sitemap.xml User-agent: * Disallow: /wp-content/uploads/wpo/wpo-plugins-tables-list.json # START YOAST BLOCK # --------------------------- User-agent: * Disallow: Sitemap: https://ckdigital360.co.il/sitemap_index.xml # --------------------------- # END YOAST BLOCK