# Allow major preview & search bots User-agent: facebookexternalhit Disallow: User-agent: Twitterbot Disallow: User-agent: Googlebot Disallow: # Block OpenAI / AI crawlers User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: CCBot Disallow: / # Block SEO & scraping bots User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: MauiBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Baiduspider Disallow: / # Sitemap Sitemap: https://khabarcenter.com/sitemap.xml