# ============================================= # Zinia.co.za – robots.txt (November 2025 – LLM-safe - Digital Whisperers) # ============================================= User-agent: * Allow: / Disallow: /old2019/ Disallow: /?s= Disallow: /feed/ Disallow: /trackback/ Disallow: /comments/feed/ Disallow: /*/thank-you/ Disallow: /go/ Sitemap: https://www.zinia.co.za/sitemap_index.xml # Polite crawl-delay for scraper bots User-agent: MJ12bot Crawl-delay: 10 User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10 # Block LLM / AI training bots (recommended) User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: Anthropic-AI Disallow: / User-agent: ClaudeBot Disallow: / User-agent: CCBot Disallow: / User-agent: PerplexityBot Disallow: /