# ===================================== # robots.txt - ZoomNews.in # Optimized for Search Engines + AI + News Websites # ===================================== # ------------------------------------- # Allow all major search engines # ------------------------------------- User-agent: * Allow: / Disallow: /controladmin/ # ------------------------------------- # Allow Ahrefs (SEO analysis) # ------------------------------------- User-agent: AhrefsBot Allow: / # ------------------------------------- # Block unwanted / non-beneficial bots # ------------------------------------- # Baidu (China) User-agent: Baiduspider Disallow: / # Yandex (Russia) User-agent: Yandex Disallow: / # Majestic SEO crawler User-agent: MJ12bot Disallow: / # ------------------------------------- # Sitemaps for Search Engines # ------------------------------------- Sitemap: https://www.zoomnews.in/sitemap.xml Sitemap: https://www.zoomnews.in/sitemap-index.xml Sitemap: https://www.zoomnews.in/sitemap-google-news.xml Sitemap: https://www.zoomnews.in/sitemap-video.xml Sitemap: https://www.zoomnews.in/sitemap-gallery.xml # ------------------------------------- # AI / LLM Content Discovery # ------------------------------------- # llms.txt for AI crawlers (ChatGPT, Gemini, Claude, etc.) Sitemap: https://www.zoomnews.in/llms.txt