# ========================================================== # robots.txt for nextM365 # https://nextm365.com # Microsoft 365 Learning Platform # ========================================================== # ---------------------------------------------------------- # Default Rules # ---------------------------------------------------------- User-agent: * Allow: / # Optional private paths Disallow: /admin/ Disallow: /internal/ # ---------------------------------------------------------- # OpenAI # ---------------------------------------------------------- User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # ---------------------------------------------------------- # Anthropic # ---------------------------------------------------------- User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / # ---------------------------------------------------------- # Google AI # ---------------------------------------------------------- User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: / User-agent: Googlebot-News Allow: / User-agent: Googlebot-Video Allow: / User-agent: Google-Extended Allow: / # ---------------------------------------------------------- # Microsoft AI # ---------------------------------------------------------- User-agent: Bingbot Allow: / User-agent: BingPreview Allow: / User-agent: AdIdxBot Allow: / # ---------------------------------------------------------- # Perplexity AI # ---------------------------------------------------------- User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # ---------------------------------------------------------- # Amazon # ---------------------------------------------------------- User-agent: Amazonbot Allow: / # ---------------------------------------------------------- # Apple # ---------------------------------------------------------- User-agent: Applebot Allow: / # ---------------------------------------------------------- # Meta # ---------------------------------------------------------- User-agent: FacebookBot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Meta-ExternalFetcher Allow: / # ---------------------------------------------------------- # ByteDance # ---------------------------------------------------------- User-agent: Bytespider Allow: / # ---------------------------------------------------------- # Common Search Engines # ---------------------------------------------------------- User-agent: DuckDuckBot Allow: / User-agent: Slurp Allow: / User-agent: YandexBot Allow: / User-agent: Baiduspider Allow: / User-agent: PetalBot Allow: / User-agent: SeznamBot Allow: / # ---------------------------------------------------------- # SEO Crawlers # ---------------------------------------------------------- User-agent: AhrefsBot Allow: / User-agent: SemrushBot Allow: / User-agent: MJ12bot Allow: / User-agent: DotBot Allow: / User-agent: CCBot Allow: / # ---------------------------------------------------------- # Sitemap # ---------------------------------------------------------- Sitemap: https://nextm365.com/sitemap.xml