User-agent: * Allow: / # Zones privees (auth-only) - blocage intentionnel pour economiser le crawl budget Disallow: /dashboard Disallow: /settings Disallow: /api/ Disallow: /admin/ # URLs a tokens (non-indexables) Disallow: /email/verify/ Disallow: /password-reset/ Disallow: /verify-email/ # Telescope (debug tool) Disallow: /telescope # --------------------------------------------------------------------------- # Robots des moteurs de reponse : ACCUEILLIS sur le contenu public, ecartes des # zones privees - exactement comme tout autre robot. # # Un bloc User-agent nomme REMPLACE le bloc « * », il n'en herite pas : sans les # Disallow recopies ci-dessous, ces robots etaient formellement invites a # explorer /settings, /api/ et les URL a jeton de reinitialisation. L'authenti- # fication tenait, mais l'invitation n'avait pas lieu d'etre. # --------------------------------------------------------------------------- User-agent: GPTBot Allow: / Disallow: /dashboard Disallow: /settings Disallow: /api/ Disallow: /admin/ Disallow: /email/verify/ Disallow: /password-reset/ Disallow: /verify-email/ Disallow: /telescope User-agent: Google-Extended Allow: / Disallow: /dashboard Disallow: /settings Disallow: /api/ Disallow: /admin/ Disallow: /email/verify/ Disallow: /password-reset/ Disallow: /verify-email/ Disallow: /telescope User-agent: PerplexityBot Allow: / Disallow: /dashboard Disallow: /settings Disallow: /api/ Disallow: /admin/ Disallow: /email/verify/ Disallow: /password-reset/ Disallow: /verify-email/ Disallow: /telescope User-agent: ClaudeBot Allow: / Disallow: /dashboard Disallow: /settings Disallow: /api/ Disallow: /admin/ Disallow: /email/verify/ Disallow: /password-reset/ Disallow: /verify-email/ Disallow: /telescope User-agent: Applebot-Extended Allow: / Disallow: /dashboard Disallow: /settings Disallow: /api/ Disallow: /admin/ Disallow: /email/verify/ Disallow: /password-reset/ Disallow: /verify-email/ Disallow: /telescope Sitemap: https://lucidnest.io/sitemap.xml Sitemap: https://lucidnest.io/blog/sitemap.xml # Carte curatee pour crawlers IA (standard llmstxt.org) # https://lucidnest.io/llms.txt # https://lucidnest.io/llms-full.txt