# AI assistants & answer engines (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, # etc.) are welcome to read public content - they match the rule below. A curated # map for them is published at https://algoinsight.io/llms.txt # (The private-page Disallow rules below apply to ALL crawlers, AI included.) User-agent: * Allow: / # Private / user-specific pages Disallow: /dashboard Disallow: /stats Disallow: /subscription Disallow: /notifications Disallow: /change-password # Auth pages Disallow: /login Disallow: /register Disallow: /auth/ # JSON API - already X-Robots-Tag: noindex; this stops it being fetched at all Disallow: /api/ # Admin portal Disallow: /admin Disallow: /admin/ # Company (B2B org) portal - private, auth + org-role gated # (the public marketing page lives at /for-teams and stays indexable) Disallow: /org Disallow: /org/ # Full-screen practice sessions (no nav, not useful as search entry points) Disallow: /system-design/practice/ Disallow: /dsa/*/practice Disallow: /behavioral/session/ Disallow: /interview/dsa/session/ Disallow: /interview/technical/session/ Disallow: /dsa/visualizer/playground Sitemap: https://algoinsight.io/sitemap.xml