# robots.txt for Oplane # https://www.oplane.com User-agent: * Allow: / # Sitemap location Sitemap: https://www.oplane.com/sitemap.xml # Docs are served from Mintlify under /docs and emit their own sitemap. # Crawlers only read robots.txt at the host root, so the docs sitemap must be # declared here (the /docs/robots.txt copy is on a subpath and ignored). Sitemap: https://www.oplane.com/docs/sitemap.xml # Block API routes Disallow: /api/ # Block internal/admin paths. Next.js serves the CSS and JS bundles from # /_next/static/ and the optimized images from /_next/image, and Googlebot # needs both to render a page the way a visitor sees it. A robots.txt matcher # takes the most specific rule, not the first, so these two Allow lines carve # those subtrees out of the blanket Disallow below. The Mintlify robots.txt # under /docs already allows /_next/image for the same reason. Allow: /_next/static/ Allow: /_next/image Disallow: /_next/ Disallow: /static/ # Block development pages Disallow: /styleguide