User-agent: * Disallow: /clockwork Disallow: /__clockwork Disallow: /horizon Disallow: /api/ # `/demo` signs in the demo tenant and redirects to `/` — the marketing # homepage's own URL, which then renders `noindex` because the visitor is a # demo user. A crawler carries the Set-Cookie through the redirect, so # following this link hands it the homepage URL marked noindex. Keep crawlers # off the whole prefix; the CTAs still work for people. Disallow: /demo # Allow important pages Allow: /docs/ Allow: /terms Allow: /privacy Allow: /llms.txt Sitemap: https://coderbuds.com/sitemap.xml # Coding agents: /llms.txt has the MCP endpoint and the exact connect command. # https://coderbuds.com/llms.txt