# robots.txt for Ghaseel Production # Canonical site: https://www.ghaseel.com (apex redirects to www) # LLM context: https://www.ghaseel.com/llms.txt User-agent: * Allow: / Disallow: /admin/ Disallow: /business/ Disallow: /driver/ Disallow: /api/ User-agent: Google-Extended Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / # Note: Staging environment (test.ghaseel.com) is protected via: # - X-Robots-Tag HTTP header # - Meta robots tag in HTML # - Dynamic robots.txt API route (/api/robots.txt) Sitemap: https://www.ghaseel.com/sitemap.xml