User-agent: GPTBot
Disallow: /

User-agent: *
Allow: /
Disallow: /terms/
Disallow: /privacy_policy/


Sitemap: https://crocoder.dev/sitemap.xml