# robots.txt for unthinkableapp.com

Sitemap: https://unthinkableapp.com/sitemap.xml

User-agent: *
Allow: /

# ---------------------------------------------
# AI crawler policy is deliberately NOT set here
# ---------------------------------------------
# Cloudflare's managed robots.txt (AI Crawl Control) prepends the
# authoritative per-crawler directives, plus the Content-Signal policy
# (search=yes, ai-train=no, use=reference), to this file at the edge.
#
# This file previously repeated those crawlers with the OPPOSITE
# directive, so GPTBot, ClaudeBot, CCBot and Google-Extended each ended
# up with contradictory Allow and Disallow groups in the served file.
# Resolution of that conflict is implementation-defined per crawler,
# which is not something worth leaving to chance.
#
# To change what AI crawlers may do, use the dashboard, not this file:
#   Cloudflare > unthinkableapp.com > AI Crawl Control
#     Overview  -> Managed robots.txt      (emits the ai-train=no signal)
#     Security  -> per-crawler Block toggles
#   Cloudflare > Security > Bots
#     "Block AI bots" must stay on "Do not block" for the per-crawler
#     toggles above to have any effect.
#
# Categories in that dashboard are not always accurate: Claude-User is
# labelled "AI Crawler" despite being the user-triggered fetch agent,
# the direct equivalent of ChatGPT-User. Toggle crawlers by name.
#
# Do not re-add per-bot User-agent groups below.