Origin linter
A probe never writes the catalog. CiteFleet publishes only after dns-txt or well-known-file succeeds, and only if robots.txt still allows the agents named on the card.
Compiled from the 1.1 default: retrieve yes, train no, act no, TDM reserved. Copy them, then probe again.
Serve at /robots.txt as text/plain.
# robots.txt compiled from a BotCentral 1.1 card # domain: resonanse.app # consent: retrieve=true train=false act=false tdm=reserved # Control tokens (Google-Extended, Applebot-Extended) are listed even though they are not HTTP User-Agents. User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: cohere-training-data-crawler Disallow: / User-agent: DeepSeekBot Disallow: / User-agent: Diffbot Disallow: / User-agent: FacebookBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: GrokBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Amazonbot Allow: / User-agent: Bingbot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: cohere-ai Allow: / User-agent: DuckAssistBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Perplexity-User Allow: / User-agent: PerplexityBot Allow: / User-agent: YouBot Allow: / User-agent: * Allow: / Sitemap: https://resonanse.app/sitemap.xml