DisclarionBot

DisclarionBot is the crawler of Disclarion Connect, operated by Disclarion. It only visits websites whose owners connected them to Disclarion Connect and verified that they control the domain.

User agent

DisclarionBot/1.0 (+https://www.disclarion.com/bot)

What it fetches

• robots.txt and the sitemaps the site lists.
• Public pages on the connected domain, as static HTML. It runs no JavaScript, submits no forms and never logs in.
• Images those pages reference, including images served from other hosts such as a CDN.

It keeps hashes, page addresses without query strings, page titles and image metadata such as C2PA Content Credentials. It does not keep page text or image files.

robots.txt

DisclarionBot follows robots.txt (RFC 9309) on every host it fetches from, pages and image hosts alike. It uses the rules for DisclarionBot if there are any, otherwise the rules for *. If a host's robots.txt can't be loaded because of a server error or timeout, it fetches nothing from that host.

How to block it

To block DisclarionBot from your whole site, add this to your robots.txt:

User-agent: DisclarionBot
Disallow: /

To block only part of it:

User-agent: DisclarionBot
Disallow: /drafts/

Rate

One request at a time per host, at least 0.5 seconds apart. A Crawl-delay in robots.txt is honored up to 5 seconds.

Contact

Questions or problems with DisclarionBot: hello@disclarion.com.