DDCheckBot — about our crawler

1Who we are

DDcheck runs business-verification (KYB) and sanctions-screening checks. To answer a check we read public company registers, sanctions and watch lists, and regulator publications — the same pages a compliance analyst would open by hand. We do not crawl the open web at large, and we do not collect personal data beyond what those official sources publish about companies and their officers.

2How to recognise us

Every outbound request carries this User-Agent:

DDCheckBot/1.0 (+https://ddcheck.net/bot; compliance data collection; [email protected])

We do not imitate a browser and we do not rotate identities to look like different visitors. If a request to your site does not carry that string, it is not us.

3How we behave

robots.txt is read and obeyed. A path you disallow is a verdict, not an obstacle: we do not route around it.
Rate limits are honoured. We respect Retry-After; a repeated 429 or a sudden 403 stops the run rather than triggering retries.
No captcha solving, no login walls. If a source distinguishes robots from people, that is its right, and we treat the closed path as closed.
Volume is small and spread out. Checks are driven by individual customer requests; scheduled bulk refreshes start inside a randomised window rather than on the hour, and their size is set from the rate we measured on your site.

4How to limit or block us

Any of these works, and none of them needs our involvement:

# Ask us to stay out entirely
User-agent: DDCheckBot
Disallow: /

# Or keep us out of one area only
User-agent: DDCheckBot
Disallow: /search

# Or just ask us to come more slowly
User-agent: DDCheckBot
Crawl-delay: 10

Returning 429 with a Retry-After header has the same effect and takes effect immediately.

5Talking to a person

If something we did looks wrong — unexpected load, a page we should not have fetched, or a request that did not identify itself as above — tell us here. The timestamp and the path are enough. A message about our crawling is not a support ticket in a queue behind paying customers, and you do not need an account with us to send one.