hreflang.com-bot

hreflang.com-bot fetches pages when someone runs an hreflang check on hreflang.com. Every fetch follows from a check somebody started. The crawler does not crawl on its own schedule.

hreflang.com-bot/1.0 (+https://hreflang.com/bot)

robots.txt

The crawler honours robots.txt for both Googlebot and hreflang.com-bot. A URL Googlebot is not allowed to fetch is reported as blocked rather than fetched, which matches what Google sees. Crawl-delay is honoured when set.

User-agent: hreflang.com-bot
Disallow: /

Rate

Requests go out one at a time per host, at most one per second, with backoff on 429 and 5xx responses and Retry-After honoured. A host returning repeated errors is paused for the rest of the check.