Bot verification is confirming that a request claiming to be a crawler really came from its vendor — by checking the source IP against the vendor's published ranges, or by reverse DNS with forward confirmation.
Scrapers borrow crawler names. A CDN that allows "GPTBot" by name lets them in; one that allows OpenAI's IP ranges does not.
OpenAI, Google and Perplexity publish JSON feeds of their ranges; Anthropic documents a CIDR; Amazon and Apple document reverse DNS.
Checked by Reflexa: Is your CDN or bot filter challenging AI crawlers? — part of the 23 checks on every page check.
Bot verification is confirming that a request claiming to be a crawler really came from its vendor — by checking the source IP against the vendor's published ranges, or by reverse DNS with forward confirmation.
Scrapers borrow crawler names. A CDN that allows "GPTBot" by name lets them in; one that allows OpenAI's IP ranges does not.
OpenAI, Google and Perplexity publish JSON feeds of their ranges; Anthropic documents a CIDR; Amazon and Apple document reverse DNS. The free tool does it for you →
The free page check runs the 23 checks on your public pages — the terms on this page, observed on your pages.