Cloudflare assessment
Cloudflare Pay Per Crawl Assessment
A Cloudflare assessment turns a preliminary content scan into a demand-aware pricing plan by comparing valuable resource groups with observed AI crawler requests.
The simple version
Cloudflare Pay Per Crawl works like a checkout counter for AI crawlers. A crawler asks for a page. Cloudflare checks your rule. If that crawler should pay, Cloudflare either lets a paying crawler through or returns a payment-required response with the price.
Classification shows what may be valuable
ClassifyToday identifies URL groups such as research, reports, data, products, and archives, then scores them for content value and discovery value.
Cloudflare shows what is being requested
When Cloudflare is connected, crawler analytics can reveal how many AI crawler requests reached each resource group over a recent period.
The output is a pricing plan
The assessment recommends whether each group should be free, charged, blocked, reviewed, fixed-price, or dynamic, with suggested starting ranges and clear caveats.
Quick answers
Common questions
How do I check if AI crawlers are visiting my Cloudflare site?
Cloudflare AI Crawl Control analytics can show AI crawler activity, including which services are requesting content and which paths they are accessing.
How do I decide what to charge AI crawlers in Cloudflare Pay Per Crawl?
Start by identifying high-value content groups, then compare those groups with Cloudflare crawler demand. Pricing should be based on both content value and actual crawler activity.
Can Cloudflare show which AI crawlers request specific URL paths?
Cloudflare AI Crawl Control analytics can be used to understand crawler activity and request patterns by characteristics such as path, crawler, status code, and time range.
Can a Cloudflare Pay Per Crawl assessment predict revenue?
It should not be treated as a revenue forecast. It can show scenarios based on observed crawler demand, but actual revenue depends on paid retrievals and crawler willingness to pay.
Does ClassifyToday replace Cloudflare Pay Per Crawl?
No. Cloudflare handles Pay Per Crawl enforcement and payment infrastructure. ClassifyToday helps classify content, recommend pricing, and manage pricing decisions.
Next step