Cloudflare has introduced a new metric on its Radar platform to help content publishers understand how AI-powered crawlers and bots impact internet traffic. The metric, called the "AI Insights" page, displays ratios of aggregate HTML page requests from crawlers associated with a given platform to the number of HTML page requests from clients referred by a hostname associated with that same platform. This allows site owners to see how often an AI model sends traffic to a site compared to how often it crawls that site, providing insights into the viability of content publication on the Internet. The metric is calculated by dividing the total number of requests from relevant user agents associated with a given search or AI platform where the response was of Content-type: text/html by the total number of requests for HTML content where the Referer header contained a hostname associated with that same search or AI platform. The data shows that AI applications often make more requests to crawl content than they send in traffic, which can impact the viability of content publication. Cloudflare has also launched expanded Verified Bots content on its Radar platform, providing a directory of verified bots and tools for site owners to block unwanted crawlers. This new metric and expanded bot verification capabilities aim to provide better information to help site owners make decisions about which AI bots to allow or block and how to ensure fair exchange of value between content creators and AI developers.