Crawler Hints Update: Cloudflare Supports IndexNow and Announces General Availability

Cloudflare has announced updates to its Crawler Hints initiative, which aims to improve the efficiency of approximately 45% of internet traffic generated by web crawlers and bots. The service now supports IndexNow, a new protocol developed by Microsoft and Yandex that allows websites to notify search engines when content is created, updated, or deleted. Additionally, Crawler Hints is now generally available for all Cloudflare customers at no cost. By enabling Crawler Hints, users can benefit from more efficient crawls with a single button click in the Cache Tab of the Dashboard.