Cloudflare and OpenAI: making AI discovery better for everyone
Blog post from Cloudflare
Cloudflare and OpenAI report early results from a July 2026 research pilot that uses Cloudflare network signals to help OpenAI’s crawler discover useful web pages for ChatGPT Search, particularly valuable but lightly linked content such as manuals, local business details, and current public-service information. Using a participating cohort representing about 1% of Cloudflare’s network, the pilot reportedly enabled the discovery and indexing of hundreds of millions of new pages, while OpenAI independently evaluates their relevance and ranking. The companies are also testing signals to avoid crawling nonexistent, duplicate, redirected, unchanged, or potentially harmful pages, aiming to improve index quality, reduce unnecessary website load, and identify isolated compromised pages without penalizing entire domains. The next phase will refine page selection, change detection, and measurement of business outcomes, while emphasizing that discovery metadata does not authorize access or provide content for model training and that site owners retain control through Cloudflare’s AI Crawl Control.
No tracked trend matches for this post yet.
Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.