Cloudflare and OpenAI say pilot brought hundreds of millions of pages into index
🎧 Listen to this story
Cloudflare and OpenAI say a research pilot launched in July 2026 led OpenAI to discover and index hundreds of millions of new pages. The project used signals from Cloudflare’s network—with a cohort representing about 1% of its total network—to help the search crawler find potentially useful content; OpenAI then independently evaluates and ranks the pages for display in ChatGPT Search.
According to Cloudflare, the initiative also revealed patterns associated with nonexistent pages, broad redirects and duplicate content, allowing the companies to reduce unnecessary requests before the crawler fetches a page. They are also testing signals to identify potentially harmful pages as an additional layer for safer, more reliable discovery.
Why it matters · editorial interpretation
The partnership could influence how web content is discovered and filtered for display in ChatGPT Search by combining infrastructure signals with independent evaluation. Because the pilot involved a cohort representing about 1% of Cloudflare’s network, its reach should still be understood within that scope.
Sources
ResearchRAG