# Cloudflare and OpenAI say pilot brought hundreds of millions of pages into index

- Published: 2026-10-15T13:00:00.000Z
- Updated: 2026-10-16T10:05:49.518Z
- Section: AI in practice
- Topics: Research, RAG
- Page: https://aidailyjournal.com/en/n/2026/10/15/cloudflare-and-openai-say-pilot-brought-hundreds-of-millions-of-pages-into-index/
- Sources: [Cloudflare](https://blog.cloudflare.com/cloudflare-openai-discovery-agentic-web)

## Summary

Cloudflare and OpenAI say a research pilot launched in July 2026 led OpenAI to discover and index hundreds of millions of new pages. The project used signals from Cloudflare’s network—with a cohort representing about 1% of its total network—to help the search crawler find potentially useful content; OpenAI then independently evaluates and ranks the pages for display in ChatGPT Search.

According to Cloudflare, the initiative also revealed patterns associated with nonexistent pages, broad redirects and duplicate content, allowing the companies to reduce unnecessary requests before the crawler fetches a page. They are also testing signals to identify potentially harmful pages as an additional layer for safer, more reliable discovery.

## Why it matters (editorial interpretation)

The partnership could influence how web content is discovered and filtered for display in ChatGPT Search by combining infrastructure signals with independent evaluation. Because the pilot involved a cohort representing about 1% of Cloudflare’s network, its reach should still be understood within that scope.

_Summary written by AI Daily Journal in its own words, based on the sources above. For details, read the original articles._