Agents no longer have to guess URLs
Cloudflare has announced a Web Search API that lets AI agents search the internet. According to the company, agents currently tend to guess a page's URL and often hit 404 errors. Web search lets agents find relevant data the way humans start with a search engine query.
A live context layer
Language models are frozen at their training cutoff, which makes them weak on recent events, changing APIs, and fast-moving news. The Web Search API integrates directly into the inference pipeline, injecting fresh, structured snippets from the web into the model's context.
Partnership and bot rules
The launch begins with partners Ceramic.ai, Exa, and Linkup. Cloudflare says its partners have committed to its bot crawling standards: crawlers must meet verified bot requirements, respect robots.txt, and include links to sources in search results.
Using it via AI Gateway
The Web Search API is consumed through AI Gateway. Users can run searches with AI Gateway credits, see calls in normal observability logs, and control which providers are accessible. Cloudflare says it will flag partners supporting Zero Data Retention and offers the service at partner list pricing with no additional markup.
