Cloudflare launches Web Search API to ground AI agents in live data

Cloudflare's new Web Search API, now in beta, lets AI agents and applications search the internet for live information instead of guessing URLs or relying on a model's training cutoff. It offers three providers — Ceramic.ai, Exa, and Linkup — all supporting Zero Data Retention and verified bot crawling standards. Requests run through AI Gateway, appear in logs, and are billed at list price with no markup; you can also bring your own API key.
Web Search API lets your AI agents and applications search the Internet and ground their responses in live information, instead of guessing URLs or relying on a model's training cutoff.
- simonw
My number one question about search APIs is always if they allow you to store and resyndicate results you get from them.
If I'm running an agent system but I'm not allowed to store the responses - or provide a "share transcript" button - that's a pretty significant limitation.
The answer to that question is inevitably buried deep in the terms. Here's the relevant section I found for Ceramic, in their list of things you can't do:
> (n) collect, aggregate, store, or compile Output, including search results, relevance scores, or rankings, for the purpose of creating or contributing to any database, dataset, index, or corpus, whether or not such database, dataset, index, or corpus is used for a purpose that competes with Ceramic; (o) resell, syndicate, or otherwise make Output available to any third party on a standalone basis or as a separately accessible component of another product or service; provided that you may display Output to your authorized end users within your own application so long as such Output is integrated into your application's functionality, is incident to the end user’s real-time query, and is not independently accessible, extractable, or downloadable by end users or third parties; or (p) retain, cache, or store Output beyond what is reasonably necessary to display such Output to your authorized end users in the ordinary and real-time course of use, unless expressly permitted in an applicable Order Form.
https://www.ceramic.ai/terms-of-service
Am I alone in […]
- iphonecorridor
For those developers out there, the best is still Gemini Flash Lite 2.5 believe it or not. It gives you 1000 google searches per day for free. Compare to Flash Lite 3.x which is 5k PER MONTH and then a few pennies PER SEARCH. Nuts. Didn’t realize search was so expensive.
Perhaps realizing all of this, Google hasn’t yet deprecated 2.5, bit limits access to it to “those who have used it before.”
It’s really really good for low cost search!
- binarymax
Why not use those providers directly? Does Cloudflare need to be in the middle of everything?
- 1vuio0pswjnm7
Explore Cloudflare's services without the web page bloat:
https://developers.cloudflare.com/llms.txt
As a textmode command line and text-only browser user this textfile is easier for me to use that the usual Silicon Valley style web pages
Not quite as good as sitemap-0.xml but it's nice to have this in addition
- daft_pink
Wow, will they offers some sort of reduce a web page into a markdown file api as welL so we can get full web pages at reduced token sizes?
- asjq178
Cloudflare protects against bots, Cloudflare sells out its customers to AI scrapers.
MITM service, Internet gatekeeper and robber baron.
- sreekanth850
Create bot detection and bot protection, then sell crawlers. Is this the peak of hypocrisy?
- jasonjmcghee
> All three support Zero Data Retention for requests made through Cloudflare
And then on the providers page:
Property Value
provider exa
Zero Data Retention No