Cloudflare Markdown for Agents
This skill enables fetching web content using Cloudflare's Markdown for Agents protocol, which automatically converts HTML pages to clean, structured Markdown format.
What is Markdown for Agents?
Cloudflare's Markdown for Agents is a content negotiation feature that:
- Automatically converts HTML to Markdown at the edge
- Reduces token usage by ~80% compared to raw HTML
- Returns clean, structured content perfect for AI processing
- Adds
x-markdown-tokensheader showing estimated token count - Includes
Content-Signalheaders for AI usage permissions
Usage
Basic Fetch
Use the provided script to fetch any URL with Markdown for Agents support:
scripts/fetch-markdown.sh <URL>
Example:
scripts/fetch-markdown.sh "https://developers.cloudflare.com/agents/"
In Code
TypeScript/JavaScript example:
const response = await fetch("https://example.com/page", {
headers: {
Accept: "text/markdown, text/html",
},
});
const tokenCount = response.headers.get("x-markdown-tokens");
const markdown = await response.text();
cURL example:
curl https://example.com/page -H "Accept: text/markdown"
Response Headers
content-type: text/markdown; charset=utf-8- Content is Markdownx-markdown-tokens: <number>- Estimated token countcontent-signal: ai-train=yes, search=yes, ai-input=yes- Usage permissions
Supported Sites
Any site using Cloudflare with Markdown for Agents enabled:
- Cloudflare Developer Documentation (developers.cloudflare.com)
- Cloudflare Blog (blog.cloudflare.com)
- Any site with the feature enabled in Cloudflare dashboard
Benefits
| Aspect | HTML | Markdown |
|---|---|---|
| Tokens | 16,180 | 3,150 |
| Reduction | - | ~80% |
| Structure | Complex | Clean |
| AI Parsing | Hard | Easy |
References
- Full protocol details: references/protocol.md
- API examples: references/examples.md