mdnew
Fetch clean Markdown from any URL using the markdown.new three-tier conversion pipeline (Header Negotiation -> Workers AI -> Browser Rendering).
Usage
Run the script with a target URL:
python3 scripts/mdnew.py <url>
Why use mdnew?
- Token Efficiency: Reduces content size by up to 80% compared to raw HTML.
- Clean Data: Strips boilerplate, ads, and nav menus, leaving only core content.
- JS Execution: Automatically handles JS-heavy pages via Cloudflare Browser Rendering fallback.
- Agent-First: Includes
x-markdown-tokenstracking to help manage context windows.