# Hanzo Crawl - AI-Ready Web Crawler > Turn any website into clean, structured Markdown for LLMs. JavaScript rendering, parallel crawling, structured extraction. Powered by crawl4ai. AI-Ready Web Crawler # Hanzo Crawl Give it a URL, get back Markdown [Read the docs](https://docs.hanzo.ai/docs/openapi/crawl/)[GitHub](https://github.com/hanzoai) Crawl — Hanzo [Chat](https://hanzo.ai/cloud/chat)[Bot](https://hanzo.ai/bot)[Search](https://hanzo.ai/search)[Crawl](https://hanzo.ai/crawl)[Studio](https://hanzo.ai/studio)[Console](https://hanzo.ai/console)[Referrals](https://hanzo.ai/cloud/referrals)[Marketplace](https://hanzo.ai/cloud/marketplace) - $hanzo - >deploy the gateway to staging - ·reading the project - ✓gateway is on staging `api.hanzo.ai/v1/crawl`[Open in the console](https://hanzo.ai/home) Example project. Every name in it is one you would give your own. JSFull rendering ParallelHigh throughput LLMStructured extraction MDClean Markdown Paste and ship Paste this into any agent. It reads the skill manifest and calls Crawl from there. Agent promptapi /v1/crawlCopy ``` Read https://hanzo.ai/skill.md and use Hanzo Crawl in my project. Start with: hanzo crawl create ``` ## Three steps, and a boundary Fetch, extract, render. Then the part that matters when the URL comes from a stranger. ### The readable part, not the page Deciding which subtree is the article is the hard problem, and it is the one this solves. You get the content and what the page says about itself, without the chrome around it. ### A browser only when needed Most pages are a fetch and a parse. Headless Chromium is a separate service it escalates to for the ones that genuinely need rendering, so you do not pay browser cost for a documentation page. ### Markdown, and the metadata Headings stay headings and links keep their targets, resolved against the page they came from. Title, description and canonical URL come back alongside — including the URL after redirects, which is the one worth citing. ### It cannot be pointed at your cluster The caller supplies the URL, which makes any crawler a request-forgery primitive. Loopback, link-local and multicast are refused — including the cloud metadata endpoint on 169.254.169.254 that hands out credentials. ### Every redirect is checked too Blocking the first address is not enough, because a public URL can redirect to a private one. The guard sits on the dialer, so a 302 toward metadata is refused at the hop that matters. ### A tool an agent can call It answers on MCP as well as over HTTP, so a model can read a page mid-conversation without you building the plumbing for it. ## How it works Each step is its own file and can be tested without the other two. Step 01 ### Fetch One guarded HTTP request. The dialer refuses private and link-local addresses on every hop, so a URL that redirects somewhere it should not reach is stopped there rather than after the fact. Step 02 ### Extract The document is reduced to the subtree a reader would call the content, plus the title, description and canonical URL the page claims for itself. If the HTML alone is not enough, this is where a headless browser gets involved. Step 03 ### Render That subtree becomes Markdown with its structure intact — headings, lists, code and links, with relative URLs resolved against the page. It is the format a model reads best and a person can still diff. ## Two ways to call it Over HTTP at /v1/crawl when your code is doing the asking, or over MCP when a model is. Static SitesSPAsDocumentationE-CommerceForumsREST API ## Pricing You are paying for the hosted API and the browsers behind it, not for the code. ### Build $49/mo - 50,000 pages/month - 5 concurrent crawlers - JavaScript rendering - Markdown + structured output - REST API access [Read the docs](https://docs.hanzo.ai/docs/openapi/crawl/) ### Scale $499/mo - 500,000 pages/month - 25 concurrent crawlers - Priority JS rendering - LLM-based extraction - Direct Search + Vector integration [Read the docs](https://docs.hanzo.ai/docs/openapi/crawl/) ### Enterprise Custom - Unlimited pages - Unlimited concurrent crawlers - Dedicated rendering pool - Custom extraction schemas - Dedicated support + SLA [Contact Sales](https://hanzo.ai/contact-sales) The crawler is open source, and so is the headless-browser image it escalates to. Run both yourself for nothing. The plans buy you somebody else operating them. Open source royalty ### 20% to the author of the code that runs Verify that you own a repository, and every org that deploys a project built from it pays you 20% of its metered spend, accrued each period. [How authors are paid](https://hanzo.ai/oss)[Our repositories](https://hanzo.ai/open-source) Hanzo Crawl ## Send it a URL One call, and the page comes back as Markdown. From your code over HTTP, or from a model over MCP. [Read the docs](https://docs.hanzo.ai/docs/openapi/crawl/)[View on GitHub](https://github.com/hanzoai) Related capabilities [ChatConversational AI](https://hanzo.ai/cloud/chat)[BotMulti-agent platform](https://hanzo.ai/bot)[SearchRetrieval & answers](https://hanzo.ai/search) ## Get Crawl Crawl, scrape, and embed License: Apache-2.0[hanzoai](https://github.com/hanzoai) [Deploy to Cloud](https://platform.hanzo.ai/deploy)