crawl4ai MCP Server
unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
claude mcp add agentrank -- npx -y agentrank-mcp-server Overview
unclecode/crawl4ai is a Python tool licensed under Apache-2.0. Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Topics: ai, ai-agents, crawler, data-extraction, llm, markdown, mcp, open-source, playwright, python, rag, scraper, web-crawler, web-crawling, web-scraping.
Ranked #35 out of 24840 indexed tools.
In the top 1% of all indexed tools.
Has 84,228 GitHub stars.
Used by 3,288 other projects.
Has 95 contributors.
Actively maintained with commits in the last week.
Ecosystem
Score Breakdown
84,228 stars → extremely popular
Last commit today → actively maintained
1006/1195 issues closed → responsive maintainer
95 contributors → active community
3,288 dependents → widely adopted
275,656 weekly installs → widely installed
Weights: Freshness 20% · Issue Health 20% · Dependents 22% · Stars 10% · Contributors 8% · How we score →
Badge all embed codes →
[](https://agentrank-ai.com/tool/unclecode--crawl4ai/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) <a href="https://agentrank-ai.com/tool/unclecode--crawl4ai/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge"><img src="https://agentrank-ai.com/api/badge/tool/unclecode--crawl4ai" alt="AgentRank"></a> Matched Queries
From the README
# 🚀🤖 Crawl4AI: the open-source web crawler for LLMs and AI agents
<div align="center">
<a href="https://trendshift.io/repositories/11716" target="_blank"></a>
**Latest: [v0.9.4](https://github.com/unclecode/crawl4ai/releases/tag/v0.9.4) (23 Sep 2026)** · [all releases →](https://github.com/unclecode/crawl4ai/releases)
<a href="https://crawl4ai.com/?ref=readme-banner">
<picture>
<source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/unclecode/crawl4ai/main/docs/assets/cloud-launch-banner-dark.svg">
</picture>
</a>
</div>
Crawl4AI turns any website into clean, LLM-ready Markdown for RAG, AI agents and data pipelines. Run the open-source web crawler and scraper yourself, free forever, or use it hosted with one key: scrape, search and extract through one API, with MCP for your agent.
## Two ways to use Crawl4AI
### 🐍 Run it yourself: open source, forever
```bash
pip install -U crawl4ai
crawl4ai-setup # installs the browser, on Read full README on GitHub → Get the weekly AgentRank digest
Top movers, new tools, ecosystem insights — straight to your inbox.