better-crawler4agent MCP Server
TC635807/better-crawler4agent
[](https://agentrank-ai.com/tool/TC635807--better-crawler4agent/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) When I was using agents, I found that most agents rely on curl commands to scrape web pages, which has a very low success rate and is slow, so I made this.
claude mcp add agentrank -- npx -y agentrank-mcp-server Overview
TC635807/better-crawler4agent is a Python tool licensed under MIT. When I was using agents, I found that most agents rely on curl commands to scrape web pages, which has a very low success rate and is slow, so I made this.
Ranked #12144 out of 24846 indexed tools.
Ecosystem
Score Breakdown
2 stars → early stage
Last commit 20d ago → recently updated
No issues filed → no history to score
0 contributors → solo project
No dependents → no downstream usage
Weights: Freshness 20% · Issue Health 20% · Dependents 22% · Stars 10% · Contributors 8% · How we score →
How to Improve
Matched Queries
Get the weekly AgentRank digest
Top movers, new tools, ecosystem insights — straight to your inbox.