anansi MCP Server
mdowis/anansi
[](https://agentrank-ai.com/tool/mdowis--anansi/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent identity layer (Chrome TLS fingerprints, matched personas, vendor-aware Cloudflare/Akamai/DataDome handling) works to slip past bot detection. Ships with an MCP server so any LLM can drive a full crawl by conversation.
claude mcp add agentrank -- npx -y agentrank-mcp-server Overview
mdowis/anansi is a Python MCP server licensed under Apache-2.0. A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent identity layer (Chrome TLS fingerprints, matched personas, vendor-aware Cloudflare/Akamai/DataDome handling) works to slip past bot detection. Ships with an MCP server so any LLM can drive a full crawl by conversation. Topics: adaptive-scraping, ai-agent, anti-bot, crawler, data-extraction, llm-tools, mcp, mcp-server, pydantic, python, self-healing, stealth-browser, tls-fingerprint, web-scraper, web-scraping, concurrent-processing.
Ranked #5012 out of 24846 indexed tools.
Ecosystem
Score Breakdown
117 stars → growing community
Last commit 2mo ago → moderate activity
17/17 issues closed → responsive maintainer
2 contributors → solo project
No dependents → no downstream usage
4 weekly installs → early adoption
Weights: Freshness 20% · Issue Health 20% · Dependents 22% · Stars 10% · Contributors 8% · How we score →
How to Improve
Badge all embed codes →
[](https://agentrank-ai.com/tool/mdowis--anansi/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) <a href="https://agentrank-ai.com/tool/mdowis--anansi/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge"><img src="https://agentrank-ai.com/api/v1/badge/mdowis--anansi" alt="AgentRank"></a> Matched Queries
From the README
> *The spider that learns.* **A self-healing web scraper for hostile sites — and it's driveable by any LLM.** Every scraper starts working. The question is how long before it breaks. Anansi is built on a different assumption: the web is adversarial and unstable, and your scraper should handle that without your involvement. When a site changes its layout, Anansi finds the data anyway and **remembers the fix**. When a page needs a browser to render, it **switches to one silently**. When bot detection gets in the way, it presents a **coherent identity** — matched TLS fingerprint, persona, and headers — that works to slip past detection instead of tripping it. And when you re-crawl, unchanged pages are skipped before a request is even made. The result is a crawler that survives redesigns, handles hostile sites, and gets better the longer it runs. Ships with an **[MCP server](docs/mcp.md)** so any LLM can drive a full crawl through conversation. --- ## Highlights - **Selectors that rRead full README on GitHub →
Get the weekly AgentRank digest
Top movers, new tools, ecosystem insights — straight to your inbox.