Name: BitingSnakes/silkworm-mcp
Rating: 3.0 (1 reviews)
Author: BitingSnakes

BitingSnakes/silkworm-mcp

Score: 51.1 Rank #67

A full-featured MCP server for building asynchronous scrapers using Python

Overview

BitingSnakes/silkworm-mcp is a Python MCP server. A full-featured MCP server for building asynchronous scrapers using Python Topics: mcp, scrapers.

Ranked #67 out of 104 indexed tools.

Actively maintained with commits in the last week.

Ecosystem

Python No license

mcpscrapers

Score Breakdown

Stars 15% 3

3 stars → early stage

Freshness 25% today

Last commit today → actively maintained

Issue Health 25% 50%

No issues filed → no history to score

Contributors 10% 1

1 contributor → solo project

Dependents 25% 0

No dependents → no downstream usage

Forks 0

Description Good

License None

Weights: Freshness 25% · Issue Health 25% · Dependents 25% · Stars 15% · Contributors 10% · How we score →

How to Improve

Description low impact

Expand your description to 150+ characters for better discoverability

License low impact

Add an MIT or Apache-2.0 license to signal trust and enable adoption

Contributors medium impact

Single-contributor projects carry bus-factor risk — welcoming contributors boosts confidence

Badge

Markdown

[![AgentRank](https://agentrank-ai.com/api/badge/tool/BitingSnakes--silkworm-mcp)](https://agentrank-ai.com/tool/BitingSnakes--silkworm-mcp/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge)

HTML

<a href="https://agentrank-ai.com/tool/BitingSnakes--silkworm-mcp/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge"><img src="https://agentrank-ai.com/api/badge/tool/BitingSnakes--silkworm-mcp" alt="AgentRank"></a>

Embed Widget docs →

HTML

<script src="https://agentrank-ai.com/embed.js" data-tool="BitingSnakes/silkworm-mcp"></script>

Details

Stars: 3
Forks: 0
Open Issues: 0
Closed Issues: 0
Contributors: 1
Dependents: —
Language: Python
License: —
Last Commit: today

Matched Queries

"mcp server""mcp-server"

From the README

# silkworm-mcp

This is a full-featured MCP server for building scrapers with:

- [silkworm-rs](https://github.com/BitingSnakes/silkworm): async crawling, fetching, follow links, and spider execution
- [scraper-rs](https://github.com/RustedBytes/scraper-rs): fast Rust-backed HTML parsing with CSS and XPath selectors

It is designed for LLM-assisted scraper development, so the server exposes both low-level page inspection tools and higher-level workflow helpers for validating selector plans and generating starter spider code.

An example: https://github.com/BitingSnakes/silkworm-example

## Features

- Fetch pages through silkworm's regular HTTP client or CDP renderer.
- Query selectors directly against a CDP-rendered DOM snapshot.
- Extract structured records from live rendered pages before committing to a full crawl.
- Cache HTML in a local document store and reuse it via `document_handle`.
- Bound the document cache with max-document, max-bytes, and idle-TTL controls.
- Inspect pages

Read full README on GitHub →