robotstxt-ai-mcp by sharozdawa
23 score
Analyze and generate robots.txt files with AI crawler awareness. Fetch any site's robots.txt, detect which AI bots (GPTBot, ClaudeBot, PerplexityBot, Google-Extended) are blocked or allowed, and generate optimized robots.txt with toggle controls for 20+ AI crawlers.
Ranked #1383 out of 1672 indexed skills.
Is this your tool? Claim this listing to add maintainer context, get a verified badge, and unlock analytics.
Claim listing → Signal Breakdown
Installs 0
Freshness GitHub not linked
Issue Health GitHub not linked
Stars GitHub not linked
Platform Breadth 1 platform
Contributors GitHub not linked
Description Detailed
How to Improve
Platforms medium impact
Badge
[](https://agentrank-ai.com/skill/glama-sharozdawa--robotstxt-ai/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge) <a href="https://agentrank-ai.com/skill/glama-sharozdawa--robotstxt-ai/?utm_source=badge&utm_medium=readme&utm_campaign=agentrank_badge"><img src="https://agentrank-ai.com/api/badge/skill/glama-sharozdawa--robotstxt-ai" alt="AgentRank"></a>