Unrendered: AI Crawler Checker
AI crawler checker: shows which page content GPTBot and ClaudeBot can't read without JavaScript.
Open the source (opens github.com) https://github.com/missiongrowth/unrendered-ai-crawler-checker-mcp
Before you use it
- Runs on your computer with your permissions. Read what it can do before connecting it to an agent.
What it is
MCP servers from io.github.missiongrowth.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
npm package (stdio)
unrendered-mcp@0.1.4
From the server's entry in the official MCP Registry
Related
-
Robots.txt & AI Crawler Checker
MCP serversrobots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.
-
AI Crawler Access Checker
MCP serversShows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.
-
Check declared robots.txt permissions for six AI crawlers at URL paths
-
Technical SEO audit crawler: broken links, 404s, redirects, titles, canonicals. Runs on Apify.
-
AI Visibility Checker
MCP serversAI visibility checker: GPTBot vs OAI-SearchBot, robots.txt audit, raw-HTML schema. 165 crawlers.
https://github.com/krisdiallo/ecom-agent/releases/download/v1.5.3/aivis.mcpb@1.5.3 -
AI Bot Access Checker
MCP serversChecks if GPTBot, ClaudeBot, PerplexityBot, Googlebot and 9 more AI crawlers can reach a page.