InnerVault

Unrendered: AI Crawler Checker

Stale Official MCP Registry, io.github.missiongrowth

AI crawler checker: shows which page content GPTBot and ClaudeBot can't read without JavaScript.

Open the source (opens github.com) https://github.com/missiongrowth/unrendered-ai-crawler-checker-mcp

Before you use it

  • Runs on your computer with your permissions. Read what it can do before connecting it to an agent.

What it is

MCP servers from io.github.missiongrowth.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

npm package (stdio)

unrendered-mcp@0.1.4

From the server's entry in the official MCP Registry

Related

  1. robots.txt tester (RFC 9309), AI crawler access (GPTBot, ClaudeBot...) and sitemap check.

    Stale Official MCP Registry, dev.workers.quietworklabs.robots-check Updated 29 days ago 1 note

  2. Shows if GPTBot, ClaudeBot, PerplexityBot and other AI crawlers can read each site in a list.

    Stale Official MCP Registry, io.github.Nero-Engine Updated 15 days ago 1 note

  3. Check declared robots.txt permissions for six AI crawlers at URL paths

    Stale Official MCP Registry, io.github.kriton-dev Updated 13 days ago 1 note

  4. Technical SEO audit crawler: broken links, 404s, redirects, titles, canonicals. Runs on Apify.

    Stale Official MCP Registry, io.github.stellalytics Updated 3 days ago 1 note

  5. AI Visibility Checker

    MCP servers

    AI visibility checker: GPTBot vs OAI-SearchBot, robots.txt audit, raw-HTML schema. 165 crawlers.

    Stale Official MCP Registry, io.github.krisdiallo Updated 2 months ago 1 note

    https://github.com/krisdiallo/ecom-agent/releases/download/v1.5.3/aivis.mcpb@1.5.3
  6. AI Bot Access Checker

    MCP servers

    Checks if GPTBot, ClaudeBot, PerplexityBot, Googlebot and 9 more AI crawlers can reach a page.

    Stale Official MCP Registry, io.seopaslaugos Updated 4 days ago 1 note