InnerVault

ActableSite AI Crawler Monitor

Stale Official MCP Registry, com.actablesite

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Open the source (opens github.com) https://github.com/unitedideas/actablesite-mcp

Before you use it

  • Runs on someone else's server: what you send it leaves your machine.
  • Marked deprecated in the MCP Registry.

What it is

MCP servers from com.actablesite.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Remote endpoint (streamable-http)

https://actablesite.com/mcp

From the server's entry in the official MCP Registry

Related

  1. Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

    Stale Official MCP Registry, com.actablesite Updated 4 months ago 1 note

  2. doc-scraper

    MCP servers

    Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)

    Indexed GitHub, Sriram-PR 109 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/Sriram-PR/doc-scraper.git
  3. Crawlerpeek

    MCP servers

    Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only.

    Stale Official MCP Registry, io.github.crawlerpeek Updated 18 days ago 1 note

    crawlerpeek@0.3.1
  4. ai-crawler-policy

    MCP servers

    Cloudflare Workers MCP server: ai-crawler-policy

    Stale Official MCP Registry, io.github.lazymac2x Updated 6 months ago 1 note

  5. graphlit-mcp-server

    MCP servers

    Model Context Protocol (MCP) Server for Graphlit Platform

    Stale GitHub, graphlit 378 ★MITUpdated 10 months ago

    git clone https://github.com/graphlit/graphlit-mcp-server.git
  6. Open SEO Crawler

    MCP servers

    Self-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages.

    Stale Official MCP Registry, io.github.puneetindersingh Updated 31 days ago 1 note

    https://github.com/puneetindersingh/open-seo-crawler/releases/download/mcp-v1.0.0/open-seo-crawler-mcp.mcpb@1.0.0