InnerVault

Crawl Census

Stale Official MCP Registry, io.github.taylorsmithgg

Ask before you fetch: will this domain serve your crawler, refuse it, or charge it?

Open the source (opens github.com) https://github.com/taylorsmithgg/crawl-census-client

Before you use it

  • Runs on someone else's server: what you send it leaves your machine.

What it is

MCP servers from io.github.taylorsmithgg.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Remote endpoint (streamable-http)

https://crawlcensus.com/mcp

From the server's entry in the official MCP Registry

Related

  1. webclaw

    MCP servers

    Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

    Stale GitHub, 0xMassi 2,380 ★AGPL-3.0Updated 33 days ago

    git clone https://github.com/0xMassi/webclaw.git
  2. firecrawl-mcp-server

    MCP servers

    Official Firecrawl MCP server, the context API for AI agents: search, scrape, and interact with the web, plus parse, crawl, map, Agent and Monitor, from any MCP client.

    Indexed GitHub, firecrawl 7,836 ★MITUpdated today

    git clone https://github.com/firecrawl/firecrawl-mcp-server.git
  3. fastCRW

    MCP servers

    Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.

    Stale Official MCP Registry, io.github.us Updated 4 months ago 1 note

  4. Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay

    Stale Official MCP Registry, io.github.kriton-dev Updated 14 days ago 1 note

  5. olostep-mcp-server

    MCP servers

    MCP server for Olostep — the web scraping, crawling, and search infrastructure used by top AI companies. Gives any MCP-compatible AI agent the ability to scrape, crawl, batch-extract, and search the web in real time.

    Stale GitHub, olostep 25 ★MITUpdated 6 days ago

    git clone https://github.com/olostep/olostep-mcp-server.git
  6. seo-crawler-mcp

    MCP servers

    Crawl and analyse websites for SEO errors using Crawlee with SQLite storage

    Stale Official MCP Registry, io.github.houtini-ai Updated 9 months ago 1 note

    @houtini/seo-crawler-mcp@2.0.1