InnerVault

Website Crawler — Markdown Pages, Sitemaps & RAG Provenance

Stale Official MCP Registry, io.github.kriton-dev

Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay

Open the source (opens apify.com) https://apify.com/hermeskd/website-to-markdown

Before you use it

  • Runs on someone else's server: what you send it leaves your machine.

What it is

MCP servers from io.github.kriton-dev.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Remote endpoint (streamable-http)

https://mcp.apify.com/?tools=hermeskd/website-to-markdown

From the server's entry in the official MCP Registry

Related

  1. Website to clean Markdown or JSON for AI and RAG: read pages, crawl sites, extract described fields.

    Stale Official MCP Registry, io.github.ByteBlisk Updated 8 days ago 1 note

  2. Apify MCP server

    MCP servers

    Lets an agent run Apify's ready-made scrapers to pull data from websites, search engines, maps and social platforms.

    Hand-checked InnerVault (hand-checked), Apify 16.0k ★MIT

  3. Playwright MCP

    MCP servers

    Lets an agent drive a real browser: open pages, click, fill in forms and read what's on screen.

    Hand-checked InnerVault (hand-checked), Microsoft Apache-2.0

    claude mcp add playwright npx @playwright/mcp@latest
  4. Crawl a website into clean Markdown for LLMs/RAG: main content only, linked docs converted.

    Stale Official MCP Registry, io.github.prometheus-maker Updated 10 days ago 1 note

  5. Turn a website into Markdown with headings, links and word counts.

    Stale Official MCP Registry, io.github.bepolabs Updated 4 days ago 1 note

  6. doc-scraper

    MCP servers

    Go web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)

    Indexed GitHub, Sriram-PR 109 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/Sriram-PR/doc-scraper.git