RAG Documentation Scraper
Crawl any documentation site and return heading-bounded, LLM-ready chunks with source metadata.
Open the source (opens github.com) https://github.com/lernowaadmin/rag-docs-scraper
Before you use it
- Runs on your computer with your permissions. Read what it can do before connecting it to an agent.
- Needs credentials: APIFY_TOKEN. Use a key with the least access you can.
What it is
MCP servers from io.github.LernowaAdmin.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
npm package (stdio)
rag-docs-scraper-mcp-server@1.0.0
From the server's entry in the official MCP Registry
Settings it asks for
APIFY_TOKENsecret required · Your Apify API token — https://console.apify.com/account/integrations
Related
-
doc-scraper
MCP serversGo web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
git clone https://github.com/Sriram-PR/doc-scraper.git -
Apify MCP server
MCP serversLets an agent run Apify's ready-made scrapers to pull data from websites, search engines, maps and social platforms.
-
Web Scraper & Crawler for RAG (Markdown)
MCP serversWebsite to clean Markdown or JSON for AI and RAG: read pages, crawl sites, extract described fields.
-
ScraperWatch
MCP serversFind and compare named scrapers using saved evidence; compare APIs, proxies and RAG extractors.
-
Web Scraper to Markdown API
MCP serversExtract clean markdown from any URL. Removes boilerplate. For RAG pipelines. x402.
-
TheCrawler
MCP serversUniversal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support.
thecrawler@0.5.8