Website to Markdown
Web pages and whole sites to clean Markdown for RAG and AI agents. Crawls links and sitemaps.
Open the source (opens apify.com) https://apify.com/sauliusautomatesit/website-content-crawler-api
Before you use it
- Runs on someone else's server: what you send it leaves your machine.
What it is
MCP servers from io.github.saulius876-lgtm.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Remote endpoint (streamable-http)
https://mcp.apify.com/?tools=sauliusautomatesit/website-content-crawler-api
From the server's entry in the official MCP Registry
Related
-
Apify MCP server
MCP serversLets an agent run Apify's ready-made scrapers to pull data from websites, search engines, maps and social platforms.
-
Web Scraper & Crawler for RAG (Markdown)
MCP serversWebsite to clean Markdown or JSON for AI and RAG: read pages, crawl sites, extract described fields.
-
Playwright MCP
MCP serversLets an agent drive a real browser: open pages, click, fill in forms and read what's on screen.
claude mcp add playwright npx @playwright/mcp@latest -
Front-End Checklist
MCP serversReview frontend code and live pages against 386 quality-gated web development rules.
-
Frontend Design Loop MCP
MCP serversDesign-first MCP for coding agents that improves websites with screenshot-grounded iteration.
frontend-design-loop-mcp@1.0.0 -
Pagewatch
MCP serversRead a URL as clean markdown, screenshot a website, url to PDF. Web access for agents, no signup.
pagewatch-mcp@0.1.0