Website Crawler (SEO)
Crawl a website from Claude and get a scored technical SEO report with a prioritised fix list.
Open the source (opens crawler.tidybutton.com) https://crawler.tidybutton.com
Before you use it
- Runs on someone else's server: what you send it leaves your machine.
What it is
MCP servers from com.tidybutton.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Remote endpoint (streamable-http)
https://crawler.tidybutton.com/mcp
From the server's entry in the official MCP Registry
Related
-
Web Scraper & Crawler for RAG (Markdown)
MCP serversWebsite to clean Markdown or JSON for AI and RAG: read pages, crawl sites, extract described fields.
-
Playwright MCP
MCP serversLets an agent drive a real browser: open pages, click, fill in forms and read what's on screen.
claude mcp add playwright npx @playwright/mcp@latest -
Website to Markdown Crawler
MCP serversCrawl a website into clean Markdown for LLMs/RAG: main content only, linked docs converted.
-
Turn a website into Markdown with headings, links and word counts.
-
Crawl sites to Markdown with sitemaps, globs and depth limits, obeying robots and crawl-delay
-
doc-scraper
MCP serversGo web crawler to scrape documentation sites and convert content to clean Markdown for LLM ingestion (RAG, training data)
git clone https://github.com/Sriram-PR/doc-scraper.git