Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to research potential clients
-
pagerender
MCP serversWhat crawlers see from any URL, plus page lookups and content editing for your Pagerender sites.
@pagerender/mcp@1.3.0 -
alice
MCP serversAudit any site's AI visibility from your assistant: crawler access, rendering, and schema.
-
web-shooter
MCP serversFast, low-token web reader and focused crawler. Returns ranked passages, not whole pages.
web-shooter@0.2.0 -
Scraperapi
MCP serversScraperAPI MCP — wraps ScraperAPI (scraperapi.com), a proxy-based web scraper with structured-data…
@pipeworx/mcp-scraperapi@0.2.1 -
ScraperApi
Public APIsEasily build scalable web scrapers
-
social-media-research-skills
SkillsAI agent skills for social media research. Outlier posts, comment mining, competitor teardowns, ad libraries & trends across TikTok, Instagram, YouTube, Reddit, X, LinkedIn & more. Powered by ScrapeCreators. Works with Claude Code, Cursor, Codex, Gemini CLI.
git clone https://github.com/ScrapeCreators/social-media-research-skills.git -
FetchRelay
MCP serversExtract public webpages as Markdown, map sites, and run bounded crawl jobs. API key required.
-
SeoGrep
MCP serversSEO for AI agents: crawl sites, audit pages, pull Search Console data, generate shareable reports.
-
business-oss
MCP serversVerified business OSS MCP for search, RSS, crawling, documents, browser, media and transcription.
-
WebsiteIQ
MCP serversRobots-aware website audits, pre-crawl quotes, and structured evidence for people and agents.
-
commoncrawl-mcp
MCP serversUse this MCP server to Common Crawl index discovery for historical web captures. Tools include...
commoncrawl-mcp@1.0.1 -
Crawlbase (Unofficial)
MCP serversUnofficial Crawlbase MCP — wraps the Crawlbase Crawling API (crawlbase.com, formerly ProxyCrawl).…
@pipeworx/mcp-crawlbase@0.2.2 -
scrapio-mcp
MCP serversFetch, crawl, and search the web: Google, Amazon, Walmart, Booking.com, Agoda, and YouTube data.
@scrapio/mcp@1.10.0 -
Klisten SchemaShield
MCP serversStore and compare organization JSON snapshots. No database crawling. Customer key required.
-
AIsa On-Page Audit
MCP serversCrawl a site: pages, resources, links, duplicates, tags, Lighthouse and raw HTML.
-
TidyFetch
MCP serversWeb pages to markdown, site crawls, company contacts, app reviews, ATS jobs and Shopify products.
-
Diffbot
MCP serversWeb search, page extraction, crawling, and Knowledge Graph queries from Diffbot's web index.
diffbot-mcp@0.2.1 -
Domduck
MCP serversDomain reputation over time: Domain Rating, Tranco rank, TLS, and AI crawler policy.
-
Causabi GEO Optimizer
MCP serversAudit a site for AI readiness: AI-crawler access, schema, FAQ, content structure. Generates fixes.
geo-optimizer-mcp@0.5.1 -
Botcard
MCP serversCited AI crawler registry (training, search or user fetch) plus robots.txt checks. No fetching.
-
useragent-mcp
MCP serversParse user-agent strings into browser, engine, OS and device, and flag crawlers - fully local.
@mrfentmen/useragent-mcp@1.0.1 -
geoscore
MCP serversAI-crawler readiness checks and fixes: GEO score, robots.txt, schema.org, FAQ and llms.txt.
@reneturcios/geoscore@0.1.0 -
Agent Audit AI
MCP serversAutonomous AI agent readiness, crawler reachability, and 30-point audit specification engine.
-
Preferly
MCP serversFree AI visibility checks for any website: AI crawler access, llms.txt, schema, business info.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.