Octocrawl
Pages, crawls and URL batches as clean Markdown and JSON for AI agents, with an Evidence Record.
Open the source (opens github.com) https://github.com/77777r7/octocrawl
Before you use it
- Runs on someone else's server: what you send it leaves your machine.
- Runs on your computer with your permissions. Read what it can do before connecting it to an agent.
- Needs credentials: W2L_API_TOKEN. Use a key with the least access you can.
What it is
MCP servers from io.github.77777R7.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
npm package (stdio)
@octocrawl/mcp@0.8.13
From the server's entry in the official MCP Registry
Remote endpoint (streamable-http)
https://mcp.octocrawl.dev/mcp
From the server's entry in the official MCP Registry
Remote endpoint (streamable-http)
https://mcp.octocrawl.dev/mcp-oauth
From the server's entry in the official MCP Registry
Settings it asks for
W2L_API_URL· The Octocrawl API the server calls: npx octocrawl serve on this computer (default http://127.0.0.1:8787), or https://api.octocrawl.devW2L_API_TOKENsecret · A bearer token for a hosted or self-hosted API; none for a local oneW2L_MCP_TOOLSETS· The tool groups to list, comma-separated: core, crawl, batch, products, logins, monitor, delivery, or all (default all); the same as --toolsetsW2L_MCP_READ_ONLY· 1 lists read-only tools alone, with a scrape that does not act as the person; the same as --read-only
Related
-
GitHub MCP server
MCP serversGitHub's official MCP server. It lets an agent read and work with repositories, issues and pull requests.
https://api.githubcopilot.com/mcp/ -
Apify MCP server
MCP serversLets an agent run Apify's ready-made scrapers to pull data from websites, search engines, maps and social platforms.
-
Official MCP Registry
MCP serversThe MCP project's own registry of public MCP servers, so you can look for a connector before building one.
-
MCP reference servers
MCP serversSmall example servers from the MCP project (filesystem, git, fetch, memory and more) that show how MCP works.
-
Connect MCP servers to Claude Code
MCP serversAnthropic's guide to adding MCP servers to Claude Code, with examples of local and remote servers.
-
Playwright MCP
MCP serversLets an agent drive a real browser: open pages, click, fill in forms and read what's on screen.
claude mcp add playwright npx @playwright/mcp@latest