InnerVault

evals-mcp-server

Stale Official MCP Registry, io.github.cyanheads

Author verifiable eval records through a draft→review→revise→submit loop with enforced graders.

Open the source (opens github.com) https://github.com/cyanheads/evals-mcp-server

Before you use it

  • Runs on your computer with your permissions. Read what it can do before connecting it to an agent.

What it is

MCP servers from io.github.cyanheads.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

npm package (stdio)

@cyanheads/evals-mcp-server@0.2.0

From the server's entry in the official MCP Registry

npm package (streamable-http)

@cyanheads/evals-mcp-server@0.2.0

From the server's entry in the official MCP Registry

Settings it asks for

  • EVALS_DATA_DIR · Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.
  • EVALS_REQUIRE_CONFIRMATION · When 'true', evals_submit_draft requests human confirmation before finalizing.
  • EVALS_DEFAULT_LICENSE · Default metadata.license applied when a draft omits one.
  • EVALS_CAPTURE_DIR · Directory of tool-call capture files; referenced EvalsIDs resolve to full dumps at submit.
  • MCP_LOG_LEVEL · Sets the minimum log level for output (e.g., 'debug', 'info', 'warn').
  • MCP_TRANSPORT_TYPE · Selects the HTTP transport.
  • MCP_HTTP_HOST · The hostname for the HTTP server.
  • MCP_HTTP_PORT · The port to run the HTTP server on.
  • MCP_HTTP_ENDPOINT_PATH · The endpoint path for the MCP server.
  • MCP_AUTH_MODE · Authentication mode to use: 'none', 'jwt', or 'oauth'.
  • EVALS_DATA_DIR · Root folder for record JSON. The store manages drafts/, submitted/, and exports/ subdirs under it.
  • EVALS_REQUIRE_CONFIRMATION · When 'true', evals_submit_draft requests human confirmation before finalizing.

Related

  1. GitHub MCP server

    MCP servers

    GitHub's official MCP server. It lets an agent read and work with repositories, issues and pull requests.

    Hand-checked InnerVault (hand-checked), GitHub 34.3k ★MIT

    https://api.githubcopilot.com/mcp/
  2. Apify MCP server

    MCP servers

    Lets an agent run Apify's ready-made scrapers to pull data from websites, search engines, maps and social platforms.

    Hand-checked InnerVault (hand-checked), Apify 16.0k ★MIT

  3. Official MCP Registry

    MCP servers

    The MCP project's own registry of public MCP servers, so you can look for a connector before building one.

    Hand-checked InnerVault (hand-checked), MCP project Moving from MIT to Apache-2.0

  4. MCP reference servers

    MCP servers

    Small example servers from the MCP project (filesystem, git, fetch, memory and more) that show how MCP works.

    Hand-checked InnerVault (hand-checked), MCP project Moving from MIT to Apache-2.0

  5. Anthropic's guide to adding MCP servers to Claude Code, with examples of local and remote servers.

    Hand-checked InnerVault (hand-checked), Anthropic Anthropic documentation

  6. Playwright MCP

    MCP servers

    Lets an agent drive a real browser: open pages, click, fill in forms and read what's on screen.

    Hand-checked InnerVault (hand-checked), Microsoft Apache-2.0

    claude mcp add playwright npx @playwright/mcp@latest