InnerVault

agent-eval

Stale Official MCP Registry, io.github.RudrenduPaul

Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.

Open the source (opens github.com) https://github.com/rudrendupaul/agent-eval

Before you use it

  • Runs on your computer with your permissions. Read what it can do before connecting it to an agent.

What it is

MCP servers from io.github.RudrenduPaul.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

pypi package (stdio)

agent-regress-cli@0.1.8

From the server's entry in the official MCP Registry

Related

  1. Agent evaluation scorecard, delivered per API call as an atom service on Conduit Atoms.

    Indexed Official MCP Registry, org.aimlds Updated yesterday 1 note

  2. heym

    MCP servers

    Build agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.

    Indexed GitHub, heymrun 1,684 ★Custom licence (see repository)Updated today

    git clone https://github.com/heymrun/heym.git
  3. agentenv-framework

    MCP servers

    Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.

    Indexed GitHub, scaleapi 441 ★Apache-2.0Updated today

    git clone https://github.com/scaleapi/agentenv-framework.git
  4. awesome-ai-agents

    MCP servers

    Curated list of AI agent frameworks, coding and automation agents, MCP servers, and evaluation tools.

    Indexed GitHub, frangelbarrera 21 ★CC0-1.0Updated yesterday

    git clone https://github.com/frangelbarrera/awesome-ai-agents.git
  5. coding.sh

    MCP servers

    Open-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.

    Indexed GitHub, jackulau 30 ★MITUpdated today

    git clone https://github.com/jackulau/coding.sh.git
  6. bg3-agent-harness

    MCP servers

    An AI agent plays Baldur's Gate 3 on Linux through a Lua mod and an MCP server, seeing only what a player sees. Includes a model benchmark and a playthrough app.

    Stale GitHub, Bogzx 33 ★MITUpdated 7 days ago

    git clone https://github.com/Bogzx/bg3-agent-harness.git