agent-eval
Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.
Open the source (opens github.com) https://github.com/rudrendupaul/agent-eval
Before you use it
- Runs on your computer with your permissions. Read what it can do before connecting it to an agent.
What it is
MCP servers from io.github.RudrenduPaul.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
pypi package (stdio)
agent-regress-cli@0.1.8
From the server's entry in the official MCP Registry
Related
-
Agent evaluation scorecard — Atom
MCP serversAgent evaluation scorecard, delivered per API call as an atom service on Conduit Atoms.
-
heym
MCP serversBuild agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.
git clone https://github.com/heymrun/heym.git -
agentenv-framework
MCP serversCreating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
git clone https://github.com/scaleapi/agentenv-framework.git -
awesome-ai-agents
MCP serversCurated list of AI agent frameworks, coding and automation agents, MCP servers, and evaluation tools.
git clone https://github.com/frangelbarrera/awesome-ai-agents.git -
coding.sh
MCP serversOpen-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.
git clone https://github.com/jackulau/coding.sh.git -
bg3-agent-harness
MCP serversAn AI agent plays Baldur's Gate 3 on Linux through a Lua mod and an MCP server, seeing only what a player sees. Includes a model benchmark and a playthrough app.
git clone https://github.com/Bogzx/bg3-agent-harness.git