Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
inspector
MCP serversTesting and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
git clone https://github.com/MCPJam/inspector.git -
cap-evolve
MCP serversOptimize any AI agent’s skills, tools/MCP, and prompts against your own evals.
git clone https://github.com/skillberry-ai/cap-evolve.git -
coding.sh
MCP serversOpen-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.
git clone https://github.com/jackulau/coding.sh.git -
agentenv-framework
MCP serversCreating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
git clone https://github.com/scaleapi/agentenv-framework.git -
web-eval-agent
MCP serversAn MCP server that autonomously evaluates web applications.
git clone https://github.com/refreshdotdev/web-eval-agent.git -
tuui
MCP serversA desktop MCP client designed as a tool unitary utility integration, accelerating AI adoption through the Model Context Protocol (MCP) and enabling cross-vendor LLM API orchestration.
git clone https://github.com/AI-QL/tuui.git -
ai-eval
MCP serversCloudflare Workers MCP server: ai-eval
-
heym
MCP serversBuild agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.
git clone https://github.com/heymrun/heym.git -
Evalmee
MCP serversCreate and edit online exams in Evalmee: sections, questions, answer keys, grading criteria.
-
Calc Eval
MCP serversEvaluate a+b style arithmetic. Expression discarded.
-
EvalGate
MCP serversRun AI evaluations, record agent traces and gate releases on evidence, with scoped org access.
-
EvalGate Docs
MCP serversSearch and read EvalGate's public documentation. Read-only, no account or credential needed.
-
WebMCP Eval
MCP serversEvaluate one public URL for WebMCP readiness: intent, tools observed, recommended, do-not-expose.
-
evalsmith-mcp
MCP serversEvaluate RAG retrieval, agent tool calls and prompt regressions with deterministic metrics.
evalsmith-mcp@0.1.0 -
IA-QA Eval & RAG — 38 tools
MCP serversLLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.
-
Execute clause-risk-score-evaluator-mcp
MCP serversPremium agentic endpoint for clause-risk-score-evaluator-mcp.
-
chess-eval
MCP serversStockfish chess eval: best move, score, principal variation, multipv. $0.005/call via x402.
-
evals-mcp-server
MCP serversAuthor verifiable eval records through a draft→review→revise→submit loop with enforced graders.
@cyanheads/evals-mcp-server@0.2.0 -
GenPark Safe Eval Expression AST Sandbox
MCP serversZero-dependency AST safe mathematical and boolean expression evaluator and validator
https://github.com/Alpha-Park/genpark-safe-eval-expression-ast-sandbox-skill/releases/download/v1.0.1/genpark-safe-eval-expression-ast-sandbox-skill-v1.0.1.mcpb -
hwatu
MCP serversVerification browser for coding agents: headless WebKit, DOM eval, screenshots, pixel-diff.
https://github.com/hongnoul/hwatu/releases/download/v0.6.0/hwatu-mcp-linux-x86_64.tar.gz@0.6.0 -
evalgate
MCP serversStatistical checks an agent runs before trusting an AI eval number (is #1 real, judge bias, more).
eval-integrity@0.4.1 -
evalpair
MCP serversRun LLM eval suites on local or hosted models; compare runs with intervals and a noise floor.
evalpair@0.1.1 -
Privi Ledger — Recovery Evaluation
MCP serversEvaluation-only ledger MCP. Temporary storage; not durable audit evidence. Payments disabled.
-
Agent evaluation scorecard — Atom
MCP serversAgent evaluation scorecard, delivered per API call as an atom service on Conduit Atoms.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.