Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
slop-eval
MCP serversWraps the slop-eval CLI as a single generic MCP tool for genericness scoring of AI UI output.
slop-eval-cli@0.1.4 -
PuzzleTide
MCP serversWord search, crossword, and sudoku generators, printable PDF worksheets, and verifiable LLM evals.
puzzletide-mcp@0.2.1 -
coding.sh
MCP serversOpen-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.
git clone https://github.com/jackulau/coding.sh.git -
inspector
MCP serversTesting and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
git clone https://github.com/MCPJam/inspector.git -
cap-evolve
MCP serversOptimize any AI agent’s skills, tools/MCP, and prompts against your own evals.
git clone https://github.com/skillberry-ai/cap-evolve.git -
web-eval-agent
MCP serversAn MCP server that autonomously evaluates web applications.
git clone https://github.com/refreshdotdev/web-eval-agent.git -
ai-eval
MCP serversCloudflare Workers MCP server: ai-eval
-
IA-QA Eval & RAG — 38 tools
MCP serversLLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.
-
chess-eval
MCP serversStockfish chess eval: best move, score, principal variation, multipv. $0.005/call via x402.
-
evals-mcp-server
MCP serversAuthor verifiable eval records through a draft→review→revise→submit loop with enforced graders.
@cyanheads/evals-mcp-server@0.2.0 -
WebMCP Eval
MCP serversEvaluate one public URL for WebMCP readiness: intent, tools observed, recommended, do-not-expose.
-
Calc Eval
MCP serversEvaluate a+b style arithmetic. Expression discarded.
-
tuui
MCP serversA desktop MCP client designed as a tool unitary utility integration, accelerating AI adoption through the Model Context Protocol (MCP) and enabling cross-vendor LLM API orchestration.
git clone https://github.com/AI-QL/tuui.git -
mcp-eval-runner
MCP serversA standardized testing harness for MCP servers and agent workflows
mcp-eval-runner@1.0.1 -
signet-eval
MCP serversDeterministic policy enforcement and MCP management for AI agent tool calls.
-
heym
MCP serversBuild agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.
git clone https://github.com/heymrun/heym.git -
agent-eval
MCP serversStatistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.
agent-regress-cli@0.1.8 -
GenPark Safe Eval Expression AST Sandbox
MCP serversZero-dependency AST safe mathematical and boolean expression evaluator and validator
https://github.com/Alpha-Park/genpark-safe-eval-expression-ast-sandbox-skill/releases/download/v1.0.1/genpark-safe-eval-expression-ast-sandbox-skill-v1.0.1.mcpb -
hwatu
MCP serversVerification browser for coding agents: headless WebKit, DOM eval, screenshots, pixel-diff.
https://github.com/hongnoul/hwatu/releases/download/v0.6.0/hwatu-mcp-linux-x86_64.tar.gz@0.6.0 -
Chipp Analytics and evals
MCP serversChipp: conversations, messages, usage and engagement analytics, end users and their memories, and.
-
LLM Eval Harness
MCP serversRun a golden set and gate LLM model swaps on accuracy, with latency and cost per request.
ghcr.io/razilzul/llm-eval-harness:1.0.0 -
Japanese Order Eval
MCP serversRegression checks for Japanese order automations: six free cases, strict JSON scoring and CI gates.
-
Eval Engine API
MCP serversPay-per-call AI evaluation MCP server. Score LLM outputs against benchmark rubrics via Workers AI.
-
Web Search API Eval
MCP serversWeb search API benchmark for AI agents: You.com, Tavily, Exa, Parallel. Results and charts.
websearch-api-eval-mcp@1.1.0
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.