Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
AISafetyHot
MCP serversAI Safety HOT: daily AI safety news, papers and incidents in one place — jailbreaks, prompt injection, alignment, evals, governance. Website, daily digest, RSS and MCP.
git clone https://github.com/wuyoscar/AISafetyHot.git -
safetyreplay-mcp
MCP serversPaid remote MCP for safety replays, policy gates, eval receipts, and release evidence.
-
Iris
MCP serversStop shipping agents on vibes. Score every agent output for quality, safety, and cost.
@iris-eval/mcp-server@0.21.0 -
AI/LLM agent output audit MCP: policy eval, tamper-evident chain, AI safety, x402 USDC on Base.
-
coding.sh
MCP serversOpen-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.
git clone https://github.com/jackulau/coding.sh.git -
inspector
MCP serversTesting and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
git clone https://github.com/MCPJam/inspector.git -
cordum
MCP serversThe action firewall for AI agents. Enforce policy and human approval before risky tool calls, shell commands, workflows, and production changes, with auditable evidence.
git clone https://github.com/cordum-io/cordum.git -
cap-evolve
MCP serversOptimize any AI agent’s skills, tools/MCP, and prompts against your own evals.
git clone https://github.com/skillberry-ai/cap-evolve.git -
web-eval-agent
MCP serversAn MCP server that autonomously evaluates web applications.
git clone https://github.com/refreshdotdev/web-eval-agent.git -
ai-eval
MCP serversCloudflare Workers MCP server: ai-eval
-
IA-QA Eval & RAG — 38 tools
MCP serversLLM & RAG evals: hallucination, eval contracts, semantic tests, tokens & model info. Free, no key.
-
chess-eval
MCP serversStockfish chess eval: best move, score, principal variation, multipv. $0.005/call via x402.
-
evals-mcp-server
MCP serversAuthor verifiable eval records through a draft→review→revise→submit loop with enforced graders.
@cyanheads/evals-mcp-server@0.2.0 -
slop-eval
MCP serversWraps the slop-eval CLI as a single generic MCP tool for genericness scoring of AI UI output.
slop-eval-cli@0.1.4 -
WebMCP Eval
MCP serversEvaluate one public URL for WebMCP readiness: intent, tools observed, recommended, do-not-expose.
-
Calc Eval
MCP serversEvaluate a+b style arithmetic. Expression discarded.
-
tuui
MCP serversA desktop MCP client designed as a tool unitary utility integration, accelerating AI adoption through the Model Context Protocol (MCP) and enabling cross-vendor LLM API orchestration.
git clone https://github.com/AI-QL/tuui.git -
mcp-eval-runner
MCP serversA standardized testing harness for MCP servers and agent workflows
mcp-eval-runner@1.0.1 -
signet-eval
MCP serversDeterministic policy enforcement and MCP management for AI agent tool calls.
-
Manage functional-safety requirements and lifecycle traceability.
-
heym
MCP serversBuild agentic systems. Run them with confidence. Orchestrate agents, automate business processes, inspect every execution, and keep humans in control. Deploy Heym on your own infrastructure.
git clone https://github.com/heymrun/heym.git -
agent-eval
MCP serversStatistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.
agent-regress-cli@0.1.8 -
GenPark Safe Eval Expression AST Sandbox
MCP serversZero-dependency AST safe mathematical and boolean expression evaluator and validator
https://github.com/Alpha-Park/genpark-safe-eval-expression-ast-sandbox-skill/releases/download/v1.0.1/genpark-safe-eval-expression-ast-sandbox-skill-v1.0.1.mcpb -
hwatu
MCP serversVerification browser for coding agents: headless WebKit, DOM eval, screenshots, pixel-diff.
https://github.com/hongnoul/hwatu/releases/download/v0.6.0/hwatu-mcp-linux-x86_64.tar.gz@0.6.0
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.