Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
Human Creative AI Workflow & Eval Lab
MCP serversRemote MCP tools for 3-vendor AI workflow diagnostics, HAR sandboxes, 50v audits, and rubrics.
-
AISafetyHot
MCP serversAI Safety HOT: daily AI safety news, papers and incidents in one place — jailbreaks, prompt injection, alignment, evals, governance. Website, daily digest, RSS and MCP.
git clone https://github.com/wuyoscar/AISafetyHot.git -
mnemiq
MCP serversOpen-source text-to-SQL engine you tune and measure on your own database
git clone https://github.com/agenticfabriq/mnemiq.git -
civic-ai-tools
MCP serversOpen-source platform connecting AI assistants to government open data — MCP server, curated civic MCP directory, and anti-hallucination framework for all 559 Socrata portals
git clone https://github.com/npstorey/civic-ai-tools.git -
Sema
MCP serversMCP tools for Sema — eval, compile, build, format, and docs for a Lisp with LLM primitives.
https://github.com/sema-lisp/sema/releases/download/v2.0.0/sema.mcpb@2.0.0 -
VerifyAX
MCP serversEvaluate, benchmark, and simulate AI agents on the VerifyAX agent-evaluation platform.
@verifyax/mcp-server@0.5.0 -
LLM-Agents-Ecosystem-Handbook
MCP serversOne-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.
git clone https://github.com/oxbshw/LLM-Agents-Ecosystem-Handbook.git -
Kojen
MCP serversTrain, evaluate, red-team and deploy AI agents: prompt tuning, LLM-judged evals, katas.
-
geminiupgradeqa-mcp
MCP serversRemote MCP for Gemini upgrade evals, prompt regressions, output diffs, and eval receipts.
-
rubrkit
MCP serversMCP-native AI evaluation: rubric audits, eval suites, and proof reports for AI/LLM output.
-
scale-hr
MCP serversScale HR evaluation SaaS for Japanese SMBs. Manage users, evaluation sheets, periods and 1on1s.
-
AssetOpsBench
MCP serversAssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for Industry 4.0 asset operations and maintenance, with 460+ scenarios, 5 specialist agents (IoT, FMSR, TSFM, Work Order,...), and multi-agent orchestration blueprints (MetaAgent, AgentHive) over MCP.
git clone https://github.com/IBM/AssetOpsBench.git -
bg3-agent-harness
MCP serversAn AI agent plays Baldur's Gate 3 on Linux through a Lua mod and an MCP server, seeing only what a player sees. Includes a model benchmark and a playthrough app.
git clone https://github.com/Bogzx/bg3-agent-harness.git -
jev-judge-mcp
MCP serversTyped judgment tools for MCP agents. TypeSafe's Jev model as verify, screen, find, classify, rerank, decide, compare, extract, review, gate, and score: the model judges, policy decides auto, review, or escalate.
git clone https://github.com/PyModel/jev-judge-mcp.git -
remnic
MCP serversOpen-source memory and context for user-aware agents: scoped memory, provenance, retrieval quality, correction, boundaries, evals, and MCP/HTTP access.
git clone https://github.com/joshuaswarren/remnic.git -
samyama-graph
MCP serversRust graph-vector database: OpenCypher (99.9% of evaluated TCK scenarios pass), vector search, graph algorithms, RESP + HTTP. LDBC SNB Interactive and BI complete; 1B edges on one machine.
git clone https://github.com/samyama-ai/samyama-graph.git -
posthog
MCP serversCapture analytics events, evaluate feature flags, and manage projects
mcparmory-posthog@1.0.5 -
Okareo
MCP serversSimulation, evaluation and monitoring for voice agents.
-
calcport
MCP serversSafe arithmetic: evaluate expressions and add, subtract, multiply, divide.
@reneturcios/calcport@0.1.0 -
mcp
MCP serversMCP server providing OpenFeature SDK installation guides and OFREP flag evaluation
@openfeature/mcp@0.0.22 -
Data Observability
MCP serversSQL data health analyzer and pipeline observability evaluator.
-
calculator-mcp-server
MCP serversEvaluate, simplify, and differentiate mathematical expressions.
@cyanheads/calculator-mcp-server@0.6.0 -
Uncertainty Calculator
MCP serversEvaluate mathematical expressions and propagate measurement uncertainty.
-
RecourseOS
MCP serversConsequence evaluation for AI agents. Check recoverability before destructive actions.
recourse-cli@0.1.12
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.