Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
labelhub-platform
MCP servers面向 LLM 训练数据生产的可信工作台:AI 提供证据、人类裁决,append-only 账本、可复现导出、评测关卡与 MCP Server。
git clone https://github.com/Iceberg86-gb/labelhub-platform.git -
cap-evolve
MCP serversOptimize any AI agent’s skills, tools/MCP, and prompts against your own evals.
git clone https://github.com/skillberry-ai/cap-evolve.git -
agentenv-framework
MCP serversCreating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, environments tools, dynamism of the environment, reproducibility, and more. There is no open source framework for building these environments effectively. Until now.
git clone https://github.com/scaleapi/agentenv-framework.git -
coding.sh
MCP serversOpen-source, local-first observability and evals for AI agents: see what Claude Code, Codex, Cursor and others did and what it cost.
git clone https://github.com/jackulau/coding.sh.git -
jev-judge-mcp
MCP serversTyped judgment tools for MCP agents. TypeSafe's Jev model as verify, screen, find, classify, rerank, decide, compare, extract, review, gate, and score: the model judges, policy decides auto, review, or escalate.
git clone https://github.com/PyModel/jev-judge-mcp.git -
LLM Prover
MCP serversLLM evaluation: compare models on cost and quality, score outputs, run benchmarks, analyse agents.
-
mcp-as-a-judge
MCP serversMCP as a Judge: a behavioral MCP that strengthens AI coding assistants via explicit LLM evaluations
mcp-as-a-judge@0.3.20
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.