Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
bg3-agent-harness
MCP serversAn AI agent plays Baldur's Gate 3 on Linux through a Lua mod and an MCP server, seeing only what a player sees. Includes a model benchmark and a playthrough app.
git clone https://github.com/Bogzx/bg3-agent-harness.git -
AssetOpsBench
MCP serversAssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for Industry 4.0 asset operations and maintenance, with 460+ scenarios, 5 specialist agents (IoT, FMSR, TSFM, Work Order,...), and multi-agent orchestration blueprints (MetaAgent, AgentHive) over MCP.
git clone https://github.com/IBM/AssetOpsBench.git -
promptdesk
PromptsPromptdesk is a tool designed for effectively creating, organizing, and evaluating prompts and large language models (LLMs).
git clone https://github.com/promptdesk/promptdesk.git -
MathJS
Public APIsEvaluate math expressions via GET or POST as JSON
-
suede-creator-skills
SkillsOpen-source skills for Claude Code and Codex, with an MCP server, a PyPI package and Suede Awesome Everything, a directory that scores AI agent skills 0 to 99. Created by Jason Colapietro, founder and CEO of Suede AI.
git clone https://github.com/JasonColapietro/suede-creator-skills.git -
jev-judge-mcp
MCP serversTyped judgment tools for MCP agents. TypeSafe's Jev model as verify, screen, find, classify, rerank, decide, compare, extract, review, gate, and score: the model judges, policy decides auto, review, or escalate.
git clone https://github.com/PyModel/jev-judge-mcp.git -
VibeSearchBench
Datasets & benchmarks🔍 The hardest search benchmark in the wild — vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.
git clone https://github.com/VibeBench/VibeSearchBench.git -
ReForm-Eval
Datasets & benchmarksAn benchmark for evaluating the capabilities of large vision-language models (LVLMs)
git clone https://github.com/FudanDISC/ReForm-Eval.git -
skill-creator-plus
SkillsBased on Anthropic's skill-creator — with bug fixes, working Cowork support, and official best practices baked in. Claude skill for creating, testing, and improving other Claude skills.
git clone https://github.com/yaniv-golan/skill-creator-plus.git -
posthog
MCP serversCapture analytics events, evaluate feature flags, and manage projects
mcparmory-posthog@1.0.5 -
Okareo
MCP serversSimulation, evaluation and monitoring for voice agents.
-
JamAIBase
AI repositoriesThe collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.
git clone https://github.com/EmbeddedLLM/JamAIBase.git -
PAKGOV-RAG-project
AI repositoriesResearch project on bilingual Urdu-English retrieval-augmented generation for Pakistani government and legal documents, with OCR, hybrid retrieval, citation grounding, and evaluation.
git clone https://github.com/salikhussain71-code/PAKGOV-RAG-project.git -
aiml-companion
Agents & frameworksAI-ML Companion: an interactive platform to learn AI & ML by watching it work - 28 tracks, 400+ modules, live visualizations - plus 20+ end-to-end real world projects from classical ML, DL, Computer Vision to production LLM & multi-agent systems.
git clone https://github.com/genieincodebottle/aiml-companion.git -
hermeneutic
SkillsTurn corrections from AI agent logs into guidance for similar tasks. Local memory with semantic retrieval, prompt-context hooks, and response checks.
git clone https://github.com/hermes-labs-ai/hermeneutic.git -
calcport
MCP serversSafe arithmetic: evaluate expressions and add, subtract, multiply, divide.
@reneturcios/calcport@0.1.0 -
agent-starter-pack
AI repositoriesShip AI Agents to Google Cloud in minutes, not months. Production-ready templates with built-in CI/CD, evaluation, and observability.
git clone https://github.com/GoogleCloudPlatform/agent-starter-pack.git -
web-eval-agent
MCP serversAn MCP server that autonomously evaluates web applications.
git clone https://github.com/refreshdotdev/web-eval-agent.git -
mcp
MCP serversMCP server providing OpenFeature SDK installation guides and OFREP flag evaluation
@openfeature/mcp@0.0.22 -
Data Observability
MCP serversSQL data health analyzer and pipeline observability evaluator.
-
calculator-mcp-server
MCP serversEvaluate, simplify, and differentiate mathematical expressions.
@cyanheads/calculator-mcp-server@0.6.0 -
Uncertainty Calculator
MCP serversEvaluate mathematical expressions and propagate measurement uncertainty.
-
RecourseOS
MCP serversConsequence evaluation for AI agents. Check recoverability before destructive actions.
recourse-cli@0.1.12 -
ADHDEvaluations
MCP servers9,846 ADHD evaluation providers from the CMS NPI Registry.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.