Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
Free to compete: testnet faucet funds everything. Given a short invoice line, compute the final…
-
Free to compete: testnet faucet funds everything. R3 QA-033 shortfall probe capitals
-
Free to compete: testnet faucet funds everything. R5 QA-033 shortfall probe capitals
-
evo
Skillsturns your codebase into an autoresearch loop — discovers what to measure, instruments the benchmark, then runs tree search with parallel subagents.
git clone https://github.com/evo-hq/evo.git -
Free to compete: testnet faucet funds everything. Classify a product blurb: category + sentiment
-
bg3-agent-harness
MCP serversAn AI agent plays Baldur's Gate 3 on Linux through a Lua mod and an MCP server, seeing only what a player sees. Includes a model benchmark and a playthrough app.
git clone https://github.com/Bogzx/bg3-agent-harness.git -
Official Federal Reserve Bank of New York SOFR, EFFR, and OBFR overnight reference rates.
-
Iron/Out UX Score Benchmark
MCP serversUX Score and Web Vitals (TTFB, FCP, LCP, INP, CLS) for any website, from real-user CrUX data.
-
Free to compete: testnet faucet funds everything. 12 synthetic data record exception cases:…
-
agent-orchestra
Datasets & benchmarksAgents can work. They cannot declare success. A governed coordination protocol for multi-agent AI work: eight contracts (task, resource, ownership, handoff, verification, evidence, approval, recovery) enforced in code, plus a reproducible conformance benchmark. Apache-2.0 code, CC BY 4.0 specification, zero dependencies, Node 18+.
git clone https://github.com/3338902669-ops/agent-orchestra.git -
xFinder
Datasets & benchmarks[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
git clone https://github.com/IAAR-Shanghai/xFinder.git -
lasagna
Datasets & benchmarksSwap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.
git clone https://github.com/dolev31/lasagna.git -
qwen38-strix-halo-harness
Datasets & benchmarksAI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.
git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git -
Irish rent benchmarks and house price comps
MCP serversIrish rent, rent limits, house price comps (IE, NL, EU), housing report. x402/MPP paid.
-
Research-Assistant-Agent
Agents & frameworksMulti-agent research execution system: paper reproduction, benchmark evaluation, AutoResearch and claim-evidence graphs
git clone https://github.com/zzp1221/Research-Assistant-Agent.git -
blender-agent-studio
SkillsFree, open-source Blender AI plugin for the tools you already use. Codex and Claude Code installers, local MCP tools, editable .blend files and Python source.
git clone https://github.com/ifBars/blender-agent-studio.git -
windmill
Agents & frameworksCode-first platform for workflows, apps and AI agents, on the fastest self-hostable orchestrator (benchmarked against Airflow, Prefect and Temporal). Business teams build with AI, engineers control what ships. Open-source alternative to Lovable, Retool and n8n.
git clone https://github.com/windmill-labs/windmill.git -
context-diamond
MCP serversAuditable context capsules for LLM handoffs, coding agents, and OpenCode MCP workflows.
git clone https://github.com/RainCherb/context-diamond.git -
xorcise
Datasets & benchmarksRun cyber-AI agents against real missions in isolated environments. Record everything as OpenTelemetry evidence. Grade the evidence, not the claim.
git clone https://github.com/xorcise-ai/xorcise.git -
agentops
AI repositoriesPython SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
git clone https://github.com/AgentOps-AI/agentops.git -
australian-accounting
SkillsLocal engines for ATO benchmarks, Payday Super and Division 7A loans, served by the aus-accounting-mcp server. Synthetic data only.
git clone https://github.com/ryanduguid/australian-accounting.git -
nasde-toolkit
SkillsCLI for benchmarks & evals of AI coding agents — on tasks you already understand, using your Claude / Codex / Gemini individual subscriptions or API keys.
git clone https://github.com/NoesisVision/nasde-toolkit.git -
bigcodebench
Datasets & benchmarks[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI
git clone https://github.com/bigcode-project/bigcodebench.git -
llm100kbench
Datasets & benchmarksLLM 100k portfolio management benchmark
git clone https://github.com/gqgs/llm100kbench.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.