Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
nemo-helix
Agents & frameworksNeMo Helix: Make the agents you ship faster, more accurate, and safer.
git clone https://github.com/NVIDIA-NeMo/nemo-helix.git -
palico-ai
Agents & frameworksBuild, Improve Performance, and Productionize your AI Application
git clone https://github.com/palico-ai/palico-ai.git -
adk-python
Agents & frameworksAn open-source, code-first Python toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
git clone https://github.com/google/adk-python.git -
chinese-llm-benchmark
Agents & frameworks非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型, 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜,也提供规模超200万的大模型缺陷库!方便广大社区研究分析、改进大模型。
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git -
deepresearch-agent
Agents & frameworks一个生产级的深度研究 Agent 系统,从零构建多智能体编排、Red-Blue 对抗降噪、 语义级上下文压缩、跨 Agent 共享记忆四大核心能力,配套 165 次独立实验 + Bootstrap 统计显著性检验的完整评测体系。
git clone https://github.com/qiqihezh/deepresearch-agent.git -
awesome-harness-engineering
Agents & frameworksAwesome list for AI agent harness engineering: tools, patterns, evals, memory, MCP, permissions, observability, and orchestration.
git clone https://github.com/ai-boost/awesome-harness-engineering.git -
overtime
Agents & frameworksGive a coding agent a brief, not a chat, and it works on its own across sessions. Includes an example run: an open-world city built in a real game engine with no human help. In early development.
git clone https://github.com/ukanwat/overtime.git -
awesome-pydantic-ai
Agents & frameworksAn opinionated list of awesome Pydantic-AI frameworks, libraries, software and resources.
git clone https://github.com/vstorm-co/awesome-pydantic-ai.git -
agentic-engineering-handbook
Agents & frameworksThe definitive OpenAI, Claude, MCP, Harness, Evals, and Production Agent Systems learning roadmap.
git clone https://github.com/keyuchen21/agentic-engineering-handbook.git -
Hypha
Agents & frameworksHarness-oriented agent system framework for production-grade LLM agent applications
git clone https://github.com/CodeSoul-co/Hypha.git -
MIRAI
Agents & frameworksCode and Data for "MIRAI: Evaluating LLM Agents for Event Forecasting"
git clone https://github.com/yecchen/MIRAI.git -
Sage
Agents & frameworksAn RSI Agent Harness for running, evaluating, and evolving agents—with tools, skills, MCP, stateful execution, and multi-agent workflows.
git clone https://github.com/ZHangZHengEric/Sage.git -
Awesome-CUA
Agents & frameworksOpen, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.
git clone https://github.com/reacher-z/Awesome-CUA.git -
awesome-auditable-ai
Agents & frameworksAuditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.
git clone https://github.com/yzhao062/awesome-auditable-ai.git -
embodied-first-exam
Agents & frameworksThe first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.
git clone https://github.com/mll-lab-nu/embodied-first-exam.git -
DM-Code-Agent
Agents & frameworksAn inspectable coding agent. Trace changes, diagnose failed runs, and share test evidence. Local-first Python, no-key demo, standalone HTML reports.
git clone https://github.com/hwfengcs/DM-Code-Agent.git -
Research-Assistant-Agent
Agents & frameworksMulti-agent research execution system: paper reproduction, benchmark evaluation, AutoResearch and claim-evidence graphs
git clone https://github.com/zzp1221/Research-Assistant-Agent.git -
GateMem
Agents & frameworksGateMem: a benchmark and evaluation toolkit for memory governance in multi-principal shared-memory LLM agents.
git clone https://github.com/rzhub/GateMem.git -
Awesome-Agent-Harness
Agents & frameworksThe first survey dedicated to LLM agent harnesses — 168 references, 34 evidence-coded systems, and 30 evaluation entries.
git clone https://github.com/Gloriaameng/Awesome-Agent-Harness.git -
wtfibought
Agents & frameworksA live arena where LLM agents trade real market data with virtual money — every thought, tool call, thesis and post-mortem is public. Bring your own model and key.
git clone https://github.com/mamawai/wtfibought.git -
adk-js
Agents & frameworksAn open-source, code-first Typescript toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
git clone https://github.com/google/adk-js.git -
collaborative-gym
Agents & frameworksFramework and toolkits for building and evaluating collaborative agents that can work together with humans.
git clone https://github.com/SALT-NLP/collaborative-gym.git -
metaharness
Agents & frameworks🛠️ The meta-harness for AI agents — scaffold your own focused, branded agent harness with its own npx CLI, MCP server, memory, learning loop, and witness-signed releases. Works with Claude Code, Codex, pi.dev, Hermes, OpenClaw, and RVM (hardware-isolated sandbox).
git clone https://github.com/ruvnet/metaharness.git -
llm-rl-environments-lil-course
Agents & frameworks🌱 A little course on Reinforcement Learning Environments for evaluating and training Language Models
git clone https://github.com/anakin87/llm-rl-environments-lil-course.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.