InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. future-agi

    Agents & frameworks

    Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

    Indexed GitHub, future-agi 2,267 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/future-agi/future-agi.git
  2. trulens

    Agents & frameworks

    Evaluation and Tracking for LLM Experiments and AI Agents

    Stale GitHub, truera 3,601 ★MITUpdated 34 days ago

    git clone https://github.com/truera/trulens.git
  3. intelligent-audit-system

    Agents & frameworks

    AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.

    Stale GitHub, Ricky-7-Yan 1,180 ★MITUpdated 11 days ago

    git clone https://github.com/Ricky-7-Yan/intelligent-audit-system.git
  4. agentic_security

    Agents & frameworks

    Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

    Indexed GitHub, msoedov 2,046 ★Apache-2.0Updated yesterday

    git clone https://github.com/msoedov/agentic_security.git
  5. trpc-agent-go

    Agents & frameworks

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    Indexed GitHub, trpc-group 1,931 ★Apache-2.0Updated yesterday

    git clone https://github.com/trpc-group/trpc-agent-go.git
  6. ai-agents-the-definitive-guide

    Agents & frameworks

    Repo for AI Agents The Definitive Guide

    Stale GitHub, Nicolepcx 2,747 ★Updated 3 months ago

    git clone https://github.com/Nicolepcx/ai-agents-the-definitive-guide.git
  7. KADATH

    Agents & frameworks

    Evolutionary multi-agent runtime that breeds, evaluates, and improves autonomous agents across reproducible epochs to converge on optimization of a goal.

    Stale GitHub, i3T4AN 253 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/i3T4AN/KADATH.git
  8. litefuse

    Agents & frameworks

    Litefuse - Agent Observability and Evaluation Platform

    Indexed GitHub, litefuse 113 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/litefuse/litefuse.git
  9. AgentBench

    Agents & frameworks

    A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

    Stale GitHub, THUDM 3,772 ★Apache-2.0Updated 9 months ago

    git clone https://github.com/THUDM/AgentBench.git
  10. ResolveLab

    Agents & frameworks

    Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents

    Stale GitHub, Ta0p1 106 ★MITUpdated 11 days ago

    git clone https://github.com/Ta0p1/ResolveLab.git
  11. WebCanvas

    Agents & frameworks

    All-in-one Web Agent framework for post-training. Start building with a few clicks!

    Stale GitHub, iMeanAI 281 ★MITUpdated 16 months ago

    git clone https://github.com/iMeanAI/WebCanvas.git
  12. RouterArena

    Agents & frameworks

    RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

    Stale GitHub, RouteWorks 157 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/RouteWorks/RouterArena.git
  13. Awesome-LLM-in-Social-Science

    Agents & frameworks

    Awesome papers involving LLMs in Social Science.

    Indexed GitHub, ValueByte-AI 653 ★MITUpdated 2 days ago

    git clone https://github.com/ValueByte-AI/Awesome-LLM-in-Social-Science.git
  14. ai-agents-tutorial

    Agents & frameworks

    Learn AI Agents step by step, from scratch - from function calling to agent loops to multi-agent systems, orchestration, and evaluation.

    Indexed GitHub, amitshekhariitbhu 212 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/amitshekhariitbhu/ai-agents-tutorial.git
  15. GTA

    Agents & frameworks

    [NeurIPS 2024 D&B] GTA: A Benchmark for General Tool Agents & [arXiv 2026] GTA-2

    Indexed GitHub, open-compass 153 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/open-compass/GTA.git
  16. CivAgent

    Agents & frameworks

    CivAgent is an LLM-based Human-like Agent acting as a Digital Player within the Strategy Game Unciv.

    Stale GitHub, fuxiAIlab 167 ★MPL-2.0Updated 20 months ago

    git clone https://github.com/fuxiAIlab/CivAgent.git
  17. cave-agent

    Agents & frameworks

    Stateful runtime management for LLM agents—inject, manipulate, and retrieve Python objects across turns.

    Stale GitHub, acodercat 204 ★MITUpdated 2 months ago

    git clone https://github.com/acodercat/cave-agent.git
  18. nemo-helix

    Agents & frameworks

    NeMo Helix: Make the agents you ship faster, more accurate, and safer.

    Indexed GitHub, NVIDIA-NeMo 145 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/NVIDIA-NeMo/nemo-helix.git
  19. generative-ai

    Agents & frameworks

    Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.

    Stale GitHub, genieincodebottle 2,669 ★MITUpdated 7 days ago

    git clone https://github.com/genieincodebottle/generative-ai.git
  20. palico-ai

    Agents & frameworks

    Build, Improve Performance, and Productionize your AI Application

    Stale GitHub, palico-ai 343 ★MITUpdated 24 months ago

    git clone https://github.com/palico-ai/palico-ai.git
  21. deepresearch-agent

    Agents & frameworks

    一个生产级的深度研究 Agent 系统,从零构建多智能体编排、Red-Blue 对抗降噪、 语义级上下文压缩、跨 Agent 共享记忆四大核心能力,配套 165 次独立实验 + Bootstrap 统计显著性检验的完整评测体系。

    Stale GitHub, qiqihezh 165 ★Updated 6 months ago

    git clone https://github.com/qiqihezh/deepresearch-agent.git
  22. fast-agent

    Agents & frameworks

    Code, Build and Evaluate agents - excellent Model and Skills/MCP/ACP/A2A Support

    Indexed GitHub, evalstate 3,970 ★Apache-2.0Updated yesterday

    git clone https://github.com/evalstate/fast-agent.git
  23. ai-job-search

    Agents & frameworks

    The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.

    Indexed GitHub, ai-job-search-dev 72.0k ★MITUpdated today

    git clone https://github.com/ai-job-search-dev/ai-job-search.git
  24. chinese-llm-benchmark

    Agents & frameworks

    非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型, 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜,也提供规模超200万的大模型缺陷库!方便广大社区研究分析、改进大模型。

    Indexed GitHub, jeinlee1991 6,518 ★Updated yesterday

    git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.