InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. trulens

    Agents & frameworks

    Evaluation and Tracking for LLM Experiments and AI Agents

    Stale GitHub, truera 3,601 ★MITUpdated 34 days ago

    git clone https://github.com/truera/trulens.git
  2. future-agi

    Agents & frameworks

    Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

    Indexed GitHub, future-agi 2,267 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/future-agi/future-agi.git
  3. intelligent-audit-system

    Agents & frameworks

    AuditPilot: auditable enterprise AI agents for evidence-grounded workflows, governed tools, evaluation harnesses, human review, and remediation delivery.

    Stale GitHub, Ricky-7-Yan 1,180 ★MITUpdated 11 days ago

    git clone https://github.com/Ricky-7-Yan/intelligent-audit-system.git
  4. agentic_security

    Agents & frameworks

    Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪

    Indexed GitHub, msoedov 2,046 ★Apache-2.0Updated yesterday

    git clone https://github.com/msoedov/agentic_security.git
  5. litefuse

    Agents & frameworks

    Litefuse - Agent Observability and Evaluation Platform

    Indexed GitHub, litefuse 113 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/litefuse/litefuse.git
  6. waku-agent

    Agents & frameworks

    Waku Waku! Waku Agent is a local-first AI agent harness you actually own, including loop, memory, eval, all in code built to stay legible as it grows.

    Indexed GitHub, ShenSeanChen 2,177 ★MITUpdated yesterday

    git clone https://github.com/ShenSeanChen/waku-agent.git
  7. fast-agent

    Agents & frameworks

    Code, Build and Evaluate agents - excellent Model and Skills/MCP/ACP/A2A Support

    Indexed GitHub, evalstate 3,970 ★Apache-2.0Updated yesterday

    git clone https://github.com/evalstate/fast-agent.git
  8. trpc-agent-go

    Agents & frameworks

    A Go framework for building production agent systems with graph workflows, tools, memory, A2A, AG-UI, MCP, evaluation, and observability.

    Indexed GitHub, trpc-group 1,931 ★Apache-2.0Updated yesterday

    git clone https://github.com/trpc-group/trpc-agent-go.git
  9. benchmarks

    Agents & frameworks

    Reproducible voice-AI benchmarking — TTS / STT / S2S latency and accuracy.

    Stale GitHub, coval-ai 104 ★Custom licence (see repository)Updated 24 days ago

    git clone https://github.com/coval-ai/benchmarks.git
  10. ai-agents-the-definitive-guide

    Agents & frameworks

    Repo for AI Agents The Definitive Guide

    Stale GitHub, Nicolepcx 2,747 ★Updated 3 months ago

    git clone https://github.com/Nicolepcx/ai-agents-the-definitive-guide.git
  11. AgentBench

    Agents & frameworks

    A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

    Stale GitHub, THUDM 3,772 ★Apache-2.0Updated 9 months ago

    git clone https://github.com/THUDM/AgentBench.git
  12. KADATH

    Agents & frameworks

    Evolutionary multi-agent runtime that breeds, evaluates, and improves autonomous agents across reproducible epochs to converge on optimization of a goal.

    Stale GitHub, i3T4AN 253 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/i3T4AN/KADATH.git
  13. caliper

    Agents & frameworks

    Run your real agent with and without your skills, MCPs, and rules. See which ones actually help, and what they cost in tokens. Supports Claude Code, Codex, Pi, Hermes, Antigravity, and OpenCode.

    Indexed GitHub, edonadei 235 ★MITUpdated yesterday

    git clone https://github.com/edonadei/caliper.git
  14. WebCanvas

    Agents & frameworks

    All-in-one Web Agent framework for post-training. Start building with a few clicks!

    Stale GitHub, iMeanAI 281 ★MITUpdated 16 months ago

    git clone https://github.com/iMeanAI/WebCanvas.git
  15. ResolveLab

    Agents & frameworks

    Fault-injected tool environments with side-effect grading for evaluating and post-training LLM agents

    Stale GitHub, Ta0p1 106 ★MITUpdated 11 days ago

    git clone https://github.com/Ta0p1/ResolveLab.git
  16. Awesome-LLM-in-Social-Science

    Agents & frameworks

    Awesome papers involving LLMs in Social Science.

    Indexed GitHub, ValueByte-AI 653 ★MITUpdated 2 days ago

    git clone https://github.com/ValueByte-AI/Awesome-LLM-in-Social-Science.git
  17. RouterArena

    Agents & frameworks

    RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

    Stale GitHub, RouteWorks 157 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/RouteWorks/RouterArena.git
  18. ai-agents-tutorial

    Agents & frameworks

    Learn AI Agents step by step, from scratch - from function calling to agent loops to multi-agent systems, orchestration, and evaluation.

    Indexed GitHub, amitshekhariitbhu 212 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/amitshekhariitbhu/ai-agents-tutorial.git
  19. GTA

    Agents & frameworks

    [NeurIPS 2024 D&B] GTA: A Benchmark for General Tool Agents & [arXiv 2026] GTA-2

    Indexed GitHub, open-compass 153 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/open-compass/GTA.git
  20. CivAgent

    Agents & frameworks

    CivAgent is an LLM-based Human-like Agent acting as a Digital Player within the Strategy Game Unciv.

    Stale GitHub, fuxiAIlab 167 ★MPL-2.0Updated 20 months ago

    git clone https://github.com/fuxiAIlab/CivAgent.git
  21. cave-agent

    Agents & frameworks

    Stateful runtime management for LLM agents—inject, manipulate, and retrieve Python objects across turns.

    Stale GitHub, acodercat 204 ★MITUpdated 2 months ago

    git clone https://github.com/acodercat/cave-agent.git
  22. generative-ai

    Agents & frameworks

    Comprehensive resources on Generative AI, including a detailed roadmap, projects, use cases, interview preparation, and coding preparation.

    Stale GitHub, genieincodebottle 2,669 ★MITUpdated 7 days ago

    git clone https://github.com/genieincodebottle/generative-ai.git
  23. ai-job-search

    Agents & frameworks

    The job search that runs on your machine. AI job application framework built on Claude Code: evaluate postings, tailor CVs, write cover letters, prep interviews. Fork it and own it.

    Indexed GitHub, ai-job-search-dev 72.0k ★MITUpdated today

    git clone https://github.com/ai-job-search-dev/ai-job-search.git
  24. joyczl-agent

    Agents & frameworks

    Joy — a local-first personal assistant. Rust core (loop / memory / tools / graph / evals), TypeScript gateways + dashboard, Python thin SDK.

    Indexed GitHub, ChrisVip001 112 ★MITUpdated 2 days ago

    git clone https://github.com/ChrisVip001/joyczl-agent.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.