InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. ragas

    AI repositories

    Supercharge Your LLM Application Evaluations 🚀

    Indexed GitHub, vibrantlabsai 16.3k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/vibrantlabsai/ragas.git
  2. EverOS

    AI repositories

    One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows.

    Indexed GitHub, EverMind-AI 13.9k ★Apache-2.0Updated today

    git clone https://github.com/EverMind-AI/EverOS.git
  3. giskard-oss

    AI repositories

    🐢 Open-Source Evaluation & Testing library for LLM Agents

    Indexed GitHub, Giskard-AI 5,954 ★Apache-2.0Updated today

    git clone https://github.com/Giskard-AI/giskard-oss.git
  4. evidently

    AI repositories

    Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

    Stale GitHub, evidentlyai 7,988 ★Apache-2.0Updated 48 days ago

    git clone https://github.com/evidentlyai/evidently.git
  5. evalscope

    AI repositories

    A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

    Indexed GitHub, modelscope 3,697 ★Apache-2.0Updated today

    git clone https://github.com/modelscope/evalscope.git
  6. EvoAgentX

    AI repositories

    🚀 EvoAgentX: Building a Self-Evolving Ecosystem of AI Agents

    Stale GitHub, ANative-Lab 3,409 ★Custom licence (see repository)Updated 16 days ago

    git clone https://github.com/ANative-Lab/EvoAgentX.git
  7. mastra

    AI repositories

    Mastra is the modern TypeScript framework for AI-powered applications and agents.

    Indexed GitHub, mastra-ai 29.5k ★Custom licence (see repository)Updated today

    git clone https://github.com/mastra-ai/mastra.git
  8. tiny-universe

    AI repositories

    《大模型白盒子构建指南》:一个全手搓的Tiny-Universe

    Stale GitHub, datawhalechina 5,106 ★Updated 9 months ago

    git clone https://github.com/datawhalechina/tiny-universe.git
  9. oumi

    AI repositories

    Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

    Stale GitHub, oumi-ai 9,408 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/oumi-ai/oumi.git
  10. WeKnora

    AI repositories

    Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.

    Indexed GitHub, Tencent 37.5k ★Custom licence (see repository)Updated today

    git clone https://github.com/Tencent/WeKnora.git
  11. maka

    AI repositories

    Apache Maka (Incubating) is a high-performance agent workspace that keeps a complete record of everything it did.

    Indexed GitHub, apache 5,975 ★Apache-2.0Updated today

    git clone https://github.com/apache/maka.git
  12. PyRIT

    AI repositories

    Open-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.

    Indexed GitHub, microsoft 4,869 ★MITUpdated today

    git clone https://github.com/microsoft/PyRIT.git
  13. MemOS

    AI repositories

    Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings and DeepSeek Harness support.

    Stale GitHub, MemTensor 12.4k ★Apache-2.0Updated 5 days ago

    git clone https://github.com/MemTensor/MemOS.git
  14. agentops

    AI repositories

    Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

    Stale GitHub, AgentOps-AI 5,885 ★MITUpdated 4 months ago

    git clone https://github.com/AgentOps-AI/agentops.git
  15. AutoGPT

    AI repositories

    AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

    Indexed GitHub, Significant-Gravitas 188.0k ★Custom licence (see repository)Updated today

    git clone https://github.com/Significant-Gravitas/AutoGPT.git
  16. magpie

    AI repositories

    Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.

    Indexed GitHub, yetone 37.2k ★MITUpdated today

    git clone https://github.com/yetone/magpie.git
  17. failproofai

    AI repositories

    Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

    Stale GitHub, FailproofAI 6,226 ★Custom licence (see repository)Updated 22 days ago

    git clone https://github.com/FailproofAI/failproofai.git
  18. VLMEvalKit

    AI repositories

    Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

    Indexed GitHub, open-compass 4,487 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/open-compass/VLMEvalKit.git
  19. simba

    AI repositories

    OpenSource Production ready Customer service with built in Evals and monitoring

    Stale GitHub, GitHamza0206 1,546 ★Apache-2.0Updated 5 months ago

    git clone https://github.com/GitHamza0206/simba.git
  20. LLM4AD_Next

    AI repositories

    A next-generation automatic algorithm design platform, making automated algorithm design more accessible and easier to use

    Stale GitHub, Optima-CityU 715 ★BSD-3-ClauseUpdated 7 days ago

    git clone https://github.com/Optima-CityU/LLM4AD_Next.git
  21. easy-dataset

    AI repositories

    A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

    Stale GitHub, ConardLi 15.0k ★Custom licence (see repository)Updated 6 months ago

    git clone https://github.com/ConardLi/easy-dataset.git
  22. AI-Infra-Guard

    AI repositories

    A full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.

    Stale GitHub, Tencent 7,471 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/Tencent/AI-Infra-Guard.git
  23. ai-system-design-guide

    AI repositories

    AI system design guide for engineers building production AI systems and evals.

    Stale GitHub, ombharatiya 4,238 ★MITUpdated 6 days ago

    git clone https://github.com/ombharatiya/ai-system-design-guide.git
  24. Gym

    AI repositories

    Evaluate and improve models and agents using environments

    Indexed GitHub, NVIDIA-NeMo 1,334 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA-NeMo/Gym.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.