InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. BentoML

    AI repositories

    The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

    Stale GitHub, bentoml 8,935 ★Apache-2.0Updated 14 days ago

    git clone https://github.com/bentoml/BentoML.git
  2. mempalace

    AI repositories

    The best-benchmarked open-source AI memory system. And it's free.

    Stale GitHub, MemPalace 60.5k ★MITUpdated 4 days ago

    git clone https://github.com/MemPalace/mempalace.git
  3. EnterpriseRAG-Bench

    AI repositories

    Dataset and benchmark for RAG on company internal documents.

    Stale GitHub, onyx-dot-app 592 ★MITUpdated 2 months ago

    git clone https://github.com/onyx-dot-app/EnterpriseRAG-Bench.git
  4. benchmark-qed

    AI repositories

    Automated benchmarking of Retrieval-Augmented Generation (RAG) systems

    Stale GitHub, microsoft 103 ★MITUpdated 10 days ago

    git clone https://github.com/microsoft/benchmark-qed.git
  5. vidore-benchmark

    AI repositories

    Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.

    Stale GitHub, illuin-tech 278 ★MITUpdated 27 days ago

    git clone https://github.com/illuin-tech/vidore-benchmark.git
  6. folkbench

    AI repositories

    帮你的 AI 编程工具找到不降智、不断连、高性价比的好线路 · Live LLM relay rankings, model integrity probes & Tauri/Rust switcher for Claude Code, Codex & Gemini CLI

    Indexed GitHub, Folkbench 3,883 ★Custom licence (see repository)Updated today

    git clone https://github.com/Folkbench/folkbench.git
  7. OpenLLM

    AI repositories

    Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

    Stale GitHub, bentoml 12.6k ★Apache-2.0Updated 25 days ago

    git clone https://github.com/bentoml/OpenLLM.git
  8. beir

    AI repositories

    A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

    Stale GitHub, beir-cellar 2,310 ★Apache-2.0Updated 13 months ago

    git clone https://github.com/beir-cellar/beir.git
  9. SDGym

    AI repositories

    Benchmarking synthetic data generation methods.

    Indexed GitHub, sdv-dev 313 ★Custom licence (see repository)Updated today

    git clone https://github.com/sdv-dev/SDGym.git
  10. docext

    AI repositories

    An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)

    Stale GitHub, NanoNets 2,083 ★Apache-2.0Updated 8 months ago

    git clone https://github.com/NanoNets/docext.git
  11. toon

    AI repositories

    🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.

    Stale GitHub, toon-format 25.5k ★MITUpdated 38 days ago

    git clone https://github.com/toon-format/toon.git
  12. Gym

    AI repositories

    Evaluate and improve models and agents using environments

    Indexed GitHub, NVIDIA-NeMo 1,334 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA-NeMo/Gym.git
  13. DreamLayer-Eval

    AI repositories

    DreamLayer Eval: open-source benchmarking for image and video diffusion models. Automate prompts, seeds, and metrics for reproducible results. A research project from DreamLayer AI (dreamlayer.io).

    Stale GitHub, TheDesignFounder 412 ★GPL-3.0Updated 17 days ago

    git clone https://github.com/TheDesignFounder/DreamLayer-Eval.git
  14. evalscope

    AI repositories

    A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

    Indexed GitHub, modelscope 3,697 ★Apache-2.0Updated today

    git clone https://github.com/modelscope/evalscope.git
  15. Repo2RLEnv

    AI repositories

    Turn any repository into verifiable RL environments for coding agents - Harbor tasks you can train on, evaluate and share on the Hugging Face Hub

    Stale GitHub, huggingface 779 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/huggingface/Repo2RLEnv.git
  16. agentic-ai

    AI repositories

    Agentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.

    Indexed GitHub, mahmoudrabie 193 ★MITUpdated 2 days ago

    git clone https://github.com/mahmoudrabie/agentic-ai.git
  17. XRAG

    AI repositories

    XRAG: eXamining the Core - Benchmarking Foundational Component Modules in Advanced Retrieval-Augmented Generation

    Stale GitHub, DocAILab 611 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/DocAILab/XRAG.git
  18. VLM2Vec

    AI repositories

    This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]

    Stale GitHub, TIGER-AI-Lab 696 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/TIGER-AI-Lab/VLM2Vec.git
  19. somali-language-standard

    AI repositories

    The open, machine-readable standard for the Somali language — orthography, grammar, terminology, translation, and AI/benchmark resources, as a versioned, citable RFC-style catalog.

    Stale GitHub, somastllc 108 ★MITUpdated 19 days ago

    git clone https://github.com/somastllc/somali-language-standard.git
  20. Huatuo-Llama-Med-Chinese

    AI repositories

    Repo for BenCao [original name: HuaTuo (华驼)], Instruction-tuning Large Language Models with Chinese Medical Knowledge. 本草(原名:华驼)模型仓库,基于中文医学知识的大语言模型指令微调

    Stale GitHub, SCIR-HI 4,999 ★Apache-2.0Updated 4 months ago

    git clone https://github.com/SCIR-HI/Huatuo-Llama-Med-Chinese.git
  21. code-review-graph

    AI repositories

    Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.

    Stale GitHub, tirth8205 32.2k ★MITUpdated 41 days ago

    git clone https://github.com/tirth8205/code-review-graph.git
  22. AI+金融(量化):1.多因子股票量化框架开源教程 2.学界和业界的经典资料收录 3.AI + 金融的相关工作,包括LLM, Agent, benchmark(evaluation), etc.

    Indexed GitHub, Barca0412 1,883 ★MITUpdated yesterday

    git clone https://github.com/Barca0412/Introduction-to-Quantitative-Finance.git
  23. Awesome-GraphRAG

    AI repositories

    Awesome-GraphRAG: A curated list of resources (surveys, papers, benchmarks, and opensource projects) on graph-based retrieval-augmented generation.

    Stale GitHub, DEEP-PolyU 2,674 ★MITUpdated 5 months ago

    git clone https://github.com/DEEP-PolyU/Awesome-GraphRAG.git
  24. VLMEvalKit

    AI repositories

    Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

    Indexed GitHub, open-compass 4,487 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/open-compass/VLMEvalKit.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.