InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

53 results with any of your words Clear search and filters
  1. vidore-benchmark

    AI repositories

    Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.

    Stale GitHub, illuin-tech 278 ★MITUpdated 27 days ago

    git clone https://github.com/illuin-tech/vidore-benchmark.git
  2. benchmark-qed

    AI repositories

    Automated benchmarking of Retrieval-Augmented Generation (RAG) systems

    Stale GitHub, microsoft 103 ★MITUpdated 10 days ago

    git clone https://github.com/microsoft/benchmark-qed.git
  3. mempalace

    AI repositories

    The best-benchmarked open-source AI memory system. And it's free.

    Stale GitHub, MemPalace 60.5k ★MITUpdated 4 days ago

    git clone https://github.com/MemPalace/mempalace.git
  4. folkbench

    AI repositories

    帮你的 AI 编程工具找到不降智、不断连、高性价比的好线路 · Live LLM relay rankings, model integrity probes & Tauri/Rust switcher for Claude Code, Codex & Gemini CLI

    Indexed GitHub, Folkbench 3,883 ★Custom licence (see repository)Updated today

    git clone https://github.com/Folkbench/folkbench.git
  5. beir

    AI repositories

    A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

    Stale GitHub, beir-cellar 2,310 ★Apache-2.0Updated 13 months ago

    git clone https://github.com/beir-cellar/beir.git
  6. SDGym

    AI repositories

    Benchmarking synthetic data generation methods.

    Indexed GitHub, sdv-dev 313 ★Custom licence (see repository)Updated today

    git clone https://github.com/sdv-dev/SDGym.git
  7. docext

    AI repositories

    An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)

    Stale GitHub, NanoNets 2,083 ★Apache-2.0Updated 8 months ago

    git clone https://github.com/NanoNets/docext.git
  8. Gym

    AI repositories

    Evaluate and improve models and agents using environments

    Indexed GitHub, NVIDIA-NeMo 1,334 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA-NeMo/Gym.git
  9. toon

    AI repositories

    🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.

    Stale GitHub, toon-format 25.5k ★MITUpdated 38 days ago

    git clone https://github.com/toon-format/toon.git
  10. DreamLayer-Eval

    AI repositories

    DreamLayer Eval: open-source benchmarking for image and video diffusion models. Automate prompts, seeds, and metrics for reproducible results. A research project from DreamLayer AI (dreamlayer.io).

    Stale GitHub, TheDesignFounder 412 ★GPL-3.0Updated 17 days ago

    git clone https://github.com/TheDesignFounder/DreamLayer-Eval.git
  11. EnterpriseRAG-Bench

    AI repositories

    Dataset and benchmark for RAG on company internal documents.

    Stale GitHub, onyx-dot-app 592 ★MITUpdated 2 months ago

    git clone https://github.com/onyx-dot-app/EnterpriseRAG-Bench.git
  12. evalscope

    AI repositories

    A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

    Indexed GitHub, modelscope 3,697 ★Apache-2.0Updated today

    git clone https://github.com/modelscope/evalscope.git
  13. agentic-ai

    AI repositories

    Agentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.

    Indexed GitHub, mahmoudrabie 193 ★MITUpdated 2 days ago

    git clone https://github.com/mahmoudrabie/agentic-ai.git
  14. XRAG

    AI repositories

    XRAG: eXamining the Core - Benchmarking Foundational Component Modules in Advanced Retrieval-Augmented Generation

    Stale GitHub, DocAILab 611 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/DocAILab/XRAG.git
  15. VLM2Vec

    AI repositories

    This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]

    Stale GitHub, TIGER-AI-Lab 696 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/TIGER-AI-Lab/VLM2Vec.git
  16. somali-language-standard

    AI repositories

    The open, machine-readable standard for the Somali language — orthography, grammar, terminology, translation, and AI/benchmark resources, as a versioned, citable RFC-style catalog.

    Stale GitHub, somastllc 108 ★MITUpdated 19 days ago

    git clone https://github.com/somastllc/somali-language-standard.git
  17. AI+金融(量化):1.多因子股票量化框架开源教程 2.学界和业界的经典资料收录 3.AI + 金融的相关工作,包括LLM, Agent, benchmark(evaluation), etc.

    Indexed GitHub, Barca0412 1,883 ★MITUpdated yesterday

    git clone https://github.com/Barca0412/Introduction-to-Quantitative-Finance.git
  18. code-review-graph

    AI repositories

    Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo workflows.

    Stale GitHub, tirth8205 32.2k ★MITUpdated 41 days ago

    git clone https://github.com/tirth8205/code-review-graph.git
  19. Awesome-GraphRAG

    AI repositories

    Awesome-GraphRAG: A curated list of resources (surveys, papers, benchmarks, and opensource projects) on graph-based retrieval-augmented generation.

    Stale GitHub, DEEP-PolyU 2,674 ★MITUpdated 5 months ago

    git clone https://github.com/DEEP-PolyU/Awesome-GraphRAG.git
  20. VLMEvalKit

    AI repositories

    Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

    Indexed GitHub, open-compass 4,487 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/open-compass/VLMEvalKit.git
  21. agentops

    AI repositories

    Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI

    Stale GitHub, AgentOps-AI 5,885 ★MITUpdated 4 months ago

    git clone https://github.com/AgentOps-AI/agentops.git
  22. awesome-decision-models

    AI repositories

    A curated list of decision models (System One / typed decision models): hosted APIs, open-weight models, runtimes, SDKs, applications, benchmarks, and papers.

    Stale GitHub, AnotiaWang 699 ★CC0-1.0Updated 7 days ago

    git clone https://github.com/AnotiaWang/awesome-decision-models.git
  23. fastRAG

    AI repositories

    Efficient Retrieval Augmentation and Generation Framework

    Stale Archived GitHub, IntelLabs 1,786 ★Apache-2.0Updated 10 months ago 1 note

    git clone https://github.com/IntelLabs/fastRAG.git
  24. hermes-official-plugins

    AI repositories

    ☤ The official plugins for Hermes Agent, built and maintained by Nous Research: Home Assistant, Spotify, Claude Subscription DirectSDK and more, one install away from the Hermes plugin catalog.

    Indexed GitHub, NousResearch 726 ★MITUpdated yesterday

    git clone https://github.com/NousResearch/hermes-official-plugins.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.