InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. arena-ai-leaderboards

    Datasets & benchmarks

    📊 Daily auto-updated snapshots of all Arena AI (LMSYS Chatbot Arena) leaderboards — LLM, Vision, Code, Video, Image & more. Structured JSON with historical tracking.

    Indexed GitHub, oolong-tea-2026 42 ★MITUpdated yesterday

    git clone https://github.com/oolong-tea-2026/arena-ai-leaderboards.git
  2. llmspeed

    Datasets & benchmarks

    Feel how fast a local LLM runs before you buy the hardware

    Stale GitHub, nicorobinreal 152 ★MITUpdated 27 days ago

    git clone https://github.com/nicorobinreal/llmspeed.git
  3. civ6-mcp

    Datasets & benchmarks

    An MCP server that lets LLM agents play Civilization VI.

    Stale GitHub, lmwilki 218 ★MITUpdated 34 days ago

    git clone https://github.com/lmwilki/civ6-mcp.git
  4. meta-agents-research-environments

    Datasets & benchmarks

    Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.

    Stale GitHub, facebookresearch 567 ★MITUpdated 47 days ago

    git clone https://github.com/facebookresearch/meta-agents-research-environments.git
  5. DeepPlanning

    Datasets & benchmarks

    Hugging Face dataset by Qwen

    Stale Hugging Face Hub, Qwen 220 ♥apache-2.0Updated 8 months ago

    Qwen/DeepPlanning
  6. polymarket-paper-trader

    Datasets & benchmarks

    Paper trading simulator for Polymarket

    Stale GitHub, agent-next 495 ★MITUpdated 15 days ago

    git clone https://github.com/agent-next/polymarket-paper-trader.git
  7. strix-halo-guide

    Datasets & benchmarks

    Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

    Stale GitHub, hogeheer499-commits 373 ★MITUpdated 7 days ago

    git clone https://github.com/hogeheer499-commits/strix-halo-guide.git
  8. BusterX

    Datasets & benchmarks

    [NeurIPS '26] BusterX & [EACL '27 Findings] BusterX++

    Indexed GitHub, l8cv 52 ★BSD-3-ClauseUpdated 3 days ago

    git clone https://github.com/l8cv/BusterX.git
  9. XRAG

    AI repositories

    XRAG: eXamining the Core - Benchmarking Foundational Component Modules in Advanced Retrieval-Augmented Generation

    Stale GitHub, DocAILab 611 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/DocAILab/XRAG.git
  10. gamebot

    Datasets & benchmarks

    [ACL 2025] GAMEBoT: Transparent Assessment of LLM Reasoning in Games

    Stale GitHub, Visual-AI 36 ★Updated 10 days ago

    git clone https://github.com/Visual-AI/gamebot.git
  11. aseprite-ai-artist

    MCP servers

    Your coding agent paints pixel art in the Aseprite window you already have open. MCP server + skills for Claude Code, omp, Codex, Gemini CLI and Cursor — draws, looks at its work, animates and exports. Gallery and benchmark: pixeli.pebbly.space

    Stale GitHub, with-pebbly 322 ★MITUpdated 34 days ago

    git clone https://github.com/with-pebbly/aseprite-ai-artist.git
  12. lora-speedrun

    Datasets & benchmarks

    Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

    Stale GitHub, Saivineeth147 149 ★MITUpdated 2 months ago

    git clone https://github.com/Saivineeth147/lora-speedrun.git
  13. MiroFlow

    Agents & frameworks

    🏆 Top-1 on 5+ benchmarks | Web UI | Supports MiroThinker, Claude, Kimi, OpenAI

    Stale GitHub, MiroMindAI 3,120 ★Apache-2.0Updated 4 months ago

    git clone https://github.com/MiroMindAI/MiroFlow.git
  14. VLM2Vec

    AI repositories

    This repo contains the code for "VLM2Vec / MMEB" [ICLR 2025], "VLM2Vec-V2 / MMEB-V2" [TMLR 2026], and "MMEB-V3" [COLM 2026]

    Stale GitHub, TIGER-AI-Lab 696 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/TIGER-AI-Lab/VLM2Vec.git
  15. prism

    Datasets & benchmarks

    Открытый бенчмарк LLM: какая нейросеть лучше пишет код 1С:Предприятие (BSL). Объективная оценка LLM по методике SMOP с реальным исполнением в 1С — Claude, GPT, Gemini, DeepSeek, YandexGPT, GigaChat.

    Stale GitHub, genlab-1c 55 ★MITUpdated 18 days ago

    git clone https://github.com/genlab-1c/prism.git
  16. tmmluplus

    Datasets & benchmarks

    Hugging Face dataset by ikala

    Indexed Hugging Face Hub, ikala 242 ♥mitUpdated 54 days ago

    ikala/tmmluplus
  17. VIBE

    Datasets & benchmarks

    Hugging Face dataset by MiniMaxAI

    Indexed Hugging Face Hub, MiniMaxAI 288 ♥mitUpdated 10 months ago

    MiniMaxAI/VIBE
  18. Curated Claude Fable 5.2 use cases, tutorials, integrations, demos, and benchmark evidence with source links and multilingual README files.

    Indexed GitHub, EvoLinkAI 84 ★Custom licence (see repository)Updated 2 days ago

    git clone https://github.com/EvoLinkAI/awesome-claude-fable-5-2-use-cases.git
  19. Ultimate Claude Fable 5 Guide 2026: Use Cases, Integrations & Benchmarks

    Indexed GitHub, thenicolas1894 143 ★Updated today

    git clone https://github.com/thenicolas1894/awesome-claude-fable-5-prompt-vault.git
  20. CL-bench

    Datasets & benchmarks

    Hugging Face dataset by tencent

    Stale Hugging Face Hub, tencent 148 ♥otherUpdated 9 months ago

    tencent/CL-bench
  21. legalbench

    Datasets & benchmarks

    Hugging Face dataset by nguha

    Stale Hugging Face Hub, nguha 194 ♥cc-by-4.0Updated 7 months ago

    nguha/legalbench
  22. LightCompress

    Datasets & benchmarks

    [EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.

    Stale GitHub, ModelTC 751 ★Apache-2.0Updated 6 months ago

    git clone https://github.com/ModelTC/LightCompress.git
  23. self-bench

    Datasets & benchmarks

    Benchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.

    Indexed GitHub, mupt-ai 34 ★MITUpdated today

    git clone https://github.com/mupt-ai/self-bench.git
  24. dataset

    Prompts

    Generative AI-based CyberSecurity-focused Prompt Dataset for Benchmarking Large Language Models

    Stale GitHub, cysecbench 50 ★MITUpdated 22 months ago

    git clone https://github.com/cysecbench/dataset.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.