InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. openbench

    Datasets & benchmarks

    Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost

    Stale GitHub, minghinmatthewlam 137 ★MITUpdated 2 months ago

    git clone https://github.com/minghinmatthewlam/openbench.git
  2. strix-halo-guide

    Datasets & benchmarks

    Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

    Stale GitHub, hogeheer499-commits 373 ★MITUpdated 7 days ago

    git clone https://github.com/hogeheer499-commits/strix-halo-guide.git
  3. LMeterX

    Datasets & benchmarks

    A general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结

    Stale GitHub, MigoXLab 212 ★Apache-2.0Updated 55 days ago

    git clone https://github.com/MigoXLab/LMeterX.git
  4. llm-value-rankings

    Datasets & benchmarks

    Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

    Indexed GitHub, yyh-001 30 ★MITUpdated yesterday

    git clone https://github.com/yyh-001/llm-value-rankings.git
  5. primitive-bench

    Datasets & benchmarks

    The marketplace for verifiable AI outcomes: state a task, get a fixed price upfront, and Primitive Bench routes across tools to complete it, refunded if the outcome isn't delivered. This repo is the open verification layer.

    Stale GitHub, primitive-bench 122 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/primitive-bench/primitive-bench.git
  6. qwen38-strix-halo-harness

    Datasets & benchmarks

    AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.

    Stale GitHub, aic0d3r 38 ★MITUpdated 8 days ago

    git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git
  7. NIMStats

    Datasets & benchmarks

    📊 Automated hourly benchmarks for 20+ NVIDIA NIM models — interactive dashboard, zero infra, self-hostable. Open-source & community-driven.

    Indexed GitHub, MauroDruwel 57 ★Updated today

    git clone https://github.com/MauroDruwel/NIMStats.git
  8. awesome-ai-gateway

    Datasets & benchmarks

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    Indexed GitHub, cuihuan 158 ★CC0-1.0Updated yesterday

    git clone https://github.com/cuihuan/awesome-ai-gateway.git
  9. lasagna

    Datasets & benchmarks

    Swap one RAG pipeline stage, hold the rest fixed, and measure whether the gain survives composition. The framework behind "Retrieval Augmented Generation Compositionality": 450 configurations, eight benchmarks, corpora from 5K to 200K documents.

    Indexed GitHub, dolev31 35 ★Apache-2.0Updated yesterday

    git clone https://github.com/dolev31/lasagna.git
  10. DishwasherBench

    Datasets & benchmarks

    A dishwasher-loading game on a physical simulation of one real machine, built to benchmark language models and playable in a browser. The game inside is called Spotless.

    Stale GitHub, composo-ai 71 ★MITUpdated 30 days ago

    git clone https://github.com/composo-ai/DishwasherBench.git
  11. ai-hardware-fit

    Datasets & benchmarks

    Can my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.

    Indexed GitHub, jaeseok614 44 ★MITUpdated today

    git clone https://github.com/jaeseok614/ai-hardware-fit.git
  12. teor

    Datasets & benchmarks

    Benchmark aberto de LLMs para o processo legislativo brasileiro

    Stale GitHub, como-votam 30 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/como-votam/teor.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.