InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

6,394 results with any of your words Clear search and filters

Looks like a goal we have a starting path for: I want to research potential clients

  1. llm-perf-leaderboard

    Tools & apps

    Hugging Face space by optimum

    Indexed Hugging Face Hub, optimum 593 ♥Updated 15 months ago 1 note

    optimum/llm-perf-leaderboard
  2. hallucination-leaderboard

    AI repositories

    Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

    Stale GitHub, vectara 3,323 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/vectara/hallucination-leaderboard.git
  3. debate

    Datasets & benchmarks

    Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance.

    Stale GitHub, lechmazur 38 ★Updated 21 days ago

    git clone https://github.com/lechmazur/debate.git
  4. open_llm_leaderboard

    Tools & apps

    Hugging Face space by open-llm-leaderboard

    Indexed Hugging Face Hub, open-llm-leaderboard 14.2k ♥Updated 5 months ago 1 note

    open-llm-leaderboard/open_llm_leaderboard
  5. Hugging Face space by upstage

    Indexed Hugging Face Hub, upstage 567 ♥Updated 23 months ago 1 note

    upstage/open-ko-llm-leaderboard
  6. Hugging Face dataset by gorilla-llm

    Stale Hugging Face Hub, gorilla-llm 135 ♥apache-2.0Updated 6 months ago

    gorilla-llm/Berkeley-Function-Calling-Leaderboard
  7. Real-time performance and profit leaderboard for the GenPark Alpha Layer. Showcasing the most efficient nodes in the agent economy.

    Stale GitHub, Alpha-Park 8 ★MITUpdated 16 days ago

    git clone https://github.com/Alpha-Park/openclaw-genpark-alpha-leaderboard.git
  8. arena-ai-leaderboards

    Datasets & benchmarks

    📊 Daily auto-updated snapshots of all Arena AI (LMSYS Chatbot Arena) leaderboards — LLM, Vision, Code, Video, Image & more. Structured JSON with historical tracking.

    Indexed GitHub, oolong-tea-2026 42 ★MITUpdated yesterday

    git clone https://github.com/oolong-tea-2026/arena-ai-leaderboards.git
  9. RouterArena

    Agents & frameworks

    RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

    Stale GitHub, RouteWorks 157 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/RouteWorks/RouterArena.git
  10. Awesome-LLM-Eval

    Datasets & benchmarks

    Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

    Stale GitHub, onejune2018 659 ★MITUpdated 11 months ago

    git clone https://github.com/onejune2018/Awesome-LLM-Eval.git
  11. lora-speedrun

    Datasets & benchmarks

    Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

    Stale GitHub, Saivineeth147 149 ★MITUpdated 2 months ago

    git clone https://github.com/Saivineeth147/lora-speedrun.git
  12. ai-model-world

    Datasets & benchmarks

    AI 大模型世界,把 556 个大模型拟人化成像素小人的可视化站点。进来就能看到此刻谁最聪明、谁最会写代码、谁最便宜、谁刚发布,往下是国内与国外分区的厂商广场、完整的发布时间线和多维排行榜。搜索认模型名、厂商和能力,输入「多模态」会直接列出全部多模态模型。数据取自 Epoch AI、models.dev、LiveBench 与 Hugging Face,每小时自动同步,所有文案由真实数据生成,不调用任何 LLM。Next.js 静态导出,零后端。

    Indexed GitHub, liyupi 274 ★MITUpdated today

    git clone https://github.com/liyupi/ai-model-world.git
  13. ClawProBench

    Datasets & benchmarks

    ClawProBench is a live-first benchmark harness for evaluating LLM agents in the OpenClaw runtime with deterministic grading and repeated-trial reliability.

    Stale GitHub, suyoumo 825 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/suyoumo/ClawProBench.git
  14. FastEval

    Datasets & benchmarks

    Fast & more realistic evaluation of chat language models. Includes leaderboard.

    Stale GitHub, FastEval 187 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/FastEval/FastEval.git
  15. confabulations

    Datasets & benchmarks

    Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.

    Stale GitHub, lechmazur 249 ★Updated 15 months ago

    git clone https://github.com/lechmazur/confabulations.git
  16. polymarket-paper-trader

    Datasets & benchmarks

    Paper trading simulator for Polymarket

    Stale GitHub, agent-next 495 ★MITUpdated 15 days ago

    git clone https://github.com/agent-next/polymarket-paper-trader.git
  17. evalscope

    AI repositories

    A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

    Indexed GitHub, modelscope 3,697 ★Apache-2.0Updated today

    git clone https://github.com/modelscope/evalscope.git
  18. GPT-X3-150M

    Models

    text generation model by AxiomicLabs · transformers

    Stale Hugging Face Hub, AxiomicLabs 98 ♥apache-2.0Updated 22 days ago

    AxiomicLabs/GPT-X3-150M
  19. uzu

    AI repositories

    A high-performance inference engine for AI models

    Indexed GitHub, trymirai 3,351 ★MITUpdated today

    git clone https://github.com/trymirai/uzu.git
  20. openlake

    AI repositories

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Stale GitHub, openlake-project 2,851 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/openlake-project/openlake.git
  21. evaluation-guidebook

    Docs & tutorials

    Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

    Stale GitHub, huggingface 2,155 ★Custom licence (see repository)Updated 11 months ago

    git clone https://github.com/huggingface/evaluation-guidebook.git
  22. claude-opus-4-6-high leads Arena coding at 1535. Anthropic has held #1 for 280 days, but Z.ai.

    Stale Official MCP Registry, com.modevc Updated 29 days ago 1 note

  23. A faster version of Whisper built on CTranslate2.

    Hand-checked InnerVault (hand-checked), SYSTRAN MIT

    pip install faster-whisper
  24. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.