InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

5,854 results with any of your words Clear search and filters

Looks like a goal we have a starting path for: I want to research potential clients

  1. llm-perf-leaderboard

    Tools & apps

    Hugging Face space by optimum

    Indexed Hugging Face Hub, optimum 593 ♥Updated 15 months ago 1 note

    optimum/llm-perf-leaderboard
  2. open_llm_leaderboard

    Tools & apps

    Hugging Face space by open-llm-leaderboard

    Indexed Hugging Face Hub, open-llm-leaderboard 14.2k ♥Updated 5 months ago 1 note

    open-llm-leaderboard/open_llm_leaderboard
  3. Hugging Face space by upstage

    Indexed Hugging Face Hub, upstage 567 ♥Updated 23 months ago 1 note

    upstage/open-ko-llm-leaderboard
  4. hallucination-leaderboard

    AI repositories

    Leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents

    Stale GitHub, vectara 3,323 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/vectara/hallucination-leaderboard.git
  5. Hugging Face dataset by gorilla-llm

    Stale Hugging Face Hub, gorilla-llm 135 ♥apache-2.0Updated 6 months ago

    gorilla-llm/Berkeley-Function-Calling-Leaderboard
  6. arena-ai-leaderboards

    Datasets & benchmarks

    📊 Daily auto-updated snapshots of all Arena AI (LMSYS Chatbot Arena) leaderboards — LLM, Vision, Code, Video, Image & more. Structured JSON with historical tracking.

    Indexed GitHub, oolong-tea-2026 42 ★MITUpdated yesterday

    git clone https://github.com/oolong-tea-2026/arena-ai-leaderboards.git
  7. RouterArena

    Agents & frameworks

    RouterArena: An open framework for evaluating LLM routers with standardized datasets, metrics, an automated framework, and a live leaderboard.

    Stale GitHub, RouteWorks 157 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/RouteWorks/RouterArena.git
  8. Awesome-LLM-Eval

    Datasets & benchmarks

    Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

    Stale GitHub, onejune2018 659 ★MITUpdated 11 months ago

    git clone https://github.com/onejune2018/Awesome-LLM-Eval.git
  9. lora-speedrun

    Datasets & benchmarks

    Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

    Stale GitHub, Saivineeth147 149 ★MITUpdated 2 months ago

    git clone https://github.com/Saivineeth147/lora-speedrun.git
  10. ai-model-world

    Datasets & benchmarks

    AI 大模型世界,把 556 个大模型拟人化成像素小人的可视化站点。进来就能看到此刻谁最聪明、谁最会写代码、谁最便宜、谁刚发布,往下是国内与国外分区的厂商广场、完整的发布时间线和多维排行榜。搜索认模型名、厂商和能力,输入「多模态」会直接列出全部多模态模型。数据取自 Epoch AI、models.dev、LiveBench 与 Hugging Face,每小时自动同步,所有文案由真实数据生成,不调用任何 LLM。Next.js 静态导出,零后端。

    Indexed GitHub, liyupi 274 ★MITUpdated today

    git clone https://github.com/liyupi/ai-model-world.git
  11. ClawProBench

    Datasets & benchmarks

    ClawProBench is a live-first benchmark harness for evaluating LLM agents in the OpenClaw runtime with deterministic grading and repeated-trial reliability.

    Stale GitHub, suyoumo 825 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/suyoumo/ClawProBench.git
  12. ds4-on-spark

    Datasets & benchmarks

    Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support

    Stale GitHub, Entrpi 409 ★MITUpdated 2 months ago

    git clone https://github.com/Entrpi/ds4-on-spark.git
  13. FastEval

    Datasets & benchmarks

    Fast & more realistic evaluation of chat language models. Includes leaderboard.

    Stale GitHub, FastEval 187 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/FastEval/FastEval.git
  14. confabulations

    Datasets & benchmarks

    Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.

    Stale GitHub, lechmazur 249 ★Updated 15 months ago

    git clone https://github.com/lechmazur/confabulations.git
  15. api-perf-analyzer

    MCP servers

    Cloudflare Workers MCP server: api-perf-analyzer

    Stale Official MCP Registry, io.github.lazymac2x Updated 6 months ago 1 note

  16. polymarket-paper-trader

    Datasets & benchmarks

    Paper trading simulator for Polymarket

    Stale GitHub, agent-next 495 ★MITUpdated 15 days ago

    git clone https://github.com/agent-next/polymarket-paper-trader.git
  17. GPT-X3-150M

    Models

    text generation model by AxiomicLabs · transformers

    Stale Hugging Face Hub, AxiomicLabs 98 ♥apache-2.0Updated 22 days ago

    AxiomicLabs/GPT-X3-150M
  18. debate

    Datasets & benchmarks

    Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance.

    Stale GitHub, lechmazur 38 ★Updated 21 days ago

    git clone https://github.com/lechmazur/debate.git
  19. perf

    MCP servers

    Benchmark, memory, Big O analysis for AI agents

    Stale Official MCP Registry, io.github.rog0x Updated 7 months ago 1 note

    @rog0x/mcp-perf-tools@1.0.2
  20. perf-mcp

    MCP servers

    Fact-check and fix AI outputs. Hallucination detection, schema validation, auto-repair.

    Stale Official MCP Registry, io.github.Perf-AI Updated 9 months ago 2 notes

    perf-mcp@0.1.1
  21. evaluation-guidebook

    Docs & tutorials

    Sharing both practical insights and theoretical knowledge about LLM evaluation that we gathered while managing the Open LLM Leaderboard and designing lighteval!

    Stale GitHub, huggingface 2,155 ★Custom licence (see repository)Updated 11 months ago

    git clone https://github.com/huggingface/evaluation-guidebook.git
  22. claude-opus-4-6-high leads Arena coding at 1535. Anthropic has held #1 for 280 days, but Z.ai.

    Stale Official MCP Registry, com.modevc Updated 29 days ago 1 note

  23. leaderboard

    Tools & apps

    Hugging Face space by mteb

    Indexed Hugging Face Hub, mteb 7,774 ♥Updated today 1 note

    mteb/leaderboard
  24. The gap between Arena's #1 and #10 models fell from 148 points in Feb 2024 to 18. #10 now wins.

    Stale Official MCP Registry, com.modevc Updated 29 days ago 1 note

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.