InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

21 results with any of your words Clear search and filters

Looks like a goal we have a starting path for: I want to connect AI to my tools

  1. UHGEval

    Datasets & benchmarks

    [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.

    Stale GitHub, IAAR-Shanghai 183 ★Apache-2.0Updated 17 months ago

    git clone https://github.com/IAAR-Shanghai/UHGEval.git
  2. TrustLLM

    Datasets & benchmarks

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    Stale GitHub, HowieHwong 632 ★MITUpdated 43 days ago

    git clone https://github.com/HowieHwong/TrustLLM.git
  3. openai_humaneval

    Datasets & benchmarks

    Hugging Face dataset by openai

    Indexed Hugging Face Hub, openai 417 ♥mitUpdated 2 years ago

    openai/openai_humaneval
  4. awesome-ai-gateway

    Datasets & benchmarks

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    Indexed GitHub, cuihuan 158 ★CC0-1.0Updated yesterday

    git clone https://github.com/cuihuan/awesome-ai-gateway.git
  5. healthbench

    Datasets & benchmarks

    Hugging Face dataset by openai

    Stale Hugging Face Hub, openai 184 ♥mitUpdated 14 months ago

    openai/healthbench
  6. gdpval

    Datasets & benchmarks

    Hugging Face dataset by openai

    Indexed Hugging Face Hub, openai 576 ♥Updated 9 months ago

    openai/gdpval
  7. summarize_from_feedback

    Datasets & benchmarks

    Hugging Face dataset by openai

    Stale Hugging Face Hub, openai 230 ♥Updated 3 years ago

    openai/summarize_from_feedback
  8. webgpt_comparisons

    Datasets & benchmarks

    Hugging Face dataset by openai

    Indexed Hugging Face Hub, openai 252 ♥Updated 3 years ago

    openai/webgpt_comparisons
  9. gsm8k

    Datasets & benchmarks

    Hugging Face dataset by openai

    Indexed Hugging Face Hub, openai 2,046 ♥mitUpdated 7 months ago

    openai/gsm8k
  10. frontierscience

    Datasets & benchmarks

    Hugging Face dataset by openai

    Stale Hugging Face Hub, openai 178 ♥apache-2.0Updated 11 months ago

    openai/frontierscience
  11. mrcr

    Datasets & benchmarks

    Hugging Face dataset by openai

    Stale Hugging Face Hub, openai 232 ♥mitUpdated 11 months ago

    openai/mrcr
  12. graphwalks

    Datasets & benchmarks

    Hugging Face dataset by openai

    Stale Hugging Face Hub, openai 138 ♥mitUpdated 2 months ago

    openai/graphwalks
  13. MMMLU

    Datasets & benchmarks

    Hugging Face dataset by openai

    Indexed Hugging Face Hub, openai 539 ♥mitUpdated 2 years ago

    openai/MMMLU
  14. llm-bulls-and-cows-benchmark

    Datasets & benchmarks

    A mini-framework for evaluating LLM performance on the Bulls and Cows number guessing game, supporting multiple LLM providers.

    Stale GitHub, stalkermustang 235 ★MITUpdated 21 months ago

    git clone https://github.com/stalkermustang/llm-bulls-and-cows-benchmark.git
  15. inferock-bench

    Datasets & benchmarks

    Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.

    Stale GitHub, inferock 107 ★Custom licence (see repository)Updated 3 months ago

    git clone https://github.com/inferock/inferock-bench.git
  16. opencompass

    Datasets & benchmarks

    OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

    Indexed GitHub, open-compass 7,596 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/open-compass/opencompass.git
  17. ResearchClawBench

    Datasets & benchmarks

    🦞 ResearchClawBench: Evaluating AI Agents for Automated Research from Re-Discovery to New-Discovery

    Stale GitHub, InternScience 275 ★MITUpdated 19 days ago

    git clone https://github.com/InternScience/ResearchClawBench.git
  18. Awesome-LLM-Eval

    Datasets & benchmarks

    Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

    Stale GitHub, onejune2018 659 ★MITUpdated 11 months ago

    git clone https://github.com/onejune2018/Awesome-LLM-Eval.git
  19. qwen38-strix-halo-harness

    Datasets & benchmarks

    AI coding agent harness for any hardware, local or cloud (OpenAI-compatible engines). Tuned for AMD Strix Halo: Qwen3.8 125B on the iGPU, NPU side-jobs, crash recovery, logged benchmarks.

    Stale GitHub, aic0d3r 38 ★MITUpdated 8 days ago

    git clone https://github.com/aic0d3r/qwen38-strix-halo-harness.git
  20. multi-agents

    Datasets & benchmarks

    Multi-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.

    Stale GitHub, BichengWang 158 ★MITUpdated 8 days ago

    git clone https://github.com/BichengWang/multi-agents.git
  21. LMeterX

    Datasets & benchmarks

    A general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结

    Stale GitHub, MigoXLab 212 ★Apache-2.0Updated 55 days ago

    git clone https://github.com/MigoXLab/LMeterX.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.