InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

170 results with any of your words Clear search and filters

Looks like a goal we have a starting path for: I want to research potential clients

  1. awesome-ai-gateway

    Datasets & benchmarks

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    Indexed GitHub, cuihuan 158 ★CC0-1.0Updated 2 days ago

    git clone https://github.com/cuihuan/awesome-ai-gateway.git
  2. ChinaTravel

    Datasets & benchmarks

    ChinaTravel: A Real-World Benchmark for Language Agents in Chinese Travel Planning

    Stale GitHub, LAMDA-NeSy 133 ★MITUpdated 2 months ago

    git clone https://github.com/LAMDA-NeSy/ChinaTravel.git
  3. WideSearch

    Datasets & benchmarks

    WideSearch: Benchmarking Agentic Broad Info-Seeking

    Stale GitHub, ByteDance-Seed 156 ★MITUpdated 13 months ago

    git clone https://github.com/ByteDance-Seed/WideSearch.git
  4. minebench

    Datasets & benchmarks

    Minecraft-style voxel benchmark for comparing AI models (Arena + Sandbox)

    Indexed GitHub, Ammaar-Alam 343 ★MITUpdated 5 days ago

    git clone https://github.com/Ammaar-Alam/minebench.git
  5. strix-halo-guide

    Datasets & benchmarks

    Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

    Stale GitHub, hogeheer499-commits 373 ★MITUpdated 8 days ago

    git clone https://github.com/hogeheer499-commits/strix-halo-guide.git
  6. sec-code-bench

    Datasets & benchmarks

    SecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).

    Stale GitHub, alibaba 135 ★Apache-2.0Updated 36 days ago

    git clone https://github.com/alibaba/sec-code-bench.git
  7. SciCode

    Datasets & benchmarks

    A benchmark that challenges language models to code solutions for scientific problems

    Stale GitHub, scicode-bench 246 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/scicode-bench/SciCode.git
  8. LMeterX

    Datasets & benchmarks

    A general-purpose API load testing platform that supports LLM services、A2A/MCP services and business HTTP interfaces, enabling one-click performance testing, result comparison, and AI-powered intelligent analysis and summarization. 一站式通用 API 压测平台,支持大模型推理业/务 HTTP 接口、A2A/MCP服务,一键完成性能测试、结果对比与 AI 智能分析总结

    Stale GitHub, MigoXLab 212 ★Apache-2.0Updated 56 days ago

    git clone https://github.com/MigoXLab/LMeterX.git
  9. TurtleBench

    Datasets & benchmarks

    TurtleBench: Evaluating Top Language Models via Real-World Yes/No Puzzles.

    Stale GitHub, mazzzystar 161 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/mazzzystar/TurtleBench.git
  10. PhysGym

    Datasets & benchmarks

    A benchmark suite for evaluating LLM-based interactive scientific reasoning.

    Indexed GitHub, principia-ai 103 ★MITUpdated 4 days ago

    git clone https://github.com/principia-ai/PhysGym.git
  11. MedXpertQA

    Datasets & benchmarks

    [ICML 2025] MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding

    Stale GitHub, TsinghuaC3I 182 ★MITUpdated 2 months ago

    git clone https://github.com/TsinghuaC3I/MedXpertQA.git
  12. xVerify

    Datasets & benchmarks

    xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

    Stale GitHub, IAAR-Shanghai 150 ★Custom licence (see repository)Updated 20 days ago

    git clone https://github.com/IAAR-Shanghai/xVerify.git
  13. ai-village

    Datasets & benchmarks

    Hugging Face dataset by aidigestorg

    Stale Hugging Face Hub, aidigestorg 138 ♥otherUpdated 41 days ago 1 note

    aidigestorg/ai-village
  14. active_genie

    Datasets & benchmarks

    The Lodash for GenAI: Real Value + Consistent + Model-Agnostic

    Stale GitHub, Roriz 168 ★Apache-2.0Updated 3 months ago

    git clone https://github.com/Roriz/active_genie.git
  15. AnswerCarefully

    Datasets & benchmarks

    Hugging Face dataset by llm-jp

    Stale Hugging Face Hub, llm-jp 187 ♥otherUpdated 2 months ago 1 note

    llm-jp/AnswerCarefully
  16. turnkeyml

    Datasets & benchmarks

    No-code CLI designed for accelerating ONNX workflows

    Stale GitHub, onnx 247 ★Apache-2.0Updated 4 months ago

    git clone https://github.com/onnx/turnkeyml.git
  17. prism

    Datasets & benchmarks

    Открытый бенчмарк LLM: какая нейросеть лучше пишет код 1С:Предприятие (BSL). Объективная оценка LLM по методике SMOP с реальным исполнением в 1С — Claude, GPT, Gemini, DeepSeek, YandexGPT, GigaChat.

    Stale GitHub, genlab-1c 55 ★MITUpdated 19 days ago

    git clone https://github.com/genlab-1c/prism.git
  18. alem-env

    Datasets & benchmarks

    Can LLM/MARL agents coordinate in long-horizon, open-ended tasks? NeurIPS 2026 (Evaluations and Datasets).

    Stale GitHub, alem-world 57 ★MITUpdated 12 days ago

    git clone https://github.com/alem-world/alem-env.git
  19. inferock-bench

    Datasets & benchmarks

    Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.

    Stale GitHub, inferock 107 ★Custom licence (see repository)Updated 3 months ago

    git clone https://github.com/inferock/inferock-bench.git
  20. UltraData-Math

    Datasets & benchmarks

    Hugging Face dataset by openbmb

    Indexed Hugging Face Hub, openbmb 365 ♥apache-2.0Updated 7 months ago

    openbmb/UltraData-Math
  21. AutoMathText

    Datasets & benchmarks

    Hugging Face dataset by math-ai

    Stale Hugging Face Hub, math-ai 194 ♥cc-by-sa-4.0Updated 16 months ago

    math-ai/AutoMathText
  22. Multi-User-LLM-Agent

    Datasets & benchmarks

    Official code for the paper: "Multi-User Large Language Model Agents"

    Stale GitHub, Kordi-AI 39 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/Kordi-AI/Multi-User-LLM-Agent.git
  23. deepmark

    Datasets & benchmarks

    Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.

    Stale GitHub, IngestAI 104 ★AGPL-3.0Updated 2 years ago

    git clone https://github.com/IngestAI/deepmark.git
  24. UltraX-Preview

    Datasets & benchmarks

    Hugging Face dataset by openbmb

    Indexed Hugging Face Hub, openbmb 301 ♥apache-2.0Updated 4 months ago

    openbmb/UltraX-Preview

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.