InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. xVerify

    Datasets & benchmarks

    xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

    Stale GitHub, IAAR-Shanghai 150 ★Custom licence (see repository)Updated 19 days ago

    git clone https://github.com/IAAR-Shanghai/xVerify.git
  2. TrustLLM

    Datasets & benchmarks

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    Stale GitHub, HowieHwong 632 ★MITUpdated 43 days ago

    git clone https://github.com/HowieHwong/TrustLLM.git
  3. MegaMath

    Datasets & benchmarks

    Hugging Face dataset by IFM

    Stale Hugging Face Hub, IFM 141 ♥odc-byUpdated 19 months ago

    IFM/MegaMath
  4. spider

    Datasets & benchmarks

    Hugging Face dataset by xlangai

    Stale Hugging Face Hub, xlangai 188 ♥cc-by-sa-4.0Updated 2 years ago

    xlangai/spider
  5. wikisql

    Datasets & benchmarks

    Hugging Face dataset by Salesforce

    Stale Hugging Face Hub, Salesforce 128 ♥unknownUpdated 2 years ago

    Salesforce/wikisql
  6. distilabel-capybara-dpo-7k-binarized

    Datasets & benchmarks

    Hugging Face dataset by argilla

    Stale Hugging Face Hub, argilla 189 ♥apache-2.0Updated 2 years ago

    argilla/distilabel-capybara-dpo-7k-binarized
  7. jupyter-agent-dataset

    Datasets & benchmarks

    Hugging Face dataset by jupyter-agent

    Stale Hugging Face Hub, jupyter-agent 177 ♥apache-2.0Updated 14 months ago

    jupyter-agent/jupyter-agent-dataset
  8. soda

    Datasets & benchmarks

    Hugging Face dataset by allenai

    Stale Hugging Face Hub, allenai 164 ♥cc-by-4.0Updated 3 years ago

    allenai/soda
  9. finephrase

    Datasets & benchmarks

    Hugging Face dataset by HuggingFaceFW

    Stale Hugging Face Hub, HuggingFaceFW 157 ♥odc-byUpdated 7 months ago

    HuggingFaceFW/finephrase
  10. Simreal-MLBench

    Datasets & benchmarks

    [Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.

    Stale GitHub, Simreal-AI 301 ★Apache-2.0Updated 53 days ago

    git clone https://github.com/Simreal-AI/Simreal-MLBench.git
  11. twitter-financial-news-sentiment

    Datasets & benchmarks

    Hugging Face dataset by zeroshot

    Stale Hugging Face Hub, zeroshot 187 ♥mitUpdated 2 years ago

    zeroshot/twitter-financial-news-sentiment
  12. spotify-tracks-dataset

    Datasets & benchmarks

    Hugging Face dataset by maharshipandya

    Stale Hugging Face Hub, maharshipandya 136 ♥bsdUpdated 2 years ago

    maharshipandya/spotify-tracks-dataset
  13. LongPage

    Datasets & benchmarks

    Hugging Face dataset by Pageshift-Entertainment

    Stale Hugging Face Hub, Pageshift-Entertainment 161 ♥cc-by-4.0Updated 10 months ago

    Pageshift-Entertainment/LongPage
  14. apple-silicon-llm-bench

    Datasets & benchmarks

    Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

    Indexed GitHub, john-rocky 73 ★MITUpdated today

    git clone https://github.com/john-rocky/apple-silicon-llm-bench.git
  15. NoLiMa

    Datasets & benchmarks

    Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"

    Stale GitHub, adobe-research 205 ★Custom licence (see repository)Updated 16 months ago

    git clone https://github.com/adobe-research/NoLiMa.git
  16. CodeX-2M-Thinking

    Datasets & benchmarks

    Hugging Face dataset by Modotte

    Stale Hugging Face Hub, Modotte 129 ♥apache-2.0Updated 9 months ago

    Modotte/CodeX-2M-Thinking
  17. OSCAR-2201

    Datasets & benchmarks

    Hugging Face dataset by oscar-corpus

    Stale Hugging Face Hub, oscar-corpus 134 ♥cc0-1.0Updated 15 months ago 1 note

    oscar-corpus/OSCAR-2201
  18. DecisionPivot

    Datasets & benchmarks

    DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.

    Stale GitHub, StartLuxLabs 144 ★Apache-2.0Updated 26 days ago

    git clone https://github.com/StartLuxLabs/DecisionPivot.git
  19. swe-sweep

    Datasets & benchmarks

    How many bugs can LMs find & fix in large codebases?

    Indexed GitHub, facebookresearch 240 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/facebookresearch/swe-sweep.git
  20. NextTransformer

    Datasets & benchmarks

    :sunrise: A comprehensive, cutting-edge open-source framework for next-generation Transformers/LLM, with compute-matched benchmarking and a platform for autonomous architecture research.

    Indexed GitHub, Interactive-Active-AI 435 ★MITUpdated today

    git clone https://github.com/Interactive-Active-AI/NextTransformer.git
  21. tulu-3-sft-mixture

    Datasets & benchmarks

    Hugging Face dataset by allenai

    Indexed Hugging Face Hub, allenai 284 ♥odc-byUpdated 23 months ago

    allenai/tulu-3-sft-mixture
  22. MobileWorld

    Datasets & benchmarks

    Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments (ACL 2026)

    Stale GitHub, Tongyi-MAI 300 ★Apache-2.0Updated 13 days ago

    git clone https://github.com/Tongyi-MAI/MobileWorld.git
  23. alem-env

    Datasets & benchmarks

    Can LLM/MARL agents coordinate in long-horizon, open-ended tasks? NeurIPS 2026 (Evaluations and Datasets).

    Stale GitHub, alem-world 57 ★MITUpdated 11 days ago

    git clone https://github.com/alem-world/alem-env.git
  24. autoguardrails

    Datasets & benchmarks

    Alignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface

    Stale GitHub, SantanderAI 129 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/SantanderAI/autoguardrails.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.