InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

99 results with any of your words Clear search and filters
  1. HallusionBench

    Datasets & benchmarks

    [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

    Stale GitHub, tianyi-lab 344 ★BSD-3-ClauseUpdated 13 months ago

    git clone https://github.com/tianyi-lab/HallusionBench.git
  2. Static-to-Dynamic-LLMEval

    Datasets & benchmarks

    The official GitHub repository of the paper "Recent advances in large language model benchmarks against data contamination: From static to dynamic evaluation"

    Stale GitHub, SeekingDream 493 ★Updated 49 days ago

    git clone https://github.com/SeekingDream/Static-to-Dynamic-LLMEval.git
  3. the_pile_books3

    Datasets & benchmarks

    Hugging Face dataset by defunct-datasets

    Stale Hugging Face Hub, defunct-datasets 156 ♥mitUpdated 2 years ago

    defunct-datasets/the_pile_books3
  4. SkyPile-150B

    Datasets & benchmarks

    Hugging Face dataset by Skywork

    Indexed Hugging Face Hub, Skywork 421 ♥Updated 2 years ago

    Skywork/SkyPile-150B
  5. LLM-Agent-Benchmark-List

    Datasets & benchmarks

    A banchmark list for evaluation of large language models.

    Stale GitHub, zhangxjohn 173 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/zhangxjohn/LLM-Agent-Benchmark-List.git
  6. ParseBench

    Datasets & benchmarks

    ParseBench - A Document Parsing Benchmark for AI Agents

    Indexed GitHub, run-llama 640 ★Apache-2.0Updated today

    git clone https://github.com/run-llama/ParseBench.git
  7. ocr

    Datasets & benchmarks

    Hugging Face dataset by uv-scripts

    Stale Hugging Face Hub, uv-scripts 166 ♥Updated 47 days ago

    uv-scripts/ocr
  8. CharacterCodex

    Datasets & benchmarks

    Hugging Face dataset by NousResearch

    Indexed Hugging Face Hub, NousResearch 258 ♥apache-2.0Updated 2 years ago

    NousResearch/CharacterCodex
  9. xVerify

    Datasets & benchmarks

    xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

    Stale GitHub, IAAR-Shanghai 150 ★Custom licence (see repository)Updated 19 days ago

    git clone https://github.com/IAAR-Shanghai/xVerify.git
  10. oscar

    Datasets & benchmarks

    Hugging Face dataset by oscar-corpus

    Stale Hugging Face Hub, oscar-corpus 209 ♥cc0-1.0Updated 14 months ago 1 note

    oscar-corpus/oscar
  11. ping_pong_bench

    Datasets & benchmarks

    A benchmark for role-playing language models

    Stale GitHub, IlyaGusev 122 ★Apache-2.0Updated 18 months ago

    git clone https://github.com/IlyaGusev/ping_pong_bench.git
  12. Awesome-LLM-Eval

    Datasets & benchmarks

    Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

    Stale GitHub, onejune2018 659 ★MITUpdated 11 months ago

    git clone https://github.com/onejune2018/Awesome-LLM-Eval.git
  13. apps

    Datasets & benchmarks

    Hugging Face dataset by codeparrot

    Stale Hugging Face Hub, codeparrot 212 ♥mitUpdated 4 years ago

    codeparrot/apps
  14. pubmed

    Datasets & benchmarks

    Hugging Face dataset by ncbi

    Stale Hugging Face Hub, ncbi 170 ♥otherUpdated 2 years ago

    ncbi/pubmed
  15. AI_Diplomacy

    Datasets & benchmarks

    Frontier Models playing the board game Diplomacy.

    Stale GitHub, GoodStartLabs 708 ★Custom licence (see repository)Updated 5 months ago

    git clone https://github.com/GoodStartLabs/AI_Diplomacy.git
  16. Nectar

    Datasets & benchmarks

    Hugging Face dataset by berkeley-nest

    Indexed Hugging Face Hub, berkeley-nest 308 ♥apache-2.0Updated 2 years ago

    berkeley-nest/Nectar
  17. minipile

    Datasets & benchmarks

    Hugging Face dataset by JeanKaddour

    Stale Hugging Face Hub, JeanKaddour 155 ♥otherUpdated 3 years ago

    JeanKaddour/minipile
  18. xFinder

    Datasets & benchmarks

    [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

    Stale GitHub, IAAR-Shanghai 178 ★Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/IAAR-Shanghai/xFinder.git
  19. DyCodeEval

    Datasets & benchmarks

    Official repository of the ICML2025 paper “Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination”

    Stale GitHub, SeekingDream 222 ★Updated 10 months ago

    git clone https://github.com/SeekingDream/DyCodeEval.git
  20. ReForm-Eval

    Datasets & benchmarks

    An benchmark for evaluating the capabilities of large vision-language models (LVLMs)

    Stale GitHub, FudanDISC 145 ★Apache-2.0Updated 3 years ago

    git clone https://github.com/FudanDISC/ReForm-Eval.git
  21. openbench

    Datasets & benchmarks

    Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost

    Stale GitHub, minghinmatthewlam 137 ★MITUpdated 2 months ago

    git clone https://github.com/minghinmatthewlam/openbench.git
  22. TrustLLM

    Datasets & benchmarks

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    Stale GitHub, HowieHwong 632 ★MITUpdated 43 days ago

    git clone https://github.com/HowieHwong/TrustLLM.git
  23. mc4

    Datasets & benchmarks

    Hugging Face dataset by legacy-datasets

    Stale Hugging Face Hub, legacy-datasets 160 ♥odc-byUpdated 2 years ago

    legacy-datasets/mc4
  24. ChemLLMBench

    Datasets & benchmarks

    Official Code for What can Large Language Models do in chemistry? A comprehensive benchmark on eight tasks (In NeurIPS 2023)

    Stale GitHub, ChemFoundationModels 176 ★Updated 2 years ago

    git clone https://github.com/ChemFoundationModels/ChemLLMBench.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.