InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

102 results with any of your words Clear search and filters
  1. OSWorld-V2

    Datasets & benchmarks

    OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks

    Indexed GitHub, xlang-ai 421 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/xlang-ai/OSWorld-V2.git
  2. code_search_net

    Datasets & benchmarks

    Hugging Face dataset by code-search-net

    Indexed Hugging Face Hub, code-search-net 353 ♥otherUpdated 8 months ago

    code-search-net/code_search_net
  3. HallusionBench

    Datasets & benchmarks

    [CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

    Stale GitHub, tianyi-lab 344 ★BSD-3-ClauseUpdated 13 months ago

    git clone https://github.com/tianyi-lab/HallusionBench.git
  4. Static-to-Dynamic-LLMEval

    Datasets & benchmarks

    The official GitHub repository of the paper "Recent advances in large language model benchmarks against data contamination: From static to dynamic evaluation"

    Stale GitHub, SeekingDream 493 ★Updated 50 days ago

    git clone https://github.com/SeekingDream/Static-to-Dynamic-LLMEval.git
  5. the_pile_books3

    Datasets & benchmarks

    Hugging Face dataset by defunct-datasets

    Stale Hugging Face Hub, defunct-datasets 156 ♥mitUpdated 2 years ago

    defunct-datasets/the_pile_books3
  6. SkyPile-150B

    Datasets & benchmarks

    Hugging Face dataset by Skywork

    Indexed Hugging Face Hub, Skywork 421 ♥Updated 2 years ago

    Skywork/SkyPile-150B
  7. LLM-Agent-Benchmark-List

    Datasets & benchmarks

    A banchmark list for evaluation of large language models.

    Stale GitHub, zhangxjohn 173 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/zhangxjohn/LLM-Agent-Benchmark-List.git
  8. ParseBench

    Datasets & benchmarks

    ParseBench - A Document Parsing Benchmark for AI Agents

    Indexed GitHub, run-llama 640 ★Apache-2.0Updated yesterday

    git clone https://github.com/run-llama/ParseBench.git
  9. ocr

    Datasets & benchmarks

    Hugging Face dataset by uv-scripts

    Stale Hugging Face Hub, uv-scripts 166 ♥Updated 48 days ago

    uv-scripts/ocr
  10. CharacterCodex

    Datasets & benchmarks

    Hugging Face dataset by NousResearch

    Indexed Hugging Face Hub, NousResearch 258 ♥apache-2.0Updated 2 years ago

    NousResearch/CharacterCodex
  11. xVerify

    Datasets & benchmarks

    xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

    Stale GitHub, IAAR-Shanghai 150 ★Custom licence (see repository)Updated 20 days ago

    git clone https://github.com/IAAR-Shanghai/xVerify.git
  12. oscar

    Datasets & benchmarks

    Hugging Face dataset by oscar-corpus

    Stale Hugging Face Hub, oscar-corpus 209 ♥cc0-1.0Updated 14 months ago 1 note

    oscar-corpus/oscar
  13. ping_pong_bench

    Datasets & benchmarks

    A benchmark for role-playing language models

    Stale GitHub, IlyaGusev 122 ★Apache-2.0Updated 18 months ago

    git clone https://github.com/IlyaGusev/ping_pong_bench.git
  14. Awesome-LLM-Eval

    Datasets & benchmarks

    Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表,主要面向基础大模型评测,旨在探求生成式AI的技术边界.

    Stale GitHub, onejune2018 659 ★MITUpdated 11 months ago

    git clone https://github.com/onejune2018/Awesome-LLM-Eval.git
  15. apps

    Datasets & benchmarks

    Hugging Face dataset by codeparrot

    Stale Hugging Face Hub, codeparrot 212 ♥mitUpdated 4 years ago

    codeparrot/apps
  16. pubmed

    Datasets & benchmarks

    Hugging Face dataset by ncbi

    Stale Hugging Face Hub, ncbi 170 ♥otherUpdated 2 years ago

    ncbi/pubmed
  17. AI_Diplomacy

    Datasets & benchmarks

    Frontier Models playing the board game Diplomacy.

    Stale GitHub, GoodStartLabs 708 ★Custom licence (see repository)Updated 5 months ago

    git clone https://github.com/GoodStartLabs/AI_Diplomacy.git
  18. Nectar

    Datasets & benchmarks

    Hugging Face dataset by berkeley-nest

    Indexed Hugging Face Hub, berkeley-nest 308 ♥apache-2.0Updated 2 years ago

    berkeley-nest/Nectar
  19. minipile

    Datasets & benchmarks

    Hugging Face dataset by JeanKaddour

    Stale Hugging Face Hub, JeanKaddour 155 ♥otherUpdated 3 years ago

    JeanKaddour/minipile
  20. xFinder

    Datasets & benchmarks

    [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

    Stale GitHub, IAAR-Shanghai 178 ★Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/IAAR-Shanghai/xFinder.git
  21. DyCodeEval

    Datasets & benchmarks

    Official repository of the ICML2025 paper “Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination”

    Stale GitHub, SeekingDream 222 ★Updated 10 months ago

    git clone https://github.com/SeekingDream/DyCodeEval.git
  22. ReForm-Eval

    Datasets & benchmarks

    An benchmark for evaluating the capabilities of large vision-language models (LVLMs)

    Stale GitHub, FudanDISC 145 ★Apache-2.0Updated 3 years ago

    git clone https://github.com/FudanDISC/ReForm-Eval.git
  23. openbench

    Datasets & benchmarks

    Same model, different wrapper: a from-scratch benchmark comparing coding-agent harnesses (codex, pi, opencode, cursor, devin) and open models on correctness, speed, and token cost

    Stale GitHub, minghinmatthewlam 137 ★MITUpdated 2 months ago

    git clone https://github.com/minghinmatthewlam/openbench.git
  24. TrustLLM

    Datasets & benchmarks

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    Stale GitHub, HowieHwong 632 ★MITUpdated 44 days ago

    git clone https://github.com/HowieHwong/TrustLLM.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.