InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. fable-5-premium

    Datasets & benchmarks

    Hugging Face dataset by saidutta69

    Stale Hugging Face Hub, saidutta69 136 ♥mitUpdated 2 months ago

    saidutta69/fable-5-premium
  2. TurtleBench

    Datasets & benchmarks

    TurtleBench: Evaluating Top Language Models via Real-World Yes/No Puzzles.

    Stale GitHub, mazzzystar 161 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/mazzzystar/TurtleBench.git
  3. Hugging Face dataset by Trendyol

    Stale Hugging Face Hub, Trendyol 136 ♥apache-2.0Updated 15 months ago

    Trendyol/Trendyol-Cybersecurity-Instruction-Tuning-Dataset
  4. active_genie

    Datasets & benchmarks

    The Lodash for GenAI: Real Value + Consistent + Model-Agnostic

    Stale GitHub, Roriz 168 ★Apache-2.0Updated 3 months ago

    git clone https://github.com/Roriz/active_genie.git
  5. UHGEval

    Datasets & benchmarks

    [ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.

    Stale GitHub, IAAR-Shanghai 183 ★Apache-2.0Updated 17 months ago

    git clone https://github.com/IAAR-Shanghai/UHGEval.git
  6. MathVista

    Datasets & benchmarks

    Hugging Face dataset by AI4Math

    Stale Hugging Face Hub, AI4Math 235 ♥cc-by-sa-4.0Updated 2 years ago

    AI4Math/MathVista
  7. LoopArena

    Datasets & benchmarks

    Benchmarking models as runtime Controllers for Loop Engineering

    Stale GitHub, AMAP-ML 151 ★Apache-2.0Updated 33 days ago

    git clone https://github.com/AMAP-ML/LoopArena.git
  8. OSCAR-2201

    Datasets & benchmarks

    Hugging Face dataset by oscar-corpus

    Stale Hugging Face Hub, oscar-corpus 134 ♥cc0-1.0Updated 15 months ago 1 note

    oscar-corpus/OSCAR-2201
  9. SGI-Bench

    Datasets & benchmarks

    Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows

    Stale GitHub, InternScience 172 ★MITUpdated 5 months ago

    git clone https://github.com/InternScience/SGI-Bench.git
  10. arxiv_dataset

    Datasets & benchmarks

    Hugging Face dataset by arxiv-community

    Stale Hugging Face Hub, arxiv-community 138 ♥cc0-1.0Updated 2 years ago

    arxiv-community/arxiv_dataset
  11. llm-value-rankings

    Datasets & benchmarks

    Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

    Indexed GitHub, yyh-001 30 ★MITUpdated 2 days ago

    git clone https://github.com/yyh-001/llm-value-rankings.git
  12. autoguardrails

    Datasets & benchmarks

    Alignment-research scaffold (autoresearch-style) for LLM guardrails: search over a single policy.md surface

    Stale GitHub, SantanderAI 129 ★Apache-2.0Updated 47 days ago

    git clone https://github.com/SantanderAI/autoguardrails.git
  13. tulu-3-sft-mixture

    Datasets & benchmarks

    Hugging Face dataset by allenai

    Indexed Hugging Face Hub, allenai 284 ♥odc-byUpdated 23 months ago

    allenai/tulu-3-sft-mixture
  14. Ditto

    Datasets & benchmarks

    A self-ailgnment method for role-play. Benchmark for role-play. Resources for "Large Language Models are Superpositions of All Characters: Attaining Arbitrary Role-play via Self-Alignment".

    Stale GitHub, OFA-Sys 214 ★MITUpdated 2 years ago

    git clone https://github.com/OFA-Sys/Ditto.git
  15. geobench

    Datasets & benchmarks

    GeoGuessr benchmark for language models

    Indexed GitHub, ccmdi 65 ★MITUpdated 4 days ago

    git clone https://github.com/ccmdi/geobench.git
  16. sec-code-bench

    Datasets & benchmarks

    SecCodeBench is a benchmark suite focusing on evaluating the security of code generated by large language models (LLMs).

    Stale GitHub, alibaba 135 ★Apache-2.0Updated 36 days ago

    git clone https://github.com/alibaba/sec-code-bench.git
  17. lora-speedrun

    Datasets & benchmarks

    Speedrunning LoRA fine-tuning: frozen task, frozen hardware, public wall-clock leaderboard. modded-nanogpt for fine-tuning.

    Stale GitHub, Saivineeth147 149 ★MITUpdated 2 months ago

    git clone https://github.com/Saivineeth147/lora-speedrun.git
  18. debate

    Datasets & benchmarks

    Adversarial multi-turn benchmark for LLM debate quality, using side-swapped matchups and multi-model judging to rank models by judged debate performance.

    Stale GitHub, lechmazur 38 ★Updated 22 days ago

    git clone https://github.com/lechmazur/debate.git
  19. ai-hardware-fit

    Datasets & benchmarks

    Can my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.

    Indexed GitHub, jaeseok614 44 ★MITUpdated yesterday

    git clone https://github.com/jaeseok614/ai-hardware-fit.git
  20. Awesome-AI-Scientist

    Datasets & benchmarks

    🧪 Awesome list of AI Scientist papers, systems, benchmarks, datasets and open-source platforms.

    Indexed GitHub, Omni-Scientist 105 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/Omni-Scientist/Awesome-AI-Scientist.git
  21. DecisionPivot

    Datasets & benchmarks

    DecisionPivot: a diagnostic benchmark for decision models in LLM systems. Contrast pairs that differ in one decisive detail, generators with independent solvers, scorer and runners.

    Stale GitHub, StartLuxLabs 144 ★Apache-2.0Updated 27 days ago

    git clone https://github.com/StartLuxLabs/DecisionPivot.git
  22. nagi-bench

    Datasets & benchmarks

    One-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.

    Indexed GitHub, nagi-studio 78 ★MITUpdated 5 days ago

    git clone https://github.com/nagi-studio/nagi-bench.git
  23. AIRTBench-Code

    Datasets & benchmarks

    Code Repository for: AIRTBench: Measuring Autonomous AI Red Teaming Capabilities in Language Models

    Stale GitHub, dreadnode 111 ★Apache-2.0Updated 33 days ago

    git clone https://github.com/dreadnode/AIRTBench-Code.git
  24. humanities_data_benchmark

    Datasets & benchmarks

    LLM Benchmark Suite for Humanities Data

    Stale GitHub, RISE-UNIBAS 32 ★GPL-3.0Updated 13 days ago

    git clone https://github.com/RISE-UNIBAS/humanities_data_benchmark.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.