InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

170 results with any of your words Clear search and filters

Looks like a goal we have a starting path for: I want to research potential clients

  1. PyHealth

    Datasets & benchmarks

    A deep learning toolkit for healthcare AI: EHR (MIMIC, eICU, OMOP), clinical text, signals and imaging. 30+ models, reproducible pipelines.

    Indexed GitHub, sunlabuiuc 1,699 ★MITUpdated yesterday

    git clone https://github.com/sunlabuiuc/PyHealth.git
  2. NoLiMa

    Datasets & benchmarks

    Official repository for "NoLiMa: Long-Context Evaluation Beyond Literal Matching"

    Stale GitHub, adobe-research 205 ★Custom licence (see repository)Updated 16 months ago

    git clone https://github.com/adobe-research/NoLiMa.git
  3. elimination_game

    Datasets & benchmarks

    A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private conversations, form alliances, and vote to eliminate each other

    Stale GitHub, lechmazur 298 ★Updated 10 months ago

    git clone https://github.com/lechmazur/elimination_game.git
  4. DeepPlanning

    Datasets & benchmarks

    Hugging Face dataset by Qwen

    Stale Hugging Face Hub, Qwen 220 ♥apache-2.0Updated 8 months ago

    Qwen/DeepPlanning
  5. ollama-webui-intel

    Datasets & benchmarks

    Ollama with intel (i)GPU acceleration in docker and benchmark

    Indexed GitHub, NikolasEnt 53 ★Updated 3 days ago

    git clone https://github.com/NikolasEnt/ollama-webui-intel.git
  6. swt-bench

    Datasets & benchmarks

    [NeurIPS 2024] Evaluation harness for SWT-Bench, a benchmark for evaluating LLM repository-level test-generation

    Stale GitHub, logic-star-ai 92 ★MITUpdated 13 days ago

    git clone https://github.com/logic-star-ai/swt-bench.git
  7. WritingBench

    Datasets & benchmarks

    WritingBench: A Comprehensive Benchmark for Generative Writing

    Stale GitHub, X-PLUG 202 ★Apache-2.0Updated 11 months ago

    git clone https://github.com/X-PLUG/WritingBench.git
  8. ping_pong_bench

    Datasets & benchmarks

    A benchmark for role-playing language models

    Stale GitHub, IlyaGusev 122 ★Apache-2.0Updated 18 months ago

    git clone https://github.com/IlyaGusev/ping_pong_bench.git
  9. LoopArena

    Datasets & benchmarks

    Benchmarking models as runtime Controllers for Loop Engineering

    Stale GitHub, AMAP-ML 151 ★Apache-2.0Updated 33 days ago

    git clone https://github.com/AMAP-ML/LoopArena.git
  10. Awesome-Scientific-LLM-Benchmarks

    Datasets & benchmarks

    A curated, accuracy-first list of benchmarks for evaluating LLMs on scientific reasoning and discovery — math, physics, chemistry, materials, biology, and agentic science.

    Stale GitHub, subinium 42 ★MITUpdated 15 days ago

    git clone https://github.com/subinium/Awesome-Scientific-LLM-Benchmarks.git
  11. MMLU-CF

    Datasets & benchmarks

    A Contamination-free Multi-task Language Understanding Benchmark [Official, ACL 2025]

    Stale GitHub, microsoft 127 ★MITUpdated 18 months ago

    git clone https://github.com/microsoft/MMLU-CF.git
  12. apple-silicon-llm-bench

    Datasets & benchmarks

    Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

    Indexed GitHub, john-rocky 73 ★MITUpdated yesterday

    git clone https://github.com/john-rocky/apple-silicon-llm-bench.git
  13. UltraData-SFT-2605

    Datasets & benchmarks

    Hugging Face dataset by openbmb

    Indexed Hugging Face Hub, openbmb 419 ♥apache-2.0Updated 5 months ago 1 note

    openbmb/UltraData-SFT-2605
  14. Finance-Instruct-500k

    Datasets & benchmarks

    Hugging Face dataset by Josephgflowers

    Indexed Hugging Face Hub, Josephgflowers 251 ♥apache-2.0Updated 8 months ago

    Josephgflowers/Finance-Instruct-500k
  15. guidelines

    Datasets & benchmarks

    Hugging Face dataset by epfl-llm

    Stale Hugging Face Hub, epfl-llm 163 ♥otherUpdated 2 years ago

    epfl-llm/guidelines
  16. Ultra-FineWeb-L3

    Datasets & benchmarks

    Hugging Face dataset by openbmb

    Indexed Hugging Face Hub, openbmb 346 ♥apache-2.0Updated 2 months ago

    openbmb/Ultra-FineWeb-L3
  17. SGI-Bench

    Datasets & benchmarks

    Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows

    Stale GitHub, InternScience 172 ★MITUpdated 5 months ago

    git clone https://github.com/InternScience/SGI-Bench.git
  18. ollama-benchmark

    Datasets & benchmarks

    Ollama based Benchmark with detail I/O token per second. Python with Deepseek R1 example.

    Stale GitHub, LarHope 174 ★MITUpdated 7 months ago

    git clone https://github.com/LarHope/ollama-benchmark.git
  19. OSWorld-V2

    Datasets & benchmarks

    OSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks

    Indexed GitHub, xlang-ai 421 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/xlang-ai/OSWorld-V2.git
  20. nagi-bench

    Datasets & benchmarks

    One-shot LLM eval cases by NAGI STUDIO - same prompt, different agents (model + harness), runnable artifacts side by side.

    Indexed GitHub, nagi-studio 78 ★MITUpdated 5 days ago

    git clone https://github.com/nagi-studio/nagi-bench.git
  21. llm-value-rankings

    Datasets & benchmarks

    Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

    Indexed GitHub, yyh-001 30 ★MITUpdated 2 days ago

    git clone https://github.com/yyh-001/llm-value-rankings.git
  22. UltraData-RL-2609

    Datasets & benchmarks

    Hugging Face dataset by openbmb

    Stale Hugging Face Hub, openbmb 184 ♥apache-2.0Updated 2 months ago

    openbmb/UltraData-RL-2609
  23. synthetic-healthcare-admissions

    Datasets & benchmarks

    Hugging Face dataset by strova-ai

    Indexed Hugging Face Hub, strova-ai 244 ♥apache-2.0Updated 14 months ago

    strova-ai/synthetic-healthcare-admissions
  24. UltraData-Code

    Datasets & benchmarks

    Hugging Face dataset by openbmb

    Stale Hugging Face Hub, openbmb 205 ♥apache-2.0Updated 36 days ago

    openbmb/UltraData-Code

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.