InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

171 results with any of your words Clear search and filters

Looks like a goal we have a starting path for: I want to research potential clients

  1. EconomicIndex

    Datasets & benchmarks

    Hugging Face dataset by Anthropic

    Indexed Hugging Face Hub, Anthropic 606 ♥mitUpdated 48 days ago

    Anthropic/EconomicIndex
  2. TrustLLM

    Datasets & benchmarks

    [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.

    Stale GitHub, HowieHwong 632 ★MITUpdated 44 days ago

    git clone https://github.com/HowieHwong/TrustLLM.git
  3. LongBench

    Datasets & benchmarks

    LongBench v2 and LongBench (ACL 25'&24')

    Stale GitHub, THUDM 1,246 ★MITUpdated 22 months ago

    git clone https://github.com/THUDM/LongBench.git
  4. ollama-benchmark

    Datasets & benchmarks

    LLM Benchmark for Throughput via Ollama (Local LLMs)

    Stale GitHub, aidatatools 397 ★MITUpdated 21 days ago

    git clone https://github.com/aidatatools/ollama-benchmark.git
  5. kg-gen

    Datasets & benchmarks

    [NeurIPS '25] Knowledge Graph Generation from Any Text

    Stale GitHub, stair-lab 1,286 ★Updated 7 months ago

    git clone https://github.com/stair-lab/kg-gen.git
  6. tau2-bench

    Datasets & benchmarks

    τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

    Indexed GitHub, sierra-research 2,442 ★MITUpdated 7 days ago

    git clone https://github.com/sierra-research/tau2-bench.git
  7. swe-sweep

    Datasets & benchmarks

    How many bugs can LMs find & fix in large codebases?

    Indexed GitHub, facebookresearch 240 ★Custom licence (see repository)Updated 5 days ago

    git clone https://github.com/facebookresearch/swe-sweep.git
  8. nautilus-compass

    Datasets & benchmarks

    Open memory & reliability layer for AI agents + independent judging/verification (NACRE judge, caliber-bench meta-benchmark, preregistered criteria) — by Nautilus Platform

    Indexed GitHub, chunxiaoxx 1,258 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/chunxiaoxx/nautilus-compass.git
  9. llm-price-compass

    Datasets & benchmarks

    This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table

    Stale GitHub, arc53 221 ★MITUpdated 23 months ago

    git clone https://github.com/arc53/llm-price-compass.git
  10. AgentLab

    Datasets & benchmarks

    AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.

    Stale GitHub, ServiceNow 653 ★Custom licence (see repository)Updated 42 days ago

    git clone https://github.com/ServiceNow/AgentLab.git
  11. Simreal-MLBench

    Datasets & benchmarks

    [Public preview] Externally scored agentic ML research benchmark: 60 tasks, real competition ground truth. Open protocol, operated evaluation.

    Stale GitHub, Simreal-AI 301 ★Apache-2.0Updated 54 days ago

    git clone https://github.com/Simreal-AI/Simreal-MLBench.git
  12. ClawBench

    Datasets & benchmarks

    Open-source benchmark for browser AI agents on daily tasks.

    Stale GitHub, TIGER-AI-Lab 1,229 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/TIGER-AI-Lab/ClawBench.git
  13. LLM-RGB

    Datasets & benchmarks

    LLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.

    Stale GitHub, babelcloud 165 ★MITUpdated 18 months ago

    git clone https://github.com/babelcloud/LLM-RGB.git
  14. LongCite

    Datasets & benchmarks

    LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

    Stale GitHub, THUDM 523 ★Apache-2.0Updated 22 months ago

    git clone https://github.com/THUDM/LongCite.git
  15. WebsiteBench

    Datasets & benchmarks

    Can AI agents rebuild websites through browser exploration?

    Indexed GitHub, TIGER-AI-Lab 300 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/TIGER-AI-Lab/WebsiteBench.git
  16. BizFinBench

    Datasets & benchmarks

    A Business-Driven Real-World Financial Benchmark for Evaluating LLMs

    Stale GitHub, HiThink-Research 169 ★Updated 6 months ago

    git clone https://github.com/HiThink-Research/BizFinBench.git
  17. GPT4-LLM-Cleaned

    Datasets & benchmarks

    Hugging Face dataset by teknium

    Stale Hugging Face Hub, teknium 171 ♥Updated 3 years ago

    teknium/GPT4-LLM-Cleaned
  18. AI_Diplomacy

    Datasets & benchmarks

    Frontier Models playing the board game Diplomacy.

    Stale GitHub, GoodStartLabs 708 ★Custom licence (see repository)Updated 5 months ago

    git clone https://github.com/GoodStartLabs/AI_Diplomacy.git
  19. chembench

    Datasets & benchmarks

    How good are LLMs at chemistry?

    Stale GitHub, lamalab-org 147 ★MITUpdated 9 months ago

    git clone https://github.com/lamalab-org/chembench.git
  20. OSWorld

    Datasets & benchmarks

    [NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

    Indexed GitHub, xlang-ai 3,262 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/xlang-ai/OSWorld.git
  21. LLM-Agent-Benchmark-List

    Datasets & benchmarks

    A banchmark list for evaluation of large language models.

    Stale GitHub, zhangxjohn 173 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/zhangxjohn/LLM-Agent-Benchmark-List.git
  22. Hugging Face dataset by bitext

    Stale Hugging Face Hub, bitext 203 ♥cdla-sharing-1.0Updated 2 years ago

    bitext/Bitext-customer-support-llm-chatbot-training-dataset
  23. Static-to-Dynamic-LLMEval

    Datasets & benchmarks

    The official GitHub repository of the paper "Recent advances in large language model benchmarks against data contamination: From static to dynamic evaluation"

    Stale GitHub, SeekingDream 493 ★Updated 50 days ago

    git clone https://github.com/SeekingDream/Static-to-Dynamic-LLMEval.git
  24. llmspeed

    Datasets & benchmarks

    Feel how fast a local LLM runs before you buy the hardware

    Stale GitHub, nicorobinreal 152 ★MITUpdated 28 days ago

    git clone https://github.com/nicorobinreal/llmspeed.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.