Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
stable-diffusion-prompts-stats-full-uncensored
Datasets & benchmarksHugging Face dataset by jtatman
jtatman/stable-diffusion-prompts-stats-full-uncensored -
EgoDemo
Datasets & benchmarksHugging Face dataset by LightwheelAI
LightwheelAI/EgoDemo -
AgentLab
Datasets & benchmarksAgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
git clone https://github.com/ServiceNow/AgentLab.git -
LLM-RGB
Datasets & benchmarksLLM Reasoning and Generation Benchmark. Evaluate LLMs in complex scenarios systematically.
git clone https://github.com/babelcloud/LLM-RGB.git -
gpt4all_prompt_generations
Datasets & benchmarksHugging Face dataset by nomic-ai
nomic-ai/gpt4all_prompt_generations -
product-database
Datasets & benchmarksHugging Face dataset by openfoodfacts
openfoodfacts/product-database -
ocr
Datasets & benchmarksHugging Face dataset by uv-scripts
uv-scripts/ocr -
UltraX-Preview
Datasets & benchmarksHugging Face dataset by openbmb
openbmb/UltraX-Preview -
OpenVid-1M
Datasets & benchmarksHugging Face dataset by nkp37
nkp37/OpenVid-1M -
polymarket-paper-trader
Datasets & benchmarksPaper trading simulator for Polymarket
git clone https://github.com/agent-next/polymarket-paper-trader.git -
StableDiffusion-v1-5-Regularization-Images
Datasets & benchmarksHugging Face dataset by ProGamerGov
ProGamerGov/StableDiffusion-v1-5-Regularization-Images -
typed-decisions
Datasets & benchmarksHugging Face dataset by LocalLLaMA
LocalLLaMA/typed-decisions -
Code_Vulnerability_Security_DPO
Datasets & benchmarksHugging Face dataset by CyberNative
CyberNative/Code_Vulnerability_Security_DPO -
OSWorld-V2
Datasets & benchmarksOSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
git clone https://github.com/xlang-ai/OSWorld-V2.git -
DocLayNet
Datasets & benchmarksHugging Face dataset by docling-project
docling-project/DocLayNet -
Pliny_HackAPrompt_Dataset
Datasets & benchmarksHugging Face dataset by hackaprompt
hackaprompt/Pliny_HackAPrompt_Dataset -
sacp
Datasets & benchmarksState-Aware Collaboration Protocol: auditable work receipts for AI agents.
git clone https://github.com/aDragon0707/sacp.git -
TrustLLM
Datasets & benchmarks[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
git clone https://github.com/HowieHwong/TrustLLM.git -
nyt-connections
Datasets & benchmarksBenchmark that evaluates LLMs using 759 NYT Connections puzzles extended with extra trick words
git clone https://github.com/lechmazur/nyt-connections.git -
llm-price-compass
Datasets & benchmarksThis project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table
git clone https://github.com/arc53/llm-price-compass.git -
SGI-Bench
Datasets & benchmarksProbing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows
git clone https://github.com/InternScience/SGI-Bench.git -
meta-agents-research-environments
Datasets & benchmarksMeta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.
git clone https://github.com/facebookresearch/meta-agents-research-environments.git -
VibeSearchBench
Datasets & benchmarks🔍 The hardest search benchmark in the wild — vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.
git clone https://github.com/VibeBench/VibeSearchBench.git -
confabulations
Datasets & benchmarksHallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.
git clone https://github.com/lechmazur/confabulations.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.