Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
OSWorld
Datasets & benchmarks[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments
git clone https://github.com/xlang-ai/OSWorld.git -
physics-problems
Datasets & benchmarksHugging Face dataset by HumynLabs
HumynLabs/physics-problems -
OSWorld-V2
Datasets & benchmarksOSWorld 2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
git clone https://github.com/xlang-ai/OSWorld-V2.git -
glue
Datasets & benchmarksHugging Face dataset by nyu-mll
nyu-mll/glue -
Bitext-customer-support-llm-chatbot-training-dataset
Datasets & benchmarksHugging Face dataset by bitext
bitext/Bitext-customer-support-llm-chatbot-training-dataset -
TrustLLM
Datasets & benchmarks[ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for local models, compatible APIs and AI agent orchestration.
git clone https://github.com/HowieHwong/TrustLLM.git -
meta-agents-research-environments
Datasets & benchmarksMeta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.
git clone https://github.com/facebookresearch/meta-agents-research-environments.git -
super_glue
Datasets & benchmarksHugging Face dataset by aps
aps/super_glue
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.