Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
Omni-SafetyBench
Datasets & benchmarks[ACM MM 2026 Oral] Code for paper "Omni-SafetyBench: A Benchmark for Safety Evaluation of Audio-Visual Large Language Models".
git clone https://github.com/THU-BPM/Omni-SafetyBench.git -
language-ai-engineering-lab
PromptsLanguage AI Engineering Lab, a place where you can deeply understand and build modern Language AI systems, from fundamentals to production.
git clone https://github.com/gil-son/language-ai-engineering-lab.git -
awesome-llm-observability
Skills50+ curated LLM observability tools PLUS 26 Agent Skills (several with runnable, unit-tested scripts) to build, evaluate, debug, secure & monitor reliable LLM apps. Tracing, evals, guardrails, LLMOps.
git clone https://github.com/ContextJet-ai/awesome-llm-observability.git -
ms-cookbook
AI repositories魔搭紫皮书|ModelScope Cookbook:面向开发者的开源模型应用实战指南,覆盖模型选型、推理、微调、评测、RAG、Agent 与 AIGC,从跑通第一个模型到构建实际应用。
git clone https://github.com/modelscope/ms-cookbook.git -
text generation model by nvidia · transformers
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 -
MiniCPM-OCR-1.0
Modelsimage text to text model by openbmb · minicpm-ocr
openbmb/MiniCPM-OCR-1.0 -
Ling-3.1-flash-1019
Modelstext generation model by inclusionAI
inclusionAI/Ling-3.1-flash-1019 -
OpenART
SkillsOpenART is an open-source framework designed to evaluate the safety and robustness of autonomous AI agents in dynamic, long-horizon, and stateful environments. It stress-tests agent runtimes against multi-step state poisoning, privilege escalation, and tool-use vulnerabilities across 10,000+ benchmark scenarios.
git clone https://github.com/AI45Lab/OpenART.git -
AgentLab
Datasets & benchmarksAgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.
git clone https://github.com/ServiceNow/AgentLab.git -
langfuse-docs
Skills🪢 Open source agent evals & observability: Trace, evaluate, and improve LLM applications with one open platform.
git clone https://github.com/langfuse/langfuse-docs.git -
xVerify
Datasets & benchmarksxVerify: Efficient Answer Verifier for Reasoning Model Evaluations
git clone https://github.com/IAAR-Shanghai/xVerify.git -
ai-agents-tutorial
Agents & frameworksLearn AI Agents step by step, from scratch - from function calling to agent loops to multi-agent systems, orchestration, and evaluation.
git clone https://github.com/amitshekhariitbhu/ai-agents-tutorial.git -
WritingBench
Datasets & benchmarksWritingBench: A Comprehensive Benchmark for Generative Writing
git clone https://github.com/X-PLUG/WritingBench.git -
SWE-bench_Pro
Datasets & benchmarksHugging Face dataset by ScaleAI
ScaleAI/SWE-bench_Pro -
GTA
Agents & frameworks[NeurIPS 2024 D&B] GTA: A Benchmark for General Tool Agents & [arXiv 2026] GTA-2
git clone https://github.com/open-compass/GTA.git -
pplx-decider-v1.1-27b
Modelstext classification model by perplexity-ai · pytorch
perplexity-ai/pplx-decider-v1.1-27b -
folkbench
AI repositories帮你的 AI 编程工具找到不降智、不断连、高性价比的好线路 · Live LLM relay rankings, model integrity probes & Tauri/Rust switcher for Claude Code, Codex & Gemini CLI
git clone https://github.com/Folkbench/folkbench.git -
text generation model by nvidia · transformers
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16 -
skillcheck
PromptsBlind A/B testing for AI agent skills, .cursorrules, CLAUDE.md, and system prompts. Detects placebo and harmful instructions.
git clone https://github.com/sx4im/skillcheck.git -
instructor-xl
Modelssentence similarity model by hkunlp · sentence-transformers
hkunlp/instructor-xl -
raglite
AI repositories🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
git clone https://github.com/superlinear-ai/raglite.git -
SWE-bench_Verified
Datasets & benchmarksHugging Face dataset by SWE-bench
SWE-bench/SWE-bench_Verified -
MOSS-Transcribe-Diarize
Modelsaudio text to text model by OpenMOSS-Team · transformers
OpenMOSS-Team/MOSS-Transcribe-Diarize -
NuExtract3
Modelsimage to text model by numind · transformers
numind/NuExtract3
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.