Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
UGI-Leaderboard
Tools & appsHugging Face space by DontPlanToEnd
DontPlanToEnd/UGI-Leaderboard -
PyRIT
AI repositoriesOpen-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.
git clone https://github.com/microsoft/PyRIT.git -
AISafetyHot
MCP serversAI Safety HOT: daily AI safety news, papers and incidents in one place — jailbreaks, prompt injection, alignment, evals, governance. Website, daily digest, RSS and MCP.
git clone https://github.com/wuyoscar/AISafetyHot.git -
opencompass
Datasets & benchmarksOpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.
git clone https://github.com/open-compass/opencompass.git -
safetyreplay-mcp
MCP serversPaid remote MCP for safety replays, policy gates, eval receipts, and release evidence.
-
Iris
MCP serversStop shipping agents on vibes. Score every agent output for quality, safety, and cost.
@iris-eval/mcp-server@0.21.0 -
AI/LLM agent output audit MCP: policy eval, tamper-evident chain, AI safety, x402 USDC on Base.
-
open_llm_leaderboard
Tools & appsHugging Face space by open-llm-leaderboard
open-llm-leaderboard/open_llm_leaderboard -
phoenix
PromptsAI Observability & Evaluation
git clone https://github.com/Arize-ai/phoenix.git -
Qwen3.8-27B
Modelsimage text to text model by Qwen · transformers
Qwen/Qwen3.8-27B -
sam3
Modelsmask generation model by facebook · transformers
facebook/sam3 -
agent-skills-eval
SkillsA test runner for agentskills.io-style AI agent skills
git clone https://github.com/darkrishabh/agent-skills-eval.git -
DeepSeek-R1
Modelstext generation model by deepseek-ai · transformers
deepseek-ai/DeepSeek-R1 -
Mixtral-8x7B-Instruct-v0.1
Modelsmodel by mistralai · vllm
mistralai/Mixtral-8x7B-Instruct-v0.1 -
trulens
Agents & frameworksEvaluation and Tracking for LLM Experiments and AI Agents
git clone https://github.com/truera/trulens.git -
DeepSeek-V4-Pro
Modelstext generation model by deepseek-ai · transformers
deepseek-ai/DeepSeek-V4-Pro -
Qwen3.8-Flash-Next
Modelsimage text to text model by Qwen · transformers
Qwen/Qwen3.8-Flash-Next -
gpt-oss-120b
Modelstext generation model by openai · transformers
openai/gpt-oss-120b -
gpt-oss-20b
Modelstext generation model by openai · transformers
openai/gpt-oss-20b -
gemma-7b
Modelstext generation model by google · transformers
google/gemma-7b -
mastra
AI repositoriesMastra is the modern TypeScript framework for AI-powered applications and agents.
git clone https://github.com/mastra-ai/mastra.git -
Kimi-K3
Modelsimage text to text model by moonshotai · transformers
moonshotai/Kimi-K3 -
Safety-Prompts
PromptsChinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts,用于评估和提升大模型的安全性。
git clone https://github.com/thu-coai/Safety-Prompts.git -
GLM-5.2
Modelstext generation model by zai-org · transformers
zai-org/GLM-5.2
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.