Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
PyRIT
AI repositoriesOpen-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.
git clone https://github.com/microsoft/PyRIT.git -
mastra
AI repositoriesMastra is the modern TypeScript framework for AI-powered applications and agents.
git clone https://github.com/mastra-ai/mastra.git -
simba
AI repositoriesOpenSource Production ready Customer service with built in Evals and monitoring
git clone https://github.com/GitHamza0206/simba.git -
Guardrails
AI repositoriesNeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
git clone https://github.com/NVIDIA-NeMo/Guardrails.git -
DreamLayer-Eval
AI repositoriesDreamLayer Eval: open-source benchmarking for image and video diffusion models. Automate prompts, seeds, and metrics for reproducible results. A research project from DreamLayer AI (dreamlayer.io).
git clone https://github.com/TheDesignFounder/DreamLayer-Eval.git -
ai-system-design-guide
AI repositoriesAI system design guide for engineers building production AI systems and evals.
git clone https://github.com/ombharatiya/ai-system-design-guide.git -
easy-dataset
AI repositoriesA powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
git clone https://github.com/ConardLi/easy-dataset.git -
overmind
AI repositoriesThe platform for continuously improving AI agents.
git clone https://github.com/overmind-core/overmind.git -
giskard-oss
AI repositories🐢 Open-Source Evaluation & Testing library for LLM Agents
git clone https://github.com/Giskard-AI/giskard-oss.git -
failproofai
AI repositoriesObservability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.
git clone https://github.com/FailproofAI/failproofai.git -
agentops
AI repositoriesPython SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
git clone https://github.com/AgentOps-AI/agentops.git -
raglite
AI repositories🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL
git clone https://github.com/superlinear-ai/raglite.git -
Awesome-Jailbreak-on-LLMs
AI repositoriesAwesome-Jailbreak-on-LLMs is a collection of state-of-the-art, novel, exciting jailbreak methods on LLMs. It contains papers, codes, datasets, evaluations, and analyses.
git clone https://github.com/yueliu1999/Awesome-Jailbreak-on-LLMs.git -
AI-Infra-Guard
AI repositoriesA full-stack AI Red Teaming platform securing AI ecosystems via Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
git clone https://github.com/Tencent/AI-Infra-Guard.git -
Tracely-ai
AI repositoriesTrace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.
git clone https://github.com/Jwuthri/Tracely-ai.git -
superagent
AI repositoriesSuperagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.
git clone https://github.com/superagent-ai/superagent.git -
orbit
AI repositoriesSelf-hosted AI gateway for private RAG, natural-language data access, and tool-calling agents.
git clone https://github.com/schmitech/orbit.git -
agentic-ai
AI repositoriesAgentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.
git clone https://github.com/mahmoudrabie/agentic-ai.git -
box
AI repositoriesRun AI agents in a sandbox that restricts what they can execute, read, write, and reach on the network. Box combines OS isolation with default-deny Dogwood policies and credential injection that keeps secrets outside the agent. Written in Rust. Supports macOS on Apple silicon and Linux.
git clone https://github.com/strands-agents/box.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.