Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
evidently
AI repositoriesEvidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
git clone https://github.com/evidentlyai/evidently.git -
PentestGPT
AI repositoriesAutomated Penetration Testing Agentic Framework Powered by Large Language Models
git clone https://github.com/GreyDGL/PentestGPT.git -
Decepticon
AI repositoriesAutonomous Hacking Agent for Red Team
git clone https://github.com/BitterSecurity/Decepticon.git -
giskard-oss
AI repositories🐢 Open-Source Evaluation & Testing library for LLM Agents
git clone https://github.com/Giskard-AI/giskard-oss.git -
alumnium
AI repositoriesEnd-to-End Testing Harness
git clone https://github.com/alumnium-hq/alumnium.git -
PyRIT
AI repositoriesOpen-source AI red teaming toolkit from Microsoft. Test generative AI systems with automated scans, adaptive multi-turn attacks, and a web UI.
git clone https://github.com/microsoft/PyRIT.git -
osmedeus
AI repositoriesA Modern Orchestration Engine for Security
git clone https://github.com/j3ssie/osmedeus.git -
OneRAG
AI repositoriesProduction-ready RAG Framework (Python/FastAPI). 1-line config swaps: 6 Vector DBs (Weaviate, Pinecone, Qdrant, ChromaDB, pgvector, MongoDB), 5 LLMs (Gemini, OpenAI, Claude, Ollama, OpenRouter). OpenAI-compatible API. 2100+ tests.
git clone https://github.com/notadev-iamaura/OneRAG.git -
guardian-cli
AI repositoriesGuardian is a production-ready AI-powered penetration testing automation CLI tool that leverages Google Gemini and LangChain to orchestrate intelligent, step-by-step penetration testing workflows while maintaining ethical hacking standards.
git clone https://github.com/zakirkun/guardian-cli.git -
mockserver-monorepo
AI repositoriesMockServer is an HTTP(S) mock server and proxy for testing that lets you mock APIs, inspect and modify live traffic, and inject failures. It supports HTTP/1.1, HTTP/2, gRPC, WebSockets, TCP and more on a single port, with additional support for HTTP/3, message brokers, and AI/LLM APIs.
git clone https://github.com/mock-server/mockserver-monorepo.git -
LLMVault
AI repositoriesAn intentionally vulnerable OWASP LLM Top 10 training platform for AI Security, Prompt Injection, RAG Security, Agent Security, and GenAI penetration testing.
git clone https://github.com/CyberSunil/LLMVault.git -
reasoning-from-scratch
AI repositoriesImplement a reasoning LLM in PyTorch from scratch, step by step
git clone https://github.com/rasbt/reasoning-from-scratch.git -
faraday
AI repositoriesOpen-source and AI-powered cybersecurity tools for offensive security, vulnerability management, and autonomous pentesting. Built by hackers in Latin America, used worldwide.
git clone https://github.com/infobyte/faraday.git -
aimock
AI repositoriesMock everything your AI app talks to — LLM APIs, MCP, A2A, AG-UI, vector DBs, search. One package, one port, zero dependencies.
git clone https://github.com/CopilotKit/aimock.git -
MNN
AI repositoriesMNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
git clone https://github.com/alibaba/MNN.git -
ATLAS
AI repositoriesAdaptive Test-time Learning and Autonomous Specialization
git clone https://github.com/inferstep/ATLAS.git -
EvalForge
AI repositoriesEvaluator-neutral AI evaluation evidence, baseline regression gates, and JSON, JUnit, and SARIF reports for CI.
git clone https://github.com/jsdhwfmax/EvalForge.git -
orchestkit
AI repositoriesThe Complete AI Development Toolkit for Claude Code. 115 skills, 36 agents, 163 hooks. Install `ork` for stable (v10.x).
git clone https://github.com/yonatangross/orchestkit.git -
ps-fuzz
AI repositoriesMake your GenAI Apps Safe & Secure :rocket: Test & harden your system prompt
git clone https://github.com/prompt-security/ps-fuzz.git -
interview-prep-skills
AI repositoriesAgent Skills for mock interviews, adaptive follow-ups, and resume-based interview questions.AI 技术面试陪练与简历出题,覆盖前端、Java/Go/C++ 后端和 AI 应用开发。
git clone https://github.com/Hazenix/interview-prep-skills.git -
pandas-ai
AI repositoriesChat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
git clone https://github.com/sinaptik-ai/pandas-ai.git -
llama_index
AI repositoriesLlamaIndex is the document processing platform for AI
git clone https://github.com/run-llama/llama_index.git -
serviette
AI repositoriesA no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway.
git clone https://github.com/pathwaycom/serviette.git -
Chat2DB
AI repositoriesChat2DB is a free, cross-platform, local-first database client and SQL workspace for developers, DBAs, analysts, and data teams. Connect to 40+ databases, manage data, edit and run SQL, and use your own AI model to generate, explain, and optimize queries. Available on desktop, web, Docker, and CLI, with MCP support.
git clone https://github.com/OtterMind/Chat2DB.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.