Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
langwatch
PromptsOpen-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
git clone https://github.com/langwatch/langwatch.git -
SHAFT_ENGINE
MCP serversJava test automation framework for web, mobile, API, CLI, database, and desktop E2E testing with a fluent API and built-in reporting.
git clone https://github.com/ShaftHQ/SHAFT_ENGINE.git -
cyber-security
Datasets & benchmarksHugging Face dataset by Vyber07
Vyber07/cyber-security -
tiktok-comment-automation
Tools & appsTikTok Comment Automation Tool. Session-based workflow manager for engagement research and testing. Template rotation, rate limiting, lightweight
git clone https://github.com/maxwilsoneng2098t9/tiktok-comment-automation.git -
evidently
AI repositoriesEvidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
git clone https://github.com/evidentlyai/evidently.git -
suitest
MCP serversSelf-hostable, MCP-native testing platform. Manual test management, deterministic runs, optional AI. Your stack, your LLM, your data.
git clone https://github.com/suiflex/suitest.git -
dataops-testgen
MCP serversOpen-source data quality tool: profiles tables, generates data quality tests from the profiling results, and runs them on a schedule with freshness, volume, and schema monitoring. Web UI, REST API, and MCP server. 14 databases plus CSV, Parquet, and JSON files. Apache 2.0.
git clone https://github.com/DataKitchen/dataops-testgen.git -
SeedBase Test Data
MCP serversGenerate realistic, FK-consistent synthetic test data for your databases from your AI assistant.
@seedbase/client@0.2.2 -
Rowsmith test data
MCP serversFake test data (CSV, JSON, SQL) from a schema. Reserved-range identifiers; reproducible by seed.
rowsmith-mcp@0.5.0 -
Static-to-Dynamic-LLMEval
Datasets & benchmarksThe official GitHub repository of the paper "Recent advances in large language model benchmarks against data contamination: From static to dynamic evaluation"
git clone https://github.com/SeekingDream/Static-to-Dynamic-LLMEval.git -
JSONPlaceholder
Public APIsFake data for testing and prototyping
-
FakeJSON
Public APIsService to generate test and fake data
-
Random Data
Public APIsRandom data generator
-
JsonFabrica
Public APIsGenerate realistic relational synthetic JSON test data from reusable templates
-
Randommer
Public APIsRandom data generator
-
Sampuli
Public APIsFormat-true synthetic test data for 90 countries: IDs, IBANs, cards, addresses
-
Toolcarton
Public APIsGenerate random testimonial data
-
RandomUser
Public APIsGenerates and list user data
-
Mailsac
Public APIsDisposable Email
-
insurance_skills
SkillsSkills used by actuaries and risk managers in their daily work.
git clone https://github.com/open-source-modelling/insurance_skills.git -
Ultimate-Offensive-Red-Team
Datasets & benchmarksHugging Face dataset by WNT3D
WNT3D/Ultimate-Offensive-Red-Team -
database-lab-engine
Agents & frameworksDBLab enables 🖖 database branching and ⚡️ thin cloning for any Postgres database and empowers DB testing in CI/CD. This optimizes database-related costs while improving time-to-market and software quality. Follow to stay updated.
git clone https://github.com/postgres-ai/database-lab-engine.git -
FakerAPI
Public APIsAPIs collection to get fake data
-
UUID Generator
Public APIsGenerate UUIDs
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.