Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
failproofai
AI repositoriesObservability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.
git clone https://github.com/FailproofAI/failproofai.git -
opensre
AI repositoriesThe open-source agent for CI/CD reliability.
git clone https://github.com/Tracer-Cloud/opensre.git -
Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models
git clone https://github.com/jxzhangjhu/Awesome-LLM-Uncertainty-Reliability-Robustness.git -
Upsonic
MCP serversBuild autonomous AI agents in Python.
git clone https://github.com/Upsonic/Upsonic.git -
xFinder
Datasets & benchmarks[ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation
git clone https://github.com/IAAR-Shanghai/xFinder.git -
holmesgpt
Agents & frameworksSRE Agent - CNCF Sandbox Project
git clone https://github.com/HolmesGPT/holmesgpt.git -
xVerify
Datasets & benchmarksxVerify: Efficient Answer Verifier for Reasoning Model Evaluations
git clone https://github.com/IAAR-Shanghai/xVerify.git -
OpenHarness
Agents & frameworksReliability harness for long-running OpenClaw agents: persistent state, strict task contracts, scheduled execution, and external validation.
git clone https://github.com/thu-nmrc/OpenHarness.git -
ai-reliability-copilot
PromptsTurn a production incident into a structured 9-section LLM response (severity, root cause, mitigation, postmortem). Ships with a 5-scenario regression suite + LLM-as-judge eval pipeline.
git clone https://github.com/YanpengQi7/ai-reliability-copilot.git -
awesome-auditable-ai
Agents & frameworksAuditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.
git clone https://github.com/yzhao062/awesome-auditable-ai.git -
TrustRAG
AI repositoriesTrustRAG:The RAG Framework within Reliable input,Trusted output
git clone https://github.com/gomate-community/TrustRAG.git -
Bike Reliability
Public APIsUK motorcycle reliability ranked by first-time MOT pass rates
-
workflow
Agents & frameworksWorkflow SDK: Build durable, reliable, and observable apps and AI Agents in TypeScript
git clone https://github.com/vercel/workflow.git -
deepmark
Datasets & benchmarksDeepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.
git clone https://github.com/IngestAI/deepmark.git -
abcoder
MCP serversdeep, reliable and confidential coding-context
git clone https://github.com/cloudwego/abcoder.git -
Agent Reliability Skills
MCP serversGenerates a pre-coding reliability skill (SKILL.md) for your agent repo from Trustabl's rules.
@trustabl/agent-reliability-skills@0.1.0-rc.3 -
parlant
Agents & frameworksBuild reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.
git clone https://github.com/emcie-co/parlant.git -
LEEVAR reliability battery
MCP serversGrade an AI agent's transcripts on 18 reliability tests. Thin evidence is NOT TESTED, not guessed.
https://github.com/forevercrab321-svg/leevar-battery/releases/download/v0.1.0/leevar-mcp-0.1.0.mcpb -
Measured uptime, price and payment evidence for 19,021 agent services. Reliability, not quality.
-
Agent Reliability
MCP serversTesting, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence
-
Nogogo AI - French Company Reliability
MCP serversCheck one French company by name or SIREN and get its Nogogo A-E reliability grade for free.
-
reliable
MCP serversResilient LLM/Agent calls via MCP: circuit breakers, timeout, jitter backoff, retry-storm guard.
reliablekit@0.1.3 -
flint-chart
MCP servers🪄 Flint is a visualization language that lets AI agents reliably create expressive, good-looking charts from simple, human-editable chart specs.
git clone https://github.com/microsoft/flint-chart.git -
MCPFax Reliability
MCP serversBefore you pay an endpoint you cannot vouch for: credit grade, drift and preflight.
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.