InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. failproofai

    AI repositories

    Observability and enforcement for AI agent harnesses. Capture every run and runtime reliability with policy enforcement.

    Stale GitHub, FailproofAI 6,226 ★Custom licence (see repository)Updated 22 days ago

    git clone https://github.com/FailproofAI/failproofai.git
  2. opensre

    AI repositories

    The open-source agent for CI/CD reliability.

    Indexed GitHub, Tracer-Cloud 12.8k ★Apache-2.0Updated yesterday

    git clone https://github.com/Tracer-Cloud/opensre.git
  3. Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models

    Stale GitHub, jxzhangjhu 840 ★MITUpdated 9 days ago

    git clone https://github.com/jxzhangjhu/Awesome-LLM-Uncertainty-Reliability-Robustness.git
  4. Upsonic

    MCP servers

    Build autonomous AI agents in Python.

    Stale GitHub, Upsonic 7,958 ★MITUpdated 5 months ago

    git clone https://github.com/Upsonic/Upsonic.git
  5. xFinder

    Datasets & benchmarks

    [ICLR 2025] xFinder: Large Language Models as Automated Evaluators for Reliable Evaluation

    Stale GitHub, IAAR-Shanghai 178 ★Custom licence (see repository)Updated 12 months ago

    git clone https://github.com/IAAR-Shanghai/xFinder.git
  6. holmesgpt

    Agents & frameworks

    SRE Agent - CNCF Sandbox Project

    Indexed GitHub, HolmesGPT 3,906 ★Apache-2.0Updated yesterday

    git clone https://github.com/HolmesGPT/holmesgpt.git
  7. xVerify

    Datasets & benchmarks

    xVerify: Efficient Answer Verifier for Reasoning Model Evaluations

    Stale GitHub, IAAR-Shanghai 150 ★Custom licence (see repository)Updated 19 days ago

    git clone https://github.com/IAAR-Shanghai/xVerify.git
  8. OpenHarness

    Agents & frameworks

    Reliability harness for long-running OpenClaw agents: persistent state, strict task contracts, scheduled execution, and external validation.

    Stale GitHub, thu-nmrc 118 ★Custom licence (see repository)Updated 7 months ago

    git clone https://github.com/thu-nmrc/OpenHarness.git
  9. Turn a production incident into a structured 9-section LLM response (severity, root cause, mitigation, postmortem). Ships with a 5-scenario regression suite + LLM-as-judge eval pipeline.

    Stale GitHub, YanpengQi7 83 ★Updated 29 days ago

    git clone https://github.com/YanpengQi7/ai-reliability-copilot.git
  10. awesome-auditable-ai

    Agents & frameworks

    Auditing AI agents: a curated list of papers, tools, datasets, benchmarks, and standards covering reliability, monitoring, failure attribution, and decision records.

    Stale GitHub, yzhao062 154 ★CC0-1.0Updated 28 days ago

    git clone https://github.com/yzhao062/awesome-auditable-ai.git
  11. TrustRAG

    AI repositories

    TrustRAG:The RAG Framework within Reliable input,Trusted output

    Stale GitHub, gomate-community 1,280 ★Updated 10 months ago

    git clone https://github.com/gomate-community/TrustRAG.git
  12. Bike Reliability

    Public APIs

    UK motorcycle reliability ranked by first-time MOT pass rates

    Indexed public-apis (GitHub list)

  13. workflow

    Agents & frameworks

    Workflow SDK: Build durable, reliable, and observable apps and AI Agents in TypeScript

    Indexed GitHub, vercel 2,512 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/vercel/workflow.git
  14. deepmark

    Datasets & benchmarks

    Deepmark AI enables a unique testing environment for language models (LLM) assessment on task-specific metrics and on your own data so your GenAI-powered solution has predictable and reliable performance.

    Stale GitHub, IngestAI 104 ★AGPL-3.0Updated 2 years ago

    git clone https://github.com/IngestAI/deepmark.git
  15. abcoder

    MCP servers

    deep, reliable and confidential coding-context

    Stale GitHub, cloudwego 390 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/cloudwego/abcoder.git
  16. Generates a pre-coding reliability skill (SKILL.md) for your agent repo from Trustabl's rules.

    Stale Official MCP Registry, io.github.trustabl Updated 7 days ago 1 note

    @trustabl/agent-reliability-skills@0.1.0-rc.3
  17. parlant

    Agents & frameworks

    Build reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.

    Stale GitHub, emcie-co 18.3k ★Apache-2.0Updated 4 months ago

    git clone https://github.com/emcie-co/parlant.git
  18. Grade an AI agent's transcripts on 18 reliability tests. Thin evidence is NOT TESTED, not guessed.

    Stale Official MCP Registry, io.github.forevercrab321-svg Updated 49 days ago 1 note

    https://github.com/forevercrab321-svg/leevar-battery/releases/download/v0.1.0/leevar-mcp-0.1.0.mcpb
  19. Measured uptime, price and payment evidence for 19,021 agent services. Reliability, not quality.

    Stale Official MCP Registry, io.github.cengit1 Updated 49 days ago 1 note

  20. Agent Reliability

    MCP servers

    Testing, benchmarking and auditing autonomous AI agents — methods, harnesses, evidence

    Stale Official MCP Registry, dev.agentreliability Updated 2 months ago 1 note

  21. Check one French company by name or SIREN and get its Nogogo A-E reliability grade for free.

    Stale Official MCP Registry, fr.nogogo Updated 2 months ago 1 note

  22. reliable

    MCP servers

    Resilient LLM/Agent calls via MCP: circuit breakers, timeout, jitter backoff, retry-storm guard.

    Stale Official MCP Registry, io.github.GravityWell8 Updated 5 days ago 1 note

    reliablekit@0.1.3
  23. flint-chart

    MCP servers

    🪄 Flint is a visualization language that lets AI agents reliably create expressive, good-looking charts from simple, human-editable chart specs.

    Stale GitHub, microsoft 4,550 ★MITUpdated 9 days ago

    git clone https://github.com/microsoft/flint-chart.git
  24. MCPFax Reliability

    MCP servers

    Before you pay an endpoint you cannot vouch for: credit grade, drift and preflight.

    Stale Official MCP Registry, com.mcpscores Updated 2 months ago 1 note

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.