Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
evalstats
PromptsStatistical inference for AI evaluations, from model comparisons to corrections for LLM judge bias, optimized for small sample sizes. All defaults battle-tested in Monte Carlo simulations.
git clone https://github.com/ianarawjo/evalstats.git -
ChainForge
PromptsAn open-source visual programming environment for battle-testing prompts to LLMs.
git clone https://github.com/ianarawjo/ChainForge.git -
reforge-ai-evals
PromptsOpen-source AI evals toolkit: skills that guide AI coding agents to write eval rubrics, eval datasets (User Input Grid), trace codes, code evaluators and LLM-as-a-judge prompts. From the Reforge AI Evals course by Calibre.
git clone https://github.com/Calibre-Labs/reforge-ai-evals.git -
futureagi-sdk
PromptsProduction-grade AI evaluation, prompt management & observability SDK. Automated evaluations with sub-100ms guardrails. No human-in-the-loop required. Python + TypeScript.
git clone https://github.com/future-agi/futureagi-sdk.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.