evalstats
Statistical inference for AI evaluations, from model comparisons to corrections for LLM judge bias, optimized for small sample sizes. All defaults battle-tested in Monte Carlo simulations.
Open the source (opens github.com) https://github.com/ianarawjo/evalstats
What it is
Prompts from ianarawjo.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/ianarawjo/evalstats.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
ChainForge
PromptsAn open-source visual programming environment for battle-testing prompts to LLMs.
git clone https://github.com/ianarawjo/ChainForge.git -
futureagi-sdk
PromptsProduction-grade AI evaluation, prompt management & observability SDK. Automated evaluations with sub-100ms guardrails. No human-in-the-loop required. Python + TypeScript.
git clone https://github.com/future-agi/futureagi-sdk.git -
Curated Claude Fable 5.2 use cases, tutorials, integrations, demos, and benchmark evidence with source links and multilingual README files.
git clone https://github.com/EvoLinkAI/awesome-claude-fable-5-2-use-cases.git -
Ultimate Claude Fable 5 Guide 2026: Use Cases, Integrations & Benchmarks
git clone https://github.com/thenicolas1894/awesome-claude-fable-5-prompt-vault.git -
dataset
PromptsGenerative AI-based CyberSecurity-focused Prompt Dataset for Benchmarking Large Language Models
git clone https://github.com/cysecbench/dataset.git -
hewn-forge
PromptsHEWN 2.0 2026: AI Output Router for Precision Summaries & Polished Code
git clone https://github.com/kaderkck/hewn-forge.git