InnerVault

evalstats

IndexedGitHub, ianarawjo

Statistical inference for AI evaluations, from model comparisons to corrections for LLM judge bias, optimized for small sample sizes. All defaults battle-tested in Monte Carlo simulations.

Open the source (opens github.com) https://github.com/ianarawjo/evalstats

What it is

Prompts from ianarawjo.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/ianarawjo/evalstats.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. ChainForge

    Prompts

    An open-source visual programming environment for battle-testing prompts to LLMs.

    Stale GitHub, ianarawjo 3,040 ★MITUpdated 18 days ago

    git clone https://github.com/ianarawjo/ChainForge.git
  2. futureagi-sdk

    Prompts

    Production-grade AI evaluation, prompt management & observability SDK. Automated evaluations with sub-100ms guardrails. No human-in-the-loop required. Python + TypeScript.

    Stale GitHub, future-agi 52 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/future-agi/futureagi-sdk.git
  3. Curated Claude Fable 5.2 use cases, tutorials, integrations, demos, and benchmark evidence with source links and multilingual README files.

    Indexed GitHub, EvoLinkAI 84 ★Custom licence (see repository)Updated 2 days ago

    git clone https://github.com/EvoLinkAI/awesome-claude-fable-5-2-use-cases.git
  4. Ultimate Claude Fable 5 Guide 2026: Use Cases, Integrations & Benchmarks

    Indexed GitHub, thenicolas1894 143 ★Updated today

    git clone https://github.com/thenicolas1894/awesome-claude-fable-5-prompt-vault.git
  5. dataset

    Prompts

    Generative AI-based CyberSecurity-focused Prompt Dataset for Benchmarking Large Language Models

    Stale GitHub, cysecbench 50 ★MITUpdated 22 months ago

    git clone https://github.com/cysecbench/dataset.git
  6. hewn-forge

    Prompts

    HEWN 2.0 2026: AI Output Router for Precision Summaries & Polished Code

    Indexed GitHub, kaderkck 116 ★Updated today

    git clone https://github.com/kaderkck/hewn-forge.git