InnerVault

reforge-ai-evals

Stale GitHub, Calibre-Labs

Open-source AI evals toolkit: skills that guide AI coding agents to write eval rubrics, eval datasets (User Input Grid), trace codes, code evaluators and LLM-as-a-judge prompts. From the Reforge AI Evals course by Calibre.

Open the source (opens github.com) https://github.com/calibre-labs/reforge-ai-evals

What it is

Prompts from Calibre-Labs.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/Calibre-Labs/reforge-ai-evals.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. AIPM-Wiki

    Prompts

    🧱 AI 产品经理入门知识库:面试题库 · AI 基础 · 案例拆解 · 学习路线 | 无论是零基础转行还是持续进步,一个仓库就够了

    Stale GitHub, archlizheng 478 ★Custom licence (see repository)Updated 10 days ago

    git clone https://github.com/archlizheng/AIPM-Wiki.git
  2. nexpath

    Prompts

    Local-first AI coding workflow for vibe coders, indie hackers, technical founders and product managers — catch missing tests and safety checks across Claude Code, Cursor, Windsurf, Replit, Lovable and Bolt.new.

    Stale GitHub, hi0001234d 359 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/hi0001234d/nexpath.git
  3. product-mode

    Prompts

    The most expensive bug in AI-assisted building is shipping the wrong thing, well. A drop-in CLAUDE.md / AGENTS.md for PM + eng teams using Claude Code, Cursor, or Codex: 7 principles for problem framing, scope, tradeoffs, and outcome measurement. Built on @karpathy's observations.

    Indexed GitHub, sohaibt 171 ★MITUpdated 2 days ago

    git clone https://github.com/sohaibt/product-mode.git
  4. ponytail

    Prompts

    Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.

    Stale GitHub, DietrichGebert 181.6k ★MITUpdated 18 days ago

    git clone https://github.com/DietrichGebert/ponytail.git
  5. Provider-neutral Agent Skill for Codex, Claude Code, and agentic harness design.

    Stale GitHub, DenisSergeevitch 2,389 ★MITUpdated 28 days ago

    git clone https://github.com/DenisSergeevitch/agents-best-practices.git
  6. cangjie-skill

    Prompts

    把书、长视频、播客等高价值内容蒸馏成可执行的 Agent Skills(Distill high-value content from books, long-form videos, podcasts, and more into executable Agent Skills)

    Stale GitHub, kangarooking 11.3k ★MITUpdated 45 days ago

    git clone https://github.com/kangarooking/cangjie-skill.git