InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. Open-source skills for Claude Code and Codex, with an MCP server, a PyPI package and Suede Awesome Everything, a directory that scores AI agent skills 0 to 99. Created by Jason Colapietro, founder and CEO of Suede AI.

    Indexed GitHub, JasonColapietro 124 ★MITUpdated yesterday

    git clone https://github.com/JasonColapietro/suede-creator-skills.git
  2. eval-genius

    Skills

    Teach your agent to work with evals: WHEN you actually need an eval or benchmark, HOW to build one that holds up, and how to read what it tells you. Deterministic-first, tool-agnostic.

    Stale GitHub, alexgreensh 24 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/alexgreensh/eval-genius.git
  3. aiml-companion

    Agents & frameworks

    AI-ML Companion: an interactive platform to learn AI & ML by watching it work - 28 tracks, 400+ modules, live visualizations - plus 20+ end-to-end real world projects from classical ML, DL, Computer Vision to production LLM & multi-agent systems.

    Indexed GitHub, genieincodebottle 74 ★Updated 2 days ago

    git clone https://github.com/genieincodebottle/aiml-companion.git
  4. archboard

    Skills

    Plan the next change with your agent on a map of the system, before it writes a line. Then follow any feature into the code, and see every place where the map and the code disagree.

    Indexed GitHub, miklschmidt 11 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/miklschmidt/archboard.git
  5. LLM Prover

    MCP servers

    LLM evaluation: compare models on cost and quality, score outputs, run benchmarks, analyse agents.

    Stale Official MCP Registry, com.pysolvr Updated 4 days ago 1 note

  6. Make AI agents aim higher without losing control: a Claude Code skill with two bars per task, a cheap gate check before expensive work, and an independent verifier that never sees the worker's reasoning. Plain markdown, EN + RU.

    Stale GitHub, alexpiar 23 ★MITUpdated 22 days ago

    git clone https://github.com/alexpiar/be-ambitious-harness.git
  7. Mini Program Engineering Skill Suite is an Agent Skill suite for evidence‑first mini‑program development. It helps agents bring WeChat or other mini‑program projects from vague intent to reliable engineering work: project intake, product specification, architecture, implementation, UI & device adaptation, debugging, verification, release readiness.

    Stale GitHub, NocodeMrLi 95 ★MITUpdated 13 days ago

    git clone https://github.com/NocodeMrLi/mini-program-engineering-skill-suite.git
  8. mcp-as-a-judge

    MCP servers

    MCP as a Judge: a behavioral MCP that strengthens AI coding assistants via explicit LLM evaluations

    Stale Official MCP Registry, io.github.OtherVibes Updated 14 months ago 1 note

    mcp-as-a-judge@0.3.20
  9. The math arm for LLMs: compute and check numbers from CSV and Excel data with pandas, SciPy and statsmodels, each with its calculation. Tool calling for Claude, Codex and local models (Ollama, vLLM, llama.cpp, LM Studio), Kaggle-style AutoML with --explain, and paper tables and figures.

    Stale GitHub, saineshnakra 35 ★MITUpdated 10 days ago

    git clone https://github.com/saineshnakra/automated-data-analyst.git
  10. LLM-driven evolution of prompts and pipelines. Evolves the prompt and the pipeline's parameters together against your labeled data, cuts losing candidates early, and shows every measurement behind the winner. Open source.

    Indexed GitHub, PromptPotter 7 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/PromptPotter/prompt-potter-optimizer.git
  11. skill-harness

    Skills

    How do you KNOW if a 'skill' is any good - deterministically? This runs controlled skill-vs-no-skill experiments. It doesn't just ask, “Did the skill work?” It asks “Did we actually give the skill to the model, did the comparison remain fair, what changed, what did it cost, and do we have enough evidence to say that confidently?”

    Stale GitHub, MrBinnacle 16 ★MITUpdated 14 days ago

    git clone https://github.com/MrBinnacle/skill-harness.git
  12. Zero-LLM deterministic jailbreak regression benchmark: runs a repeatable battery of known-pattern attacks against an LLM endpoint and scores refusal/partial/compliance across runs. Catch when a model or prompt update silently got weaker. Single-turn, responsible-use. pip install hermes-jailbench

    Stale GitHub, hermes-labs-ai 12 ★Apache-2.0Updated 27 days ago

    git clone https://github.com/hermes-labs-ai/hermes-jailbench.git
  13. Aion-RP-Llama-3.1-8B ranks the highest in the character evaluation portion of the RPBench-Auto benchmark, a roleplaying-specific variant of Arena-Hard-Auto, where LLMs evaluate each other’s responses. It is a fine-tuned base model...

    Indexed OpenRouter model list, aion-labs Updated 21 months ago

    aion-labs/aion-rp-llama-3.1-8b

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.