InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. EvalForge Lite

    MCP servers

    Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.

    Stale Official MCP Registry, io.github.thejaredchapman Updated 46 days ago 2 notes

    evalforge-lite@1.0.1
  2. evalsnap

    MCP servers

    Snapshot diff for agent and tool outputs: changed cases, score regressions, pass/fail verdict.

    Stale Official MCP Registry, io.github.CloudCorpRecords Updated 14 days ago 1 note

    @reneturcios/evalsnap@0.1.0
  3. agentic-ai

    AI repositories

    Agentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.

    Indexed GitHub, mahmoudrabie 193 ★MITUpdated 2 days ago

    git clone https://github.com/mahmoudrabie/agentic-ai.git
  4. PhysGym

    Datasets & benchmarks

    A benchmark suite for evaluating LLM-based interactive scientific reasoning.

    Indexed GitHub, principia-ai 103 ★MITUpdated 3 days ago

    git clone https://github.com/principia-ai/PhysGym.git
  5. GDPevo

    Datasets & benchmarks

    A Benchmark for Evaluating Agent Self-Evolution on Real Business Tasks

    Stale GitHub, Prism-Shadow 119 ★Apache-2.0Updated 18 days ago

    git clone https://github.com/Prism-Shadow/GDPevo.git
  6. image text to text model by lightonai · transformers

    Stale Hugging Face Hub, lightonai 23 ♥apache-2.0Updated 38 days ago

    lightonai/LightOnOCR-3-1B
  7. Make AI agents aim higher without losing control: a Claude Code skill with two bars per task, a cheap gate check before expensive work, and an independent verifier that never sees the worker's reasoning. Plain markdown, EN + RU.

    Stale GitHub, alexpiar 23 ★MITUpdated 22 days ago

    git clone https://github.com/alexpiar/be-ambitious-harness.git
  8. DM-Code-Agent

    Agents & frameworks

    An inspectable coding agent. Trace changes, diagnose failed runs, and share test evidence. Local-first Python, no-key demo, standalone HTML reports.

    Indexed GitHub, hwfengcs 152 ★MITUpdated yesterday

    git clone https://github.com/hwfengcs/DM-Code-Agent.git
  9. Xiaomi-OCR-0

    Models

    image text to text model by SeerRay-Lab · transformers

    Stale Hugging Face Hub, SeerRay-Lab 47 ♥apache-2.0Updated 39 days ago

    SeerRay-Lab/Xiaomi-OCR-0
  10. Act as a Senior Research Paper Evaluator. You are an experienced academic reviewer with expertise in evaluating scholarly work across multiple disciplines. Your task is to critically assess academic documents and…

    Indexed prompts.chat (CC0 prompt collection), Fisehazion CC0-1.0

  11. humanities_data_benchmark

    Datasets & benchmarks

    LLM Benchmark Suite for Humanities Data

    Stale GitHub, RISE-UNIBAS 32 ★GPL-3.0Updated 12 days ago

    git clone https://github.com/RISE-UNIBAS/humanities_data_benchmark.git
  12. labelhub-platform

    MCP servers

    面向 LLM 训练数据生产的可信工作台:AI 提供证据、人类裁决,append-only 账本、可复现导出、评测关卡与 MCP Server。

    Stale GitHub, Iceberg86-gb 48 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/Iceberg86-gb/labelhub-platform.git
  13. agent-eval

    MCP servers

    Statistical regression testing for LLM agents: p-value, effect size, and CI on behavior change.

    Stale Official MCP Registry, io.github.RudrenduPaul Updated 3 months ago 1 note

    agent-regress-cli@0.1.8
  14. Hive Evaluator

    MCP servers

    MCP server: NEED + YIELD + CLEAN-MONEY gates with EIP-3009 attestations · Hive Civilization

    Stale Official MCP Registry, io.github.srotzin Updated 6 months ago 1 note

  15. Act as a Business Idea Evaluator. You are an expert in assessing business concepts across various industries. Your task is to evaluate and score the given business idea based on specific criteria. You will: - Analyze…

    Indexed prompts.chat (CC0 prompt collection), amvicioushecs CC0-1.0

  16. Chipp: conversations, messages, usage and engagement analytics, end users and their memories, and.

    Stale Official MCP Registry, ai.chipp Updated 20 days ago 1 note

  17. automatic speech recognition model by FermionResearch · mlx

    Stale Hugging Face Hub, FermionResearch 19 ♥cc-by-4.0Updated 19 days ago

    FermionResearch/Phonon-2.5-English
  18. Research-Assistant-Agent

    Agents & frameworks

    Multi-agent research execution system: paper reproduction, benchmark evaluation, AutoResearch and claim-evidence graphs

    Indexed GitHub, zzp1221 207 ★MITUpdated 3 days ago

    git clone https://github.com/zzp1221/Research-Assistant-Agent.git
  19. Catch fabricated RAG citations before they reach the user: a zero-token verbatim gate + a burden-of-proof judge, framework-agnostic.

    Indexed GitHub, tonydzi 6 ★MITUpdated 2 days ago

    git clone https://github.com/tonydzi/verbatim-citation-gate.git
  20. Repo2RLEnv

    AI repositories

    Turn any repository into verifiable RL environments for coding agents - Harbor tasks you can train on, evaluate and share on the Hugging Face Hub

    Stale GitHub, huggingface 779 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/huggingface/Repo2RLEnv.git
  21. beir

    AI repositories

    A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

    Stale GitHub, beir-cellar 2,310 ★Apache-2.0Updated 13 months ago

    git clone https://github.com/beir-cellar/beir.git
  22. Act as a PhD Thesis Evaluator for Computer Science. You are an expert in computer science with significant experience in reviewing doctoral dissertations. Your task is to evaluate the provided PhD thesis and offer…

    Indexed prompts.chat (CC0 prompt collection), Doyle-59217 CC0-1.0

  23. GateMem

    Agents & frameworks

    GateMem: a benchmark and evaluation toolkit for memory governance in multi-principal shared-memory LLM agents.

    Stale GitHub, rzhub 139 ★MITUpdated 35 days ago

    git clone https://github.com/rzhub/GateMem.git
  24. LLM Eval Harness

    MCP servers

    Run a golden set and gate LLM model swaps on accuracy, with latency and cost per request.

    Stale Official MCP Registry, io.github.razilzul Updated 29 days ago 2 notes

    ghcr.io/razilzul/llm-eval-harness:1.0.0

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.