InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. Awesome-CUA

    Agents & frameworks

    Open, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.

    Stale GitHub, reacher-z 659 ★Custom licence (see repository)Updated 6 days ago

    git clone https://github.com/reacher-z/Awesome-CUA.git
  2. ai-model-world

    Datasets & benchmarks

    AI 大模型世界,把 556 个大模型拟人化成像素小人的可视化站点。进来就能看到此刻谁最聪明、谁最会写代码、谁最便宜、谁刚发布,往下是国内与国外分区的厂商广场、完整的发布时间线和多维排行榜。搜索认模型名、厂商和能力,输入「多模态」会直接列出全部多模态模型。数据取自 Epoch AI、models.dev、LiveBench 与 Hugging Face,每小时自动同步,所有文案由真实数据生成,不调用任何 LLM。Next.js 静态导出,零后端。

    Indexed GitHub, liyupi 274 ★MITUpdated today

    git clone https://github.com/liyupi/ai-model-world.git
  3. elimination_game

    Datasets & benchmarks

    A multi-player tournament benchmark that tests LLMs in social reasoning, strategy, and deception. Players engage in public and private conversations, form alliances, and vote to eliminate each other

    Stale GitHub, lechmazur 298 ★Updated 10 months ago

    git clone https://github.com/lechmazur/elimination_game.git
  4. apple-silicon-llm-bench

    Datasets & benchmarks

    Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

    Indexed GitHub, john-rocky 73 ★MITUpdated today

    git clone https://github.com/john-rocky/apple-silicon-llm-bench.git
  5. NIMStats

    Datasets & benchmarks

    📊 Automated hourly benchmarks for 20+ NVIDIA NIM models — interactive dashboard, zero infra, self-hostable. Open-source & community-driven.

    Indexed GitHub, MauroDruwel 57 ★Updated today

    git clone https://github.com/MauroDruwel/NIMStats.git
  6. jina-clip-v2

    Models

    feature extraction model by jinaai · transformers

    Stale Hugging Face Hub, jinaai 346 ♥cc-by-nc-4.0Updated 7 months ago

    jinaai/jina-clip-v2
  7. multi-agents

    Datasets & benchmarks

    Multi-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.

    Stale GitHub, BichengWang 158 ★MITUpdated 8 days ago

    git clone https://github.com/BichengWang/multi-agents.git
  8. VisualNews-Repository

    Datasets & benchmarks

    [EMNLP'21] Visual News: Benchmark and Challenges in News Image Captioning

    Stale GitHub, FuxiaoLiu 106 ★Updated 2 years ago

    git clone https://github.com/FuxiaoLiu/VisualNews-Repository.git
  9. Repo2RLEnv

    AI repositories

    Turn any repository into verifiable RL environments for coding agents - Harbor tasks you can train on, evaluate and share on the Hugging Face Hub

    Stale GitHub, huggingface 779 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/huggingface/Repo2RLEnv.git
  10. Benzi

    Tools & apps

    Benzi is code intelligence infrastructure for AI models. It compiles your codebase into a resolved, queryable map of calls, data flow, control flow and class hierarchy first; then it reads, explains, runs, edits and verifies your code using it. Every language runs its own tree-sitter grammar into the same query map.

    Stale GitHub, oooscoos 177 ★Custom licence (see repository)Updated 7 days ago

    git clone https://github.com/oooscoos/Benzi.git
  11. VKORE-46M-NPU

    Models

    text generation model by FINAL-Bench · transformers

    Stale Hugging Face Hub, FINAL-Bench 27 ♥apache-2.0Updated 27 days ago

    FINAL-Bench/VKORE-46M-NPU
  12. embodied-first-exam

    Agents & frameworks

    The first exam for code agents in the physical world: frozen robot tasks from many benchmark suites, each answered with a program and verified in a separate sandbox. Runs on Harbor.

    Stale GitHub, mll-lab-nu 236 ★MITUpdated 10 days ago

    git clone https://github.com/mll-lab-nu/embodied-first-exam.git
  13. claude-protein-binder-design

    Datasets & benchmarks

    Hugging Face dataset by Anthropic

    Indexed Hugging Face Hub, Anthropic 244 ♥cc-by-4.0Updated 3 months ago

    Anthropic/claude-protein-binder-design
  14. ReForm-Eval

    Datasets & benchmarks

    An benchmark for evaluating the capabilities of large vision-language models (LVLMs)

    Stale GitHub, FudanDISC 145 ★Apache-2.0Updated 3 years ago

    git clone https://github.com/FudanDISC/ReForm-Eval.git
  15. meta-agents-research-environments

    Datasets & benchmarks

    Meta Agents Research Environments is a comprehensive platform designed to evaluate AI agents in dynamic, realistic scenarios. Unlike static benchmarks, this platform introduces evolving environments where agents must adapt their strategies as new information becomes available, mirroring real-world challenges.

    Stale GitHub, facebookresearch 567 ★MITUpdated 47 days ago

    git clone https://github.com/facebookresearch/meta-agents-research-environments.git
  16. One-Eval

    Datasets & benchmarks

    Automated system for LLM evaluation via agents. Doc as below:

    Stale GitHub, OpenDCAI 165 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/OpenDCAI/One-Eval.git
  17. agentic-ai

    AI repositories

    Agentic AI research papers, benchmarks, frameworks, and tools curated across 24 domains.

    Indexed GitHub, mahmoudrabie 193 ★MITUpdated 2 days ago

    git clone https://github.com/mahmoudrabie/agentic-ai.git
  18. VibeSearchBench

    Datasets & benchmarks

    🔍 The hardest search benchmark in the wild — vague, multi-turn, proactive. 200 long-horizon tasks with persona-driven progressive disclosure, scored by verifiable schema-free knowledge-graph evaluation. No vibes, just triplet F1.

    Stale GitHub, VibeBench 112 ★MITUpdated 5 months ago

    git clone https://github.com/VibeBench/VibeSearchBench.git
  19. DeepPlanning

    Datasets & benchmarks

    Hugging Face dataset by Qwen

    Stale Hugging Face Hub, Qwen 220 ♥apache-2.0Updated 8 months ago

    Qwen/DeepPlanning
  20. polymarket-paper-trader

    Datasets & benchmarks

    Paper trading simulator for Polymarket

    Stale GitHub, agent-next 495 ★MITUpdated 15 days ago

    git clone https://github.com/agent-next/polymarket-paper-trader.git
  21. AlgoTune

    Agents & frameworks

    AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each problem, and is faster than existing implementations.

    Stale GitHub, oripress 118 ★MITUpdated 4 months ago

    git clone https://github.com/oripress/AlgoTune.git
  22. strix-halo-guide

    Datasets & benchmarks

    Evidence-backed AMD Strix Halo local-AI setup and benchmarks: Qwen3.8, Ollama, llama.cpp, Vulkan/ROCm, large GGUFs, and cross-OEM results.

    Stale GitHub, hogeheer499-commits 373 ★MITUpdated 7 days ago

    git clone https://github.com/hogeheer499-commits/strix-halo-guide.git
  23. civ6-mcp

    Datasets & benchmarks

    An MCP server that lets LLM agents play Civilization VI.

    Stale GitHub, lmwilki 218 ★MITUpdated 34 days ago

    git clone https://github.com/lmwilki/civ6-mcp.git
  24. llmspeed

    Datasets & benchmarks

    Feel how fast a local LLM runs before you buy the hardware

    Stale GitHub, nicorobinreal 152 ★MITUpdated 27 days ago

    git clone https://github.com/nicorobinreal/llmspeed.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.