InnerVault

SWE-bench-Live

Stale GitHub, microsoft

[NeurIPS 2025 D&B] ๐Ÿš€ SWE-bench Goes Live!

Open the source (opens github.com) https://github.com/microsoft/swe-bench-live

What it is

Datasets & benchmarks from microsoft.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/microsoft/SWE-bench-Live.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. swe-sweep

    Datasets & benchmarks

    How many bugs can LMs find & fix in large codebases?

    Indexed GitHub, facebookresearch 240 โ˜…Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/facebookresearch/swe-sweep.git
  2. WebsiteBench

    Datasets & benchmarks

    Can AI agents rebuild websites through browser exploration?

    Indexed GitHub, TIGER-AI-Lab 300 โ˜…Apache-2.0Updated 6 days ago

    git clone https://github.com/TIGER-AI-Lab/WebsiteBench.git
  3. self-bench

    Datasets & benchmarks

    Benchmark coding agents and models on your own repository with private Harbor-formatted evals built from its merged pull requests.

    Indexed GitHub, mupt-ai 34 โ˜…MITUpdated today

    git clone https://github.com/mupt-ai/self-bench.git
  4. SWE-bench_Verified

    Datasets & benchmarks

    Hugging Face dataset by SWE-bench

    Stale Hugging Face Hub, SWE-bench 188 โ™ฅUpdated 3 months ago

    SWE-bench/SWE-bench_Verified
  5. SWE-bench_Pro

    Datasets & benchmarks

    Hugging Face dataset by ScaleAI

    Stale Hugging Face Hub, ScaleAI 197 โ™ฅUpdated 55 days ago

    ScaleAI/SWE-bench_Pro
  6. multi-agents

    Datasets & benchmarks

    Multi-agent teams for real work: run teams of coding agents (Claude Code, Codex, any model) in isolated git worktrees, and measure whether the team beats a solo agent on cost and results.

    Stale GitHub, BichengWang 158 โ˜…MITUpdated 8 days ago

    git clone https://github.com/BichengWang/multi-agents.git