InnerVault

AI_Diplomacy

Stale GitHub, GoodStartLabs

Frontier Models playing the board game Diplomacy.

Open the source (opens github.com) https://github.com/goodstartlabs/ai_diplomacy

What it is

Datasets & benchmarks from GoodStartLabs.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/GoodStartLabs/AI_Diplomacy.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. TheAgentCompany

    Datasets & benchmarks

    An agent benchmark with tasks in a simulated software company.

    Stale GitHub, TheAgentCompany 795 ★MITUpdated 12 months ago

    git clone https://github.com/TheAgentCompany/TheAgentCompany.git
  2. SciCode

    Datasets & benchmarks

    A benchmark that challenges language models to code solutions for scientific problems

    Stale GitHub, scicode-bench 246 ★Apache-2.0Updated 14 days ago

    git clone https://github.com/scicode-bench/SciCode.git
  3. MedXpertQA

    Datasets & benchmarks

    [ICML 2025] MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding

    Stale GitHub, TsinghuaC3I 182 ★MITUpdated 2 months ago

    git clone https://github.com/TsinghuaC3I/MedXpertQA.git
  4. tau2-bench

    Datasets & benchmarks

    τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

    Indexed GitHub, sierra-research 2,442 ★MITUpdated 6 days ago

    git clone https://github.com/sierra-research/tau2-bench.git
  5. o11y-bench

    Datasets & benchmarks

    Open benchmark on observability tasks built on Harbor

    Indexed GitHub, grafana 80 ★AGPL-3.0Updated today

    git clone https://github.com/grafana/o11y-bench.git
  6. WritingBench

    Datasets & benchmarks

    WritingBench: A Comprehensive Benchmark for Generative Writing

    Stale GitHub, X-PLUG 202 ★Apache-2.0Updated 11 months ago

    git clone https://github.com/X-PLUG/WritingBench.git