InnerVault

llm-bulls-and-cows-benchmark

Stale GitHub, stalkermustang

A mini-framework for evaluating LLM performance on the Bulls and Cows number guessing game, supporting multiple LLM providers.

Open the source (opens github.com) https://github.com/stalkermustang/llm-bulls-and-cows-benchmark

What it is

Datasets & benchmarks from stalkermustang.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/stalkermustang/llm-bulls-and-cows-benchmark.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. BALROG

    Datasets & benchmarks

    Benchmarking Agentic LLM and VLM Reasoning On Games

    Stale GitHub, balrog-ai 274 ★MITUpdated 7 months ago

    git clone https://github.com/balrog-ai/BALROG.git
  2. AI_Diplomacy

    Datasets & benchmarks

    Frontier Models playing the board game Diplomacy.

    Stale GitHub, GoodStartLabs 708 ★Custom licence (see repository)Updated 5 months ago

    git clone https://github.com/GoodStartLabs/AI_Diplomacy.git
  3. LawBench

    Datasets & benchmarks

    Benchmarking Legal Knowledge of Large Language Models

    Stale GitHub, open-compass 455 ★Apache-2.0Updated 3 years ago

    git clone https://github.com/open-compass/LawBench.git
  4. geobench

    Datasets & benchmarks

    GeoGuessr benchmark for language models

    Indexed GitHub, ccmdi 65 ★MITUpdated 4 days ago

    git clone https://github.com/ccmdi/geobench.git
  5. DishwasherBench

    Datasets & benchmarks

    A dishwasher-loading game on a physical simulation of one real machine, built to benchmark language models and playable in a browser. The game inside is called Spotless.

    Stale GitHub, composo-ai 71 ★MITUpdated 31 days ago

    git clone https://github.com/composo-ai/DishwasherBench.git
  6. gamebot

    Datasets & benchmarks

    [ACL 2025] GAMEBoT: Transparent Assessment of LLM Reasoning in Games

    Stale GitHub, Visual-AI 36 ★Updated 11 days ago

    git clone https://github.com/Visual-AI/gamebot.git