InnerVault

ollama-benchmark

Stale GitHub, aidatatools

LLM Benchmark for Throughput via Ollama (Local LLMs)

Open the source (opens github.com) https://github.com/aidatatools/ollama-benchmark

What it is

Datasets & benchmarks from aidatatools.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/aidatatools/ollama-benchmark.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. ollama-benchmark

    Datasets & benchmarks

    Ollama based Benchmark with detail I/O token per second. Python with Deepseek R1 example.

    Stale GitHub, LarHope 174 ★MITUpdated 7 months ago

    git clone https://github.com/LarHope/ollama-benchmark.git
  2. llm-value-rankings

    Datasets & benchmarks

    Daily LLM value rankings - compare 300+ models by intelligence, speed and price. OpenRouter + Artificial Analysis. 大模型性价比排行榜

    Indexed GitHub, yyh-001 30 ★MITUpdated yesterday

    git clone https://github.com/yyh-001/llm-value-rankings.git
  3. awesome-ai-gateway

    Datasets & benchmarks

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    Indexed GitHub, cuihuan 158 ★CC0-1.0Updated yesterday

    git clone https://github.com/cuihuan/awesome-ai-gateway.git
  4. swe-sweep

    Datasets & benchmarks

    How many bugs can LMs find & fix in large codebases?

    Indexed GitHub, facebookresearch 240 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/facebookresearch/swe-sweep.git
  5. llm-colosseum

    Datasets & benchmarks

    Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

    Stale GitHub, OpenGenerativeAI 1,483 ★MITUpdated 20 months ago

    git clone https://github.com/OpenGenerativeAI/llm-colosseum.git
  6. llm-bulls-and-cows-benchmark

    Datasets & benchmarks

    A mini-framework for evaluating LLM performance on the Bulls and Cows number guessing game, supporting multiple LLM providers.

    Stale GitHub, stalkermustang 235 ★MITUpdated 21 months ago

    git clone https://github.com/stalkermustang/llm-bulls-and-cows-benchmark.git