InnerVault

inferock-bench

Stale GitHub, inferock

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls with token usage, failure, and billing-integrity receipts.

Open the source (opens github.com) https://github.com/inferock/inferock-bench

What it is

Datasets & benchmarks from inferock.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/inferock/inferock-bench.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. claude-protein-binder-design

    Datasets & benchmarks

    Hugging Face dataset by Anthropic

    Indexed Hugging Face Hub, Anthropic 244 ♥cc-by-4.0Updated 3 months ago

    Anthropic/claude-protein-binder-design
  2. opencompass

    Datasets & benchmarks

    OpenCompass is an LLM evaluation platform, supporting a wide range of models from OpenAI, Anthropic, Gemini, Qwen, GLM, DeepSeek, etc, across 100+ datasets covering knowledge, reasoning, coding, science, language, long-context, and safety.

    Indexed GitHub, open-compass 7,596 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/open-compass/opencompass.git
  3. awesome-ai-gateway

    Datasets & benchmarks

    ⚡ Awesome AI Gateway — pick an AI gateway from 240+ (LiteLLM, OpenRouter, Portkey, Kong, Higress, new-api, Bifrost) by cost, security & compliance, see what consolidated in 2026, learn how they actually work from an 8-chapter handbook, and verify every number yourself. Reproducible benchmarks, bilingual; stars & releases refreshed daily.

    Indexed GitHub, cuihuan 158 ★CC0-1.0Updated yesterday

    git clone https://github.com/cuihuan/awesome-ai-gateway.git
  4. ollama-benchmark

    Datasets & benchmarks

    LLM Benchmark for Throughput via Ollama (Local LLMs)

    Stale GitHub, aidatatools 397 ★MITUpdated 20 days ago

    git clone https://github.com/aidatatools/ollama-benchmark.git
  5. TheAgentCompany

    Datasets & benchmarks

    An agent benchmark with tasks in a simulated software company.

    Stale GitHub, TheAgentCompany 795 ★MITUpdated 12 months ago

    git clone https://github.com/TheAgentCompany/TheAgentCompany.git
  6. AI_Diplomacy

    Datasets & benchmarks

    Frontier Models playing the board game Diplomacy.

    Stale GitHub, GoodStartLabs 708 ★Custom licence (see repository)Updated 5 months ago

    git clone https://github.com/GoodStartLabs/AI_Diplomacy.git