InnerVault

LLM Latency Tracker

Stale Official MCP Registry, dev.llmlatency

Measured latency, time to first token and uptime for ~45 AI inference APIs, by region.

Open the source (opens github.com) https://github.com/mazamaka/llm-latency-tracker

Before you use it

  • Runs on someone else's server: what you send it leaves your machine.

What it is

MCP servers from dev.llmlatency.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Remote endpoint (streamable-http)

https://llmlatency.dev/mcp

From the server's entry in the official MCP Registry

Related

  1. LLM Eval Harness

    MCP servers

    Run a golden set and gate LLM model swaps on accuracy, with latency and cost per request.

    Stale Official MCP Registry, io.github.razilzul Updated 29 days ago 2 notes

    ghcr.io/razilzul/llm-eval-harness:1.0.0
  2. A knowledge base and runnable curriculum from junior to distinguished engineer: CS foundations, DSA, system design, C++ and Python, quant and low-latency systems, agentic AI, cloud AI, developer toolchain, and shell and Unix engineering.

    Indexed GitHub, shreejitverma 26 ★MITUpdated yesterday

    git clone https://github.com/shreejitverma/The-Distinguished-Engineer.git
  3. server

    MCP servers

    Observability MCP server: query LLM cost/errors/latency & operate alerts/evals from Claude/Cursor

    Stale Official MCP Registry, com.argosvix Updated 2 months ago 2 notes

    @argosvix/mcp-server@1.1.2
  4. ChimeraForge

    MCP servers

    Local-first LLM deployment planner: GPU/VRAM sizing, cost and latency, with provenance

    Stale Official MCP Registry, io.github.Sahil170595 Updated 2 days ago 1 note

    chimeraforge@0.101.0
  5. Model Radar

    MCP servers

    Ping 134+ free coding LLMs across 17 providers, rank by latency, pick the fastest.

    Stale Official MCP Registry, io.github.srclight Updated 3 months ago 1 note

    model-radar-mcp@0.12.0
  6. Orma Memory

    MCP servers

    Episode-first, zero-latency long-term memory for local LLMs and AI coding assistants.

    Stale Official MCP Registry, io.github.wizardwithcodehazard Updated 15 days ago 1 note

    orma-ai@0.1.13