LLM Latency Tracker
Measured latency, time to first token and uptime for ~45 AI inference APIs, by region.
Open the source (opens github.com) https://github.com/mazamaka/llm-latency-tracker
Before you use it
- Runs on someone else's server: what you send it leaves your machine.
What it is
MCP servers from dev.llmlatency.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Remote endpoint (streamable-http)
https://llmlatency.dev/mcp
From the server's entry in the official MCP Registry
Related
-
LLM Eval Harness
MCP serversRun a golden set and gate LLM model swaps on accuracy, with latency and cost per request.
ghcr.io/razilzul/llm-eval-harness:1.0.0 -
The-Distinguished-Engineer
MCP serversA knowledge base and runnable curriculum from junior to distinguished engineer: CS foundations, DSA, system design, C++ and Python, quant and low-latency systems, agentic AI, cloud AI, developer toolchain, and shell and Unix engineering.
git clone https://github.com/shreejitverma/The-Distinguished-Engineer.git -
server
MCP serversObservability MCP server: query LLM cost/errors/latency & operate alerts/evals from Claude/Cursor
@argosvix/mcp-server@1.1.2 -
ChimeraForge
MCP serversLocal-first LLM deployment planner: GPU/VRAM sizing, cost and latency, with provenance
chimeraforge@0.101.0 -
Model Radar
MCP serversPing 134+ free coding LLMs across 17 providers, rank by latency, pick the fastest.
model-radar-mcp@0.12.0 -
Orma Memory
MCP serversEpisode-first, zero-latency long-term memory for local LLMs and AI coding assistants.
orma-ai@0.1.13