EvalForge Lite
Compare text LLMs across OpenRouter, Bedrock, Vertex AI and Foundry with automated grading.
Open the source (opens github.com) https://github.com/thejaredchapman/evalforge-lite
Before you use it
- Runs on your computer with your permissions. Read what it can do before connecting it to an agent.
- Needs credentials: OPENROUTER_API_KEY. Use a key with the least access you can.
What it is
MCP servers from io.github.thejaredchapman.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
pypi package (stdio)
evalforge-lite@1.0.1
From the server's entry in the official MCP Registry
Settings it asks for
OPENROUTER_API_KEYsecret · Optional. OpenRouter API key held by the server so tool calls need no credentials for OpenRouter. If unset, pass creds in each tool call.
Related
-
Liters/min to liters/s, number discarded
MCP serversLiters/min to liters/s, number discarded
-
tooluniverse
MCP servers2,700+ scientific tools for AI scientists: life science, research, literature, and more.
tooluniverse@1.5.10 -
literal-mcp
MCP serversLiteral library: books, states, lookup.
literal-mcp@1.0.0 -
LiteScribe
MCP serversSearch and read your LiteScribe recordings: transcripts, summaries, action items, screenshots.
-
US gallons to liters
MCP serversUS gallons to liters
-
Liters to US gallons
MCP serversLiters to US gallons