retriEVAL
LLM evals as MCP tools: score outputs for faithfulness, relevancy, and hallucination.
Open the source (opens github.com) https://github.com/hcarrillo001/retrieval-mcp
Before you use it
- Runs on your computer with your permissions. Read what it can do before connecting it to an agent.
- Needs credentials: ANTHROPIC_API_KEY. Use a key with the least access you can.
What it is
MCP servers from io.github.hcarrillo001.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
oci package (stdio)
ghcr.io/hcarrillo001/retrieval-mcp:1.0.0
From the server's entry in the official MCP Registry
Settings it asks for
ANTHROPIC_API_KEYsecret · Judge model API key. Not needed if you set RETRIEVAL_JUDGE_BACKEND=ollama to run the judge locally.RETRIEVAL_JUDGE_BACKEND· Which judge to score with: anthropic (default), openai, or ollama for a fully local judge.RETRIEVAL_JUDGE_MODEL· Judge model id, e.g. claude-sonnet-4-6 or qwen2.5:14b for Ollama.RETRIEVAL_BUDGET_USD· Spend cap for judge calls. Unset means no cap.
Related
-
GitHub MCP server
MCP serversGitHub's official MCP server. It lets an agent read and work with repositories, issues and pull requests.
https://api.githubcopilot.com/mcp/ -
semble
MCP serversFast and Accurate Code Search for Agents. Uses 99% fewer tokens than grep+read
git clone https://github.com/MinishLab/semble.git -
Apify MCP server
MCP serversLets an agent run Apify's ready-made scrapers to pull data from websites, search engines, maps and social platforms.
-
VectorCode
MCP serversA code repository indexing tool to supercharge your LLM experience.
git clone https://github.com/Davidyz/VectorCode.git -
Mantic.sh
MCP serversA structural code search engine for Al agents.
git clone https://github.com/marcoaapfortes/Mantic.sh.git -
serena
MCP serversA powerful MCP toolkit for coding, providing semantic retrieval and editing capabilities - the IDE for your agent
git clone https://github.com/oraios/serena.git