Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
BentoML
AI repositoriesThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
git clone https://github.com/bentoml/BentoML.git -
ai-inference-proof-escrow-auditor
MCP serversERC-8183 Proof-of-Inference, Anti-Model-Downgrade & Token Billing Escrow on Base.
-
Qwen3.8-Max rates within 30 Arena points of Claude Opus 5.5 for 3.3× less per output token..
-
LitServe
Tools & appsA minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
git clone https://github.com/Lightning-AI/LitServe.git -
openvino
AI repositoriesOpenVINO™ is an open source toolkit for optimizing and deploying AI inference
git clone https://github.com/openvinotoolkit/openvino.git -
flama
AI repositoriesThe production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP.
git clone https://github.com/vortico/flama.git -
awesome-llm-token-optimization
PromptsA curated list of strategies, tools, papers, and resources for reducing LLM token costs and improving efficiency in production.
git clone https://github.com/pleasedodisturb/awesome-llm-token-optimization.git -
ai-hardware-fit
Datasets & benchmarksCan my GPU run this? Pick a GPU to get 3 fitting AI models, quantization, VRAM, speed ranges, and run commands. 한국어·English.
git clone https://github.com/jaeseok614/ai-hardware-fit.git -
Groq
Public APIsFast AI inference API with free tier, supports Llama, Mixtral, Gemma models
-
vibedonate
MCP serversBitTorrent-style mesh for AI inference across agentic CLIs. Local-first.
vibedonate@0.4.2 -
telegraph
MCP serversDecentralized AI inference (weather, deepfake detection, LLMs) with x402 USDC micropayments.
telegraph-protocol-mcp@1.0.0 -
mcp
MCP servers63 paid services via USDC: crypto analytics, satellite, IoT, AI inference, prediction markets.
coinrailz-mcp@1.1.0 -
Animica
MCP serversAnimica chain data, free keyless AI inference, quantum randomness, x402 discovery, mining stats.
animica-mcp@0.2.2 -
Animica
MCP serversAnimica chain data, free keyless AI inference, quantum randomness, x402 discovery, mining stats.
animica-mcp@0.2.2 -
drain-mcp
MCP serversPay for AI inference with USDC micropayments on Polygon. No API keys needed.
drain-mcp@0.1.3 -
GenieLocker
MCP serversDiscover and quote quality-gated private AI inference without creating or buying a locker.
ghcr.io/nhantour/genie-locker-mcp:0.2.0 -
inferenceindexer-mcp
MCP serversAI inference pricing for agents: live and historical model prices, provider comparison.
inferenceindexer-mcp@0.1.1 -
myai-mcp
MCP serversDecentralized AI inference on Base: OpenAI-compatible chat via community GPUs, paid in MYAI
myai-mcp@0.2.0 -
trading-mcp
MCP servers72 x402 endpoints: trading, AI inference, blockchain, escrow. USDC on Base+Solana.
ai-rook-trading-mcp@1.1.0 -
mingxin-mcp-server
MCP serversMeasured AI-inference-storage benchmarks with citations, article search, KV-cache ROI estimation.
mingxin-mcp-server@1.0.0 -
InferCPI
MCP serversAI inference price index: token prices, cost per capability, open vs closed, hosts, cost per task.
-
LLM Latency Tracker
MCP serversMeasured latency, time to first token and uptime for ~45 AI inference APIs, by region.
-
XFuel
MCP serversSubmit AI inference to XFuel, pay per task (USDC via x402 or TFUEL), fetch/verify ZK proofs.
xfuel-mcp@0.1.1 -
Animica
MCP serversRead-only Animica chain data, free AI inference, verifiable quantum randomness, and mining stats.
animica-mcp@0.2.0
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.