Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to connect AI to my tools
-
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git -
serviette
AI repositoriesA no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway.
git clone https://github.com/pathwaycom/serviette.git -
ray
AI repositoriesRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
git clone https://github.com/ray-project/ray.git -
llm-action
AI repositories本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)
git clone https://github.com/liguodongiot/llm-action.git -
omlx
AI repositoriesLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
git clone https://github.com/jundot/omlx.git -
serve
AI repositories☁️ Build multimodal AI applications with cloud-native stack
git clone https://github.com/jina-ai/serve.git -
mcp-toolbox
AI repositoriesMCP Toolbox for Databases is an open source MCP server for databases.
git clone https://github.com/googleapis/mcp-toolbox.git -
A2A
AI repositoriesAgent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.
git clone https://github.com/a2aproject/A2A.git -
BentoML
AI repositoriesThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
git clone https://github.com/bentoml/BentoML.git -
MaxKB
AI repositories🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。
git clone https://github.com/1Panel-dev/MaxKB.git -
vespa
AI repositoriesThe AI search platform
git clone https://github.com/vespa-engine/vespa.git -
composio
AI repositoriesComposio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
git clone https://github.com/ComposioHQ/composio.git -
vllm-ascend
AI repositoriesCommunity maintained hardware plugin for vLLM on Huawei Ascend
git clone https://github.com/vllm-project/vllm-ascend.git -
sglang
AI repositoriesSGLang is a high-performance serving framework for large language models and multimodal models.
git clone https://github.com/sgl-project/sglang.git -
Mooncake
AI repositoriesMooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
git clone https://github.com/kvcache-ai/Mooncake.git -
chitu
AI repositoriesHigh-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
git clone https://github.com/thu-pacman/chitu.git -
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
OpenBidKit_Yibiao
AI repositories开箱即用的AI标书编写工具,标书AI生成工具,投标工具箱、知识库、标书查重、废标项检查,完全开源免费,欢迎使用
git clone https://github.com/FB208/OpenBidKit_Yibiao.git -
LightLLM
AI repositoriesLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
git clone https://github.com/ModelTC/LightLLM.git -
gateway
AI repositoriesA blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
git clone https://github.com/Portkey-AI/gateway.git -
docs-mcp-server
AI repositoriesGrounded Docs MCP Server: Open-Source Alternative to Context7, Nia, and Ref.Tools
git clone https://github.com/arabold/docs-mcp-server.git -
plano
AI repositoriesPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
git clone https://github.com/katanemo/plano.git -
beta9
AI repositoriesUltrafast serverless GPU inference, sandboxes, and background jobs
git clone https://github.com/beam-cloud/beta9.git -
tiny-llm
AI repositorieslearn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
git clone https://github.com/skyzh/tiny-llm.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.