InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to connect AI to my tools

  1. vllm

    AI repositories

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Indexed GitHub, vllm-project 97.0k ★Apache-2.0Updated today

    git clone https://github.com/vllm-project/vllm.git
  2. serviette

    AI repositories

    A no-code RAG server that keeps answers in sync with your documents. Works with 8 vector databases. Built on Pathway.

    Stale GitHub, pathwaycom 58.7k ★MITUpdated 6 days ago

    git clone https://github.com/pathwaycom/serviette.git
  3. ray

    AI repositories

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Indexed GitHub, ray-project 44.3k ★Apache-2.0Updated today

    git clone https://github.com/ray-project/ray.git
  4. llm-action

    AI repositories

    本项目旨在分享大模型相关技术原理以及实战经验(大模型工程化、大模型应用落地)

    Stale GitHub, liguodongiot 25.2k ★Apache-2.0Updated 33 days ago

    git clone https://github.com/liguodongiot/llm-action.git
  5. omlx

    AI repositories

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

    Indexed GitHub, jundot 23.7k ★Apache-2.0Updated today

    git clone https://github.com/jundot/omlx.git
  6. serve

    AI repositories

    ☁️ Build multimodal AI applications with cloud-native stack

    Stale GitHub, jina-ai 21.9k ★Apache-2.0Updated 20 months ago

    git clone https://github.com/jina-ai/serve.git
  7. mcp-toolbox

    AI repositories

    MCP Toolbox for Databases is an open source MCP server for databases.

    Indexed GitHub, googleapis 16.9k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/googleapis/mcp-toolbox.git
  8. A2A

    AI repositories

    Agent2Agent (A2A) is an open protocol enabling communication and interoperability between opaque agentic applications.

    Indexed GitHub, a2aproject 26.6k ★Apache-2.0Updated 3 days ago

    git clone https://github.com/a2aproject/A2A.git
  9. BentoML

    AI repositories

    The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

    Stale GitHub, bentoml 8,935 ★Apache-2.0Updated 14 days ago

    git clone https://github.com/bentoml/BentoML.git
  10. MaxKB

    AI repositories

    🔥 MaxKB is an open-source platform for building enterprise-grade agents. 强大易用的开源企业级智能体平台。

    Indexed GitHub, 1Panel-dev 23.2k ★GPL-3.0Updated 2 days ago

    git clone https://github.com/1Panel-dev/MaxKB.git
  11. vespa

    AI repositories

    The AI search platform

    Indexed GitHub, vespa-engine 7,180 ★Apache-2.0Updated today

    git clone https://github.com/vespa-engine/vespa.git
  12. composio

    AI repositories

    Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.

    Indexed GitHub, ComposioHQ 31.1k ★MITUpdated today

    git clone https://github.com/ComposioHQ/composio.git
  13. vllm-ascend

    AI repositories

    Community maintained hardware plugin for vLLM on Huawei Ascend

    Indexed GitHub, vllm-project 3,084 ★Apache-2.0Updated today

    git clone https://github.com/vllm-project/vllm-ascend.git
  14. sglang

    AI repositories

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Indexed GitHub, sgl-project 38.9k ★Apache-2.0Updated today

    git clone https://github.com/sgl-project/sglang.git
  15. Mooncake

    AI repositories

    Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

    Indexed GitHub, kvcache-ai 7,047 ★Apache-2.0Updated today

    git clone https://github.com/kvcache-ai/Mooncake.git
  16. chitu

    AI repositories

    High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    Stale GitHub, thu-pacman 2,998 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/thu-pacman/chitu.git
  17. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git
  18. OpenBidKit_Yibiao

    AI repositories

    开箱即用的AI标书编写工具,标书AI生成工具,投标工具箱、知识库、标书查重、废标项检查,完全开源免费,欢迎使用

    Indexed GitHub, FB208 3,338 ★AGPL-3.0Updated yesterday

    git clone https://github.com/FB208/OpenBidKit_Yibiao.git
  19. LightLLM

    AI repositories

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    Indexed GitHub, ModelTC 4,362 ★Apache-2.0Updated today

    git clone https://github.com/ModelTC/LightLLM.git
  20. gateway

    AI repositories

    A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

    Stale GitHub, Portkey-AI 13.2k ★MITUpdated 5 months ago

    git clone https://github.com/Portkey-AI/gateway.git
  21. docs-mcp-server

    AI repositories

    Grounded Docs MCP Server: Open-Source Alternative to Context7, Nia, and Ref.Tools

    Stale GitHub, arabold 1,827 ★MITUpdated 24 days ago

    git clone https://github.com/arabold/docs-mcp-server.git
  22. plano

    AI repositories

    Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

    Stale GitHub, katanemo 7,099 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/katanemo/plano.git
  23. beta9

    AI repositories

    Ultrafast serverless GPU inference, sandboxes, and background jobs

    Indexed GitHub, beam-cloud 1,852 ★AGPL-3.0Updated today

    git clone https://github.com/beam-cloud/beta9.git
  24. tiny-llm

    AI repositories

    learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

    Stale GitHub, skyzh 5,680 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/skyzh/tiny-llm.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.