Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to connect AI to my tools
-
OpenLLM
AI repositoriesRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
git clone https://github.com/bentoml/OpenLLM.git -
hertzbeat
AI repositoriesAn AI-powered next-generation open source real-time observability system.
git clone https://github.com/apache/hertzbeat.git -
llm-d
AI repositoriesState of the art inference performance with modern accelerators on Kubernetes
git clone https://github.com/llm-d/llm-d.git -
PowerInfer
AI repositoriesHigh-speed Large Language Model Serving for Local Deployment
git clone https://github.com/Tiiny-AI/PowerInfer.git -
aidea-server
AI repositoriesAIdea 是一款支持 GPT 以及国产大语言模型通义千问、文心一言等,支持 Stable Diffusion 文生图、图生图、 SDXL1.0、超分辨率、图片上色的全能型 APP。
git clone https://github.com/mylxsw/aidea-server.git -
autoflow
AI repositoriespingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai
git clone https://github.com/pingcap/autoflow.git -
Chat2DB
AI repositoriesChat2DB is a free, cross-platform, local-first database client and SQL workspace for developers, DBAs, analysts, and data teams. Connect to 40+ databases, manage data, edit and run SQL, and use your own AI model to generate, explain, and optimize queries. Available on desktop, web, Docker, and CLI, with MCP support.
git clone https://github.com/OtterMind/Chat2DB.git -
awesome-generative-ai
AI repositoriesA curated list of modern Generative Artificial Intelligence projects and services
git clone https://github.com/steven2358/awesome-generative-ai.git -
mlx-serve
AI repositoriesNative LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
git clone https://github.com/ddalcu/mlx-serve.git -
sie
AI repositoriesOpen-source inference server and production cluster for all the models your agent needs.
git clone https://github.com/superlinked/sie.git -
mockserver-monorepo
AI repositoriesMockServer is an HTTP(S) mock server and proxy for testing that lets you mock APIs, inspect and modify live traffic, and inject failures. It supports HTTP/1.1, HTTP/2, gRPC, WebSockets, TCP and more on a single port, with additional support for HTTP/3, message brokers, and AI/LLM APIs.
git clone https://github.com/mock-server/mockserver-monorepo.git -
rtp-llm
AI repositoriesRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
git clone https://github.com/alibaba/rtp-llm.git -
simba
AI repositoriesOpenSource Production ready Customer service with built in Evals and monitoring
git clone https://github.com/GitHamza0206/simba.git -
agent-squad
AI repositoriesFlexible and powerful framework for managing multiple AI agents and handling complex conversations
git clone https://github.com/2FastLabs/agent-squad.git -
kvcached
AI repositoriesVirtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
git clone https://github.com/ovg-project/kvcached.git -
GenerativeAIExamples
AI repositoriesGenerative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
git clone https://github.com/NVIDIA/GenerativeAIExamples.git -
lmdeploy
AI repositoriesLMDeploy is a toolkit for compressing, deploying, and serving LLMs.
git clone https://github.com/InternLM/lmdeploy.git -
csghub-server
AI repositoriescsghub-server is the backend server for CSGHub which helps user to manage datasets, modes, and also run Model Inference, Finetune and Application Spaces.
git clone https://github.com/OpenCSGs/csghub-server.git -
ramalama
AI repositoriesRamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
git clone https://github.com/containers/ramalama.git -
ai-infra-book
AI repositories《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验
git clone https://github.com/bojieli/ai-infra-book.git -
superduper
AI repositoriesSuperduper: End-to-end framework for building custom AI applications and agents.
git clone https://github.com/superduper-io/superduper.git -
jev-chat-jarvis
AI repositoriesThe chat decision assistant: before you reply, Jev reads the chat, judges intent and risk, and drafts replies you fill in with one tap. You press send. Android · Windows · macOS · iOS | 聊天辅助决策工具:先看懂对方再回复,发不发由你。
git clone https://github.com/jev-chat/jev-chat-jarvis.git -
serverless-chat-langchainjs
AI repositoriesBuild your own serverless AI Chat with Retrieval-Augmented-Generation using LangChain.js, TypeScript and Azure
git clone https://github.com/Azure-Samples/serverless-chat-langchainjs.git -
CodeProject.AI-Server
AI repositoriesCodeProject.AI Server is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.
git clone https://github.com/codeproject/CodeProject.AI-Server.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.