InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

Looks like a goal we have a starting path for: I want to connect AI to my tools

  1. OpenLLM

    AI repositories

    Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

    Stale GitHub, bentoml 12.6k ★Apache-2.0Updated 25 days ago

    git clone https://github.com/bentoml/OpenLLM.git
  2. hertzbeat

    AI repositories

    An AI-powered next-generation open source real-time observability system.

    Stale GitHub, apache 7,463 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/apache/hertzbeat.git
  3. llm-d

    AI repositories

    State of the art inference performance with modern accelerators on Kubernetes

    Indexed GitHub, llm-d 5,274 ★Apache-2.0Updated today

    git clone https://github.com/llm-d/llm-d.git
  4. PowerInfer

    AI repositories

    High-speed Large Language Model Serving for Local Deployment

    Stale GitHub, Tiiny-AI 9,828 ★MITUpdated 6 months ago

    git clone https://github.com/Tiiny-AI/PowerInfer.git
  5. aidea-server

    AI repositories

    AIdea 是一款支持 GPT 以及国产大语言模型通义千问、文心一言等,支持 Stable Diffusion 文生图、图生图、 SDXL1.0、超分辨率、图片上色的全能型 APP。

    Stale GitHub, mylxsw 1,765 ★Updated 25 days ago

    git clone https://github.com/mylxsw/aidea-server.git
  6. autoflow

    AI repositories

    pingcap/autoflow is a Graph RAG based and conversational knowledge base tool built with TiDB Serverless Vector Storage. Demo: https://tidb.ai

    Stale GitHub, pingcap 2,982 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/pingcap/autoflow.git
  7. Chat2DB

    AI repositories

    Chat2DB is a free, cross-platform, local-first database client and SQL workspace for developers, DBAs, analysts, and data teams. Connect to 40+ databases, manage data, edit and run SQL, and use your own AI model to generate, explain, and optimize queries. Available on desktop, web, Docker, and CLI, with MCP support.

    Stale GitHub, OtterMind 28.3k ★Custom licence (see repository)Updated 33 days ago

    git clone https://github.com/OtterMind/Chat2DB.git
  8. awesome-generative-ai

    AI repositories

    A curated list of modern Generative Artificial Intelligence projects and services

    Stale GitHub, steven2358 12.8k ★CC0-1.0Updated 17 days ago

    git clone https://github.com/steven2358/awesome-generative-ai.git
  9. mlx-serve

    AI repositories

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    Indexed GitHub, ddalcu 2,475 ★Custom licence (see repository)Updated today

    git clone https://github.com/ddalcu/mlx-serve.git
  10. sie

    AI repositories

    Open-source inference server and production cluster for all the models your agent needs.

    Indexed GitHub, superlinked 3,517 ★Apache-2.0Updated yesterday

    git clone https://github.com/superlinked/sie.git
  11. mockserver-monorepo

    AI repositories

    MockServer is an HTTP(S) mock server and proxy for testing that lets you mock APIs, inspect and modify live traffic, and inject failures. It supports HTTP/1.1, HTTP/2, gRPC, WebSockets, TCP and more on a single port, with additional support for HTTP/3, message brokers, and AI/LLM APIs.

    Indexed GitHub, mock-server 5,010 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/mock-server/mockserver-monorepo.git
  12. rtp-llm

    AI repositories

    RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

    Indexed GitHub, alibaba 1,400 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/alibaba/rtp-llm.git
  13. simba

    AI repositories

    OpenSource Production ready Customer service with built in Evals and monitoring

    Stale GitHub, GitHamza0206 1,546 ★Apache-2.0Updated 5 months ago

    git clone https://github.com/GitHamza0206/simba.git
  14. agent-squad

    AI repositories

    Flexible and powerful framework for managing multiple AI agents and handling complex conversations

    Indexed GitHub, 2FastLabs 7,805 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/2FastLabs/agent-squad.git
  15. kvcached

    AI repositories

    Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

    Stale GitHub, ovg-project 2,033 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/ovg-project/kvcached.git
  16. GenerativeAIExamples

    AI repositories

    Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

    Stale GitHub, NVIDIA 4,210 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/NVIDIA/GenerativeAIExamples.git
  17. lmdeploy

    AI repositories

    LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

    Stale GitHub, InternLM 8,136 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/InternLM/lmdeploy.git
  18. csghub-server

    AI repositories

    csghub-server is the backend server for CSGHub which helps user to manage datasets, modes, and also run Model Inference, Finetune and Application Spaces.

    Indexed GitHub, OpenCSGs 1,040 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/OpenCSGs/csghub-server.git
  19. ramalama

    AI repositories

    RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

    Stale GitHub, containers 3,097 ★MITUpdated 16 days ago

    git clone https://github.com/containers/ramalama.git
  20. ai-infra-book

    AI repositories

    《深入理解 AI Infra:量化分析与系统设计》(李博杰 著)开源书稿:从硬件约束和模型架构出发,量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验

    Stale GitHub, bojieli 6,489 ★Apache-2.0Updated 46 days ago

    git clone https://github.com/bojieli/ai-infra-book.git
  21. superduper

    AI repositories

    Superduper: End-to-end framework for building custom AI applications and agents.

    Stale GitHub, superduper-io 5,327 ★Apache-2.0Updated 14 months ago

    git clone https://github.com/superduper-io/superduper.git
  22. jev-chat-jarvis

    AI repositories

    The chat decision assistant: before you reply, Jev reads the chat, judges intent and risk, and drafts replies you fill in with one tap. You press send. Android · Windows · macOS · iOS | 聊天辅助决策工具:先看懂对方再回复,发不发由你。

    Stale GitHub, jev-chat 7,749 ★MITUpdated 39 days ago

    git clone https://github.com/jev-chat/jev-chat-jarvis.git
  23. serverless-chat-langchainjs

    AI repositories

    Build your own serverless AI Chat with Retrieval-Augmented-Generation using LangChain.js, TypeScript and Azure

    Stale GitHub, Azure-Samples 867 ★MITUpdated 10 days ago

    git clone https://github.com/Azure-Samples/serverless-chat-langchainjs.git
  24. CodeProject.AI-Server

    AI repositories

    CodeProject.AI Server is a self contained service that software developers can include in, and distribute with, their applications in order to augment their apps with the power of AI.

    Stale GitHub, codeproject 985 ★Custom licence (see repository)Updated 16 months ago

    git clone https://github.com/codeproject/CodeProject.AI-Server.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.