InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. OpenLLM

    AI repositories

    Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

    Stale GitHub, bentoml 12.6k ★Apache-2.0Updated 25 days ago

    git clone https://github.com/bentoml/OpenLLM.git
  2. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/gpustack/gpustack.git
  3. incognide

    Agents & frameworks

    Explore the unknown, build the future, own your data.

    Stale GitHub, NPC-Worldwide 496 ★MITUpdated 6 days ago

    git clone https://github.com/NPC-Worldwide/incognide.git
  4. mistral-inference

    AI repositories

    Official inference library for Mistral models

    Stale Archived GitHub, mistralai 10.8k ★Apache-2.0Updated 5 months ago 1 note

    git clone https://github.com/mistralai/mistral-inference.git
  5. omlx

    AI repositories

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

    Indexed GitHub, jundot 23.7k ★Apache-2.0Updated today

    git clone https://github.com/jundot/omlx.git
  6. optillm

    Prompts

    Optimizing inference proxy for LLMs

    Stale GitHub, algorithmicsuperintelligence 4,337 ★Apache-2.0Updated 14 days ago

    git clone https://github.com/algorithmicsuperintelligence/optillm.git
  7. wllama

    AI repositories

    WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

    Stale GitHub, ngxson 1,363 ★MITUpdated 10 days ago

    git clone https://github.com/ngxson/wllama.git
  8. kvcached

    AI repositories

    Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

    Stale GitHub, ovg-project 2,033 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/ovg-project/kvcached.git
  9. LLM-VM

    Agents & frameworks

    irresponsible innovation. Try now at https://chat.dev/

    Stale GitHub, anarchy-ai 492 ★MITUpdated 2 years ago

    git clone https://github.com/anarchy-ai/LLM-VM.git
  10. BentoML

    AI repositories

    The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

    Stale GitHub, bentoml 8,935 ★Apache-2.0Updated 14 days ago

    git clone https://github.com/bentoml/BentoML.git
  11. airllm

    AI repositories

    AirLLM 2.8T LLM inference with single 4GB GPU

    Indexed GitHub, lyogavin 42.5k ★Apache-2.0Updated today

    git clone https://github.com/lyogavin/airllm.git
  12. bespoke_automata

    Tools & apps

    Bespoke Automata is a GUI and deployment pipline for making complex AI agents locally and offline

    Stale GitHub, C0deMunk33 223 ★GPL-3.0Updated 8 months ago

    git clone https://github.com/C0deMunk33/bespoke_automata.git
  13. AI-Engineer-Headquarters

    AI repositories

    A collection of scientific methods, processes, algorithms, and systems to build stories & models.

    Stale GitHub, hemansnation 3,776 ★Updated 19 days ago

    git clone https://github.com/hemansnation/AI-Engineer-Headquarters.git
  14. ecologits

    AI repositories

    🌱 EcoLogits tracks the energy consumption and environmental footprint of using generative AI models through APIs.

    Stale GitHub, mlco2 354 ★MPL-2.0Updated 21 days ago

    git clone https://github.com/mlco2/ecologits.git
  15. llmspeed

    Datasets & benchmarks

    Feel how fast a local LLM runs before you buy the hardware

    Stale GitHub, nicorobinreal 152 ★MITUpdated 27 days ago

    git clone https://github.com/nicorobinreal/llmspeed.git
  16. beta9

    AI repositories

    Ultrafast serverless GPU inference, sandboxes, and background jobs

    Indexed GitHub, beam-cloud 1,852 ★AGPL-3.0Updated today

    git clone https://github.com/beam-cloud/beta9.git
  17. LLM-TPU

    AI repositories

    Run generative AI models in sophgo BM1684X/BM1688

    Stale GitHub, sophgo 321 ★Custom licence (see repository)Updated 7 days ago

    git clone https://github.com/sophgo/LLM-TPU.git
  18. Context-Engine

    MCP servers

    Context-Engine MCP - Agentic Context Compression Suite

    Stale GitHub, Context-Engine-AI 401 ★MITUpdated 4 months ago

    git clone https://github.com/Context-Engine-AI/Context-Engine.git
  19. cave-agent

    Agents & frameworks

    Stateful runtime management for LLM agents—inject, manipulate, and retrieve Python objects across turns.

    Stale GitHub, acodercat 204 ★MITUpdated 2 months ago

    git clone https://github.com/acodercat/cave-agent.git
  20. lemonade

    MCP servers

    Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

    Indexed GitHub, lemonade-sdk 6,222 ★Apache-2.0Updated today

    git clone https://github.com/lemonade-sdk/lemonade.git
  21. tiny-llm

    AI repositories

    learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

    Stale GitHub, skyzh 5,680 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/skyzh/tiny-llm.git
  22. nanocoder

    AI repositories

    An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.

    Indexed GitHub, Nano-Collective 2,573 ★Custom licence (see repository)Updated today

    git clone https://github.com/Nano-Collective/nanocoder.git
  23. eko

    Prompts

    Eko (Eko Keeps Operating) - Build Production-ready Agentic Workflow with Natural Language - eko.fellou.ai

    Stale GitHub, FellouAI 4,962 ★MITUpdated 8 months ago

    git clone https://github.com/FellouAI/eko.git
  24. Bittune

    Agents & frameworks

    Local-first engineering agent that deploys, benchmarks and tunes vLLM/SGLang inference services on your own GPUs, with auditable run evidence.

    Indexed GitHub, bitcloud-ai 304 ★MITUpdated 3 days ago

    git clone https://github.com/bitcloud-ai/Bittune.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.