Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
omlx
AI repositoriesLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
git clone https://github.com/jundot/omlx.git -
wllama
AI repositoriesWebAssembly binding for llama.cpp - Enabling on-browser LLM inference
git clone https://github.com/ngxson/wllama.git -
kvcached
AI repositoriesVirtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
git clone https://github.com/ovg-project/kvcached.git -
BentoML
AI repositoriesThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
git clone https://github.com/bentoml/BentoML.git -
airllm
AI repositoriesAirLLM 2.8T LLM inference with single 4GB GPU
git clone https://github.com/lyogavin/airllm.git -
AI-Engineer-Headquarters
AI repositoriesA collection of scientific methods, processes, algorithms, and systems to build stories & models.
git clone https://github.com/hemansnation/AI-Engineer-Headquarters.git -
ecologits
AI repositories🌱 EcoLogits tracks the energy consumption and environmental footprint of using generative AI models through APIs.
git clone https://github.com/mlco2/ecologits.git -
beta9
AI repositoriesUltrafast serverless GPU inference, sandboxes, and background jobs
git clone https://github.com/beam-cloud/beta9.git -
LLM-TPU
AI repositoriesRun generative AI models in sophgo BM1684X/BM1688
git clone https://github.com/sophgo/LLM-TPU.git -
tiny-llm
AI repositorieslearn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen
git clone https://github.com/skyzh/tiny-llm.git -
nanocoder
AI repositoriesAn open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.
git clone https://github.com/Nano-Collective/nanocoder.git -
neuron-ai
AI repositoriesThe Agentic Framework of the PHP ecosystem to build production-ready AI driven applications. Connect components (LLMs, Tools, vector DBs, memory) to agents that interact with your data and UI.
git clone https://github.com/neuron-core/neuron-ai.git -
plano
AI repositoriesPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
git clone https://github.com/katanemo/plano.git -
rtp-llm
AI repositoriesRTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
git clone https://github.com/alibaba/rtp-llm.git -
kimi-k3-in-c
AI repositoriesA 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
git clone https://github.com/FareedKhan-dev/kimi-k3-in-c.git -
openlake
AI repositoriesOpenLake is a high performance storage engine for efficient LLM inference and GPU Training
git clone https://github.com/openlake-project/openlake.git -
MiniSearch
AI repositoriesMinimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space
git clone https://github.com/felladrin/MiniSearch.git -
ome
AI repositoriesOpen Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
git clone https://github.com/ome-projects/ome.git -
deepreasoning
AI repositoriesA high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
git clone https://github.com/winfunc/deepreasoning.git -
tokenspeed
AI repositoriesTokenSpeed is a speed-of-light LLM inference engine.
git clone https://github.com/lightseekorg/tokenspeed.git -
awesome-ai-web-search
AI repositoriesList of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search
git clone https://github.com/felladrin/awesome-ai-web-search.git -
Atomic-Chat
AI repositoriesLocal AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
git clone https://github.com/AtomicBot-ai/Atomic-Chat.git -
jev
AI repositoriesjevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
git clone https://github.com/feder-cr/jev.git -
ShannonBase
AI repositoriesThe Next-Gen Database for AI—an infrastructure designed for data and AI. As the MySQL of the AI era.
git clone https://github.com/Shannon-Data/ShannonBase.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.