Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
Bonsai-demo
AI repositoriesBonsai Demo
git clone https://github.com/PrismML-Eng/Bonsai-demo.git -
jan
AI repositoriesJan is an open source alternative to ChatGPT that runs 100% offline on your computer.
git clone https://github.com/janhq/jan.git -
wllama
AI repositoriesWebAssembly binding for llama.cpp - Enabling on-browser LLM inference
git clone https://github.com/ngxson/wllama.git -
llmware
AI repositoriesUnified framework for building enterprise RAG pipelines with small, specialized models
git clone https://github.com/llmware-ai/llmware.git -
kalosm
AI repositoriesInstant, controllable, local pre-trained AI models in Rust
git clone https://github.com/floneum/kalosm.git -
LLamaSharp
AI repositoriesA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
git clone https://github.com/SciSharp/LLamaSharp.git -
runanywhere-sdks
AI repositoriesProduction ready toolkit to run AI locally
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git -
engine
AI repositories2bit quants, kernels and runtime for consumer devices.
git clone https://github.com/cactus-compute/engine.git -
Dot
AI repositoriesText-To-Speech, RAG, and LLMs. All local!
git clone https://github.com/alexpinel/Dot.git -
phlox
AI repositoriesOpen source, local first AI medical agent for desktop and web.
git clone https://github.com/bloodworks-io/phlox.git -
llama-gpt
AI repositoriesA self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
git clone https://github.com/getumbrel/llama-gpt.git -
ramalama
AI repositoriesRamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
git clone https://github.com/containers/ramalama.git -
xybrid
AI repositoriesCross-platform on-device AI toolkit
git clone https://github.com/xybrid-ai/xybrid.git -
Box
AI repositoriesThe most advanced, fully offline client-side AI suite on Android today.
git clone https://github.com/jegly/Box.git -
khoj
AI repositoriesYour AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
git clone https://github.com/khoj-ai/khoj.git -
inference
AI repositoriesOpen-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
git clone https://github.com/xorbitsai/inference.git -
yzma
AI repositoriesGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
git clone https://github.com/hybridgroup/yzma.git -
reor
AI repositoriesPrivate & local AI personal knowledge management app for high entropy people.
git clone https://github.com/reorproject/reor.git -
paddler
AI repositoriesOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
git clone https://github.com/intentee/paddler.git -
Atomic-Chat
AI repositoriesLocal AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V
git clone https://github.com/AtomicBot-ai/Atomic-Chat.git -
intel-extension-for-transformers
AI repositories⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
git clone https://github.com/intel/intel-extension-for-transformers.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.