Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
Bonsai-demo
AI repositoriesBonsai Demo
git clone https://github.com/PrismML-Eng/Bonsai-demo.git -
jan
AI repositoriesJan is an open source alternative to ChatGPT that runs 100% offline on your computer.
git clone https://github.com/janhq/jan.git -
wllama
AI repositoriesWebAssembly binding for llama.cpp - Enabling on-browser LLM inference
git clone https://github.com/ngxson/wllama.git -
llmware
AI repositoriesUnified framework for building enterprise RAG pipelines with small, specialized models
git clone https://github.com/llmware-ai/llmware.git -
kalosm
AI repositoriesInstant, controllable, local pre-trained AI models in Rust
git clone https://github.com/floneum/kalosm.git -
LLamaSharp
AI repositoriesA C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.
git clone https://github.com/SciSharp/LLamaSharp.git -
runanywhere-sdks
AI repositoriesProduction ready toolkit to run AI locally
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git -
engine
AI repositories2bit quants, kernels and runtime for consumer devices.
git clone https://github.com/cactus-compute/engine.git -
Dot
AI repositoriesText-To-Speech, RAG, and LLMs. All local!
git clone https://github.com/alexpinel/Dot.git -
hass_local_openai_llm
Agents & frameworksHome Assistant LLM integration for local OpenAI-compatible services (llamacpp, vllm, etc)
git clone https://github.com/skye-harris/hass_local_openai_llm.git -
phlox
AI repositoriesOpen source, local first AI medical agent for desktop and web.
git clone https://github.com/bloodworks-io/phlox.git -
llama-gpt
AI repositoriesA self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
git clone https://github.com/getumbrel/llama-gpt.git -
lsp-ai
Tools & appsLSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.
git clone https://github.com/SilasMarvin/lsp-ai.git -
ramalama
AI repositoriesRamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
git clone https://github.com/containers/ramalama.git -
xybrid
AI repositoriesCross-platform on-device AI toolkit
git clone https://github.com/xybrid-ai/xybrid.git -
Box
AI repositoriesThe most advanced, fully offline client-side AI suite on Android today.
git clone https://github.com/jegly/Box.git -
khoj
AI repositoriesYour AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.
git clone https://github.com/khoj-ai/khoj.git -
inference
AI repositoriesOpen-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
git clone https://github.com/xorbitsai/inference.git -
yzma
AI repositoriesGo with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
git clone https://github.com/hybridgroup/yzma.git -
reor
AI repositoriesPrivate & local AI personal knowledge management app for high entropy people.
git clone https://github.com/reorproject/reor.git -
paddler
AI repositoriesOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
git clone https://github.com/intentee/paddler.git -
mac-ml-speed-test
Datasets & benchmarksA few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.
git clone https://github.com/mrdbourke/mac-ml-speed-test.git -
Lynkr
Tools & appsStreamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.
git clone https://github.com/Fast-Editor/Lynkr.git -
CLIO
Tools & appsAn AI-assisted coding agent that runs in your terminal and supports many providers and models.
git clone https://github.com/SyntheticAutonomicMind/CLIO.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.