Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
picollm
AI repositoriesOn-device LLM Inference Powered by X-Bit Quantization
git clone https://github.com/Picovoice/picollm.git -
Foundation-Models-Framework-Lab
AI repositoriesA practical lab for building, testing, and evaluating apps with Apple's Foundation Models framework.
git clone https://github.com/rudrankriyam/Foundation-Models-Framework-Lab.git -
openmed
AI repositoriesLocal-first healthcare AI: clinical NER and HIPAA PII de-identification on hardware you control. 2,200+ medical models, 35 model-backed PII languages, and Python, MLX, Android and browser runtimes. Apache-2.0 SDK.
git clone https://github.com/maziyarpanahi/openmed.git -
cactus
AI repositoriesSub-50mb agentic, voice and vision intelligence for consumer devices.
git clone https://github.com/cactus-compute/cactus.git -
runanywhere-sdks
AI repositoriesProduction ready toolkit to run AI locally
git clone https://github.com/RunanywhereAI/runanywhere-sdks.git -
nativ
AI repositoriesNativ is an open-source local AI app for Mac. It runs open AI models on Apple Silicon, and nothing leaves your Mac.
git clone https://github.com/Neywa-Labs/nativ.git -
litert-samples
AI repositoriesLiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.
git clone https://github.com/google-ai-edge/litert-samples.git -
SwiftLM
AI repositories⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
git clone https://github.com/SharpAI/SwiftLM.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
Hands-On-Large-Language-Models
AI repositoriesOfficial code repo for the O'Reilly Book - "Hands-On Large Language Models"
git clone https://github.com/HandsOnLLM/Hands-On-Large-Language-Models.git -
jev
AI repositoriesjevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.
git clone https://github.com/feder-cr/jev.git -
LLMs-from-scratch
AI repositoriesImplement a ChatGPT-like LLM in PyTorch from scratch, step by step
git clone https://github.com/rasbt/LLMs-from-scratch.git -
llm-course
AI repositoriesCourse to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
git clone https://github.com/mlabonne/llm-course.git -
Qwen
AI repositoriesThe official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
git clone https://github.com/QwenLM/Qwen.git -
LLMSurvey
AI repositoriesThe official GitHub page for the survey paper "A Survey of Large Language Models".
git clone https://github.com/RUCAIBox/LLMSurvey.git -
awesome-japanese-llm
AI repositories日本語LLMまとめ - Overview of Japanese LLMs
git clone https://github.com/llm-jp/awesome-japanese-llm.git -
VivaDicta
AI repositoriesiOS & watchOS speech-to-text app with AI voice keyboard, on-device RAG, and chat with your notes - powered by Apple Foundation Models, WhisperKit, NVIDIA Parakeet, and 20+ AI providers
git clone https://github.com/n0an/VivaDicta.git -
PentestGPT
AI repositoriesAutomated Penetration Testing Agentic Framework Powered by Large Language Models
git clone https://github.com/GreyDGL/PentestGPT.git -
Chinese-LLaMA-Alpaca
AI repositories中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca.git -
turbo-fieldfare
AI repositoriesGemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
git clone https://github.com/drumih/turbo-fieldfare.git -
PowerInfer
AI repositoriesHigh-speed Large Language Model Serving for Local Deployment
git clone https://github.com/Tiiny-AI/PowerInfer.git -
txtai
AI repositories💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
git clone https://github.com/neuml/txtai.git -
ai
AI repositoriesOn-device LLM execution in React Native with Vercel AI SDK compatibility
git clone https://github.com/callstackincubator/ai.git -
Janus
AI repositoriesJanus-Series: Unified Multimodal Understanding and Generation Models
git clone https://github.com/deepseek-ai/Janus.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.