InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. llmfit

    AI repositories

    Hundreds of models & providers. One command to find what runs on your hardware.

    Stale GitHub, AlexsJones 38.8k ★MITUpdated 7 days ago

    git clone https://github.com/AlexsJones/llmfit.git
  2. handy-ollama

    AI repositories

    动手学Ollama,CPU玩转大模型部署,在线阅读地址:https://datawhalechina.github.io/handy-ollama/

    Stale GitHub, datawhalechina 2,543 ★Custom licence (see repository)Updated 10 months ago

    git clone https://github.com/datawhalechina/handy-ollama.git
  3. mojo-dllm

    AI repositories

    Local inference for diffusion language models (LLaDA, Dream), written in Mojo

    Stale GitHub, vladimirrott 506 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/vladimirrott/mojo-dllm.git
  4. Soup

    AI repositories

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    Stale GitHub, MakazhanAlpamys 10.3k ★Apache-2.0Updated 9 days ago

    git clone https://github.com/MakazhanAlpamys/Soup.git
  5. inferssd

    AI repositories

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Indexed GitHub, wici-ai 1,025 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/wici-ai/inferssd.git
  6. atomic-agent

    AI repositories

    Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

    Stale GitHub, AtomicBot-ai 3,460 ★MITUpdated 19 days ago

    git clone https://github.com/AtomicBot-ai/atomic-agent.git
  7. TensorSharp

    AI repositories

    A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

    Stale GitHub, zhongkaifu 675 ★BSD-3-ClauseUpdated 4 days ago

    git clone https://github.com/zhongkaifu/TensorSharp.git
  8. ETOS-LLM-Studio

    AI repositories

    A native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools, Siri Shortcuts, and cross-device sync. Built with Swift.

    Indexed GitHub, Eric-Terminal 220 ★GPL-3.0Updated yesterday

    git clone https://github.com/Eric-Terminal/ETOS-LLM-Studio.git
  9. Box

    AI repositories

    The most advanced, fully offline client-side AI suite on Android today.

    Indexed GitHub, jegly 1,013 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/jegly/Box.git
  10. unsloth

    AI repositories

    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

    Indexed GitHub, unslothai 79.6k ★Apache-2.0Updated today

    git clone https://github.com/unslothai/unsloth.git
  11. yzma

    AI repositories

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    Stale GitHub, hybridgroup 652 ★Custom licence (see repository)Updated 32 days ago

    git clone https://github.com/hybridgroup/yzma.git
  12. mlx-serve

    AI repositories

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    Indexed GitHub, ddalcu 2,475 ★Custom licence (see repository)Updated today

    git clone https://github.com/ddalcu/mlx-serve.git
  13. Atomic-Chat

    AI repositories

    Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

    Stale GitHub, AtomicBot-ai 1,808 ★Custom licence (see repository)Updated 30 days ago

    git clone https://github.com/AtomicBot-ai/Atomic-Chat.git
  14. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated today

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  15. PS5LM

    AI repositories

    llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

    Stale GitHub, cobanov 673 ★GPL-3.0Updated 24 days ago

    git clone https://github.com/cobanov/PS5LM.git
  16. jev

    AI repositories

    jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

    Stale GitHub, feder-cr 1,342 ★MITUpdated 31 days ago

    git clone https://github.com/feder-cr/jev.git
  17. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated today

    git clone https://github.com/prabanta-dev/janas.git
  18. PolyStrata

    AI repositories

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

    Stale GitHub, VecSzn 722 ★MITUpdated 16 days ago

    git clone https://github.com/VecSzn/PolyStrata.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.