InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

19 results with any of your words Clear search and filters
  1. SeaGOAT

    AI repositories

    local-first semantic code search engine

    Stale GitHub, kantord 1,316 ★MITUpdated 16 days ago

    git clone https://github.com/kantord/SeaGOAT.git
  2. llmfit

    AI repositories

    Hundreds of models & providers. One command to find what runs on your hardware.

    Stale GitHub, AlexsJones 38.8k ★MITUpdated 8 days ago

    git clone https://github.com/AlexsJones/llmfit.git
  3. handy-ollama

    AI repositories

    动手学Ollama,CPU玩转大模型部署,在线阅读地址:https://datawhalechina.github.io/handy-ollama/

    Stale GitHub, datawhalechina 2,543 ★Custom licence (see repository)Updated 10 months ago

    git clone https://github.com/datawhalechina/handy-ollama.git
  4. mojo-dllm

    AI repositories

    Local inference for diffusion language models (LLaDA, Dream), written in Mojo

    Stale GitHub, vladimirrott 506 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/vladimirrott/mojo-dllm.git
  5. Soup

    AI repositories

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    Stale GitHub, MakazhanAlpamys 10.3k ★Apache-2.0Updated 10 days ago

    git clone https://github.com/MakazhanAlpamys/Soup.git
  6. inferssd

    AI repositories

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Indexed GitHub, wici-ai 1,025 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/wici-ai/inferssd.git
  7. atomic-agent

    AI repositories

    Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

    Stale GitHub, AtomicBot-ai 3,460 ★MITUpdated 20 days ago

    git clone https://github.com/AtomicBot-ai/atomic-agent.git
  8. TensorSharp

    AI repositories

    A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

    Stale GitHub, zhongkaifu 675 ★BSD-3-ClauseUpdated 5 days ago

    git clone https://github.com/zhongkaifu/TensorSharp.git
  9. ETOS-LLM-Studio

    AI repositories

    A native LLM client for iOS & Apple Watch. Run local GGUF models offline via llama.cpp, or connect to OpenAI/Claude/Gemini. Features local RAG, Model Context Protocol (MCP) tools, Siri Shortcuts, and cross-device sync. Built with Swift.

    Indexed GitHub, Eric-Terminal 220 ★GPL-3.0Updated 2 days ago

    git clone https://github.com/Eric-Terminal/ETOS-LLM-Studio.git
  10. Box

    AI repositories

    The most advanced, fully offline client-side AI suite on Android today.

    Indexed GitHub, jegly 1,013 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/jegly/Box.git
  11. unsloth

    AI repositories

    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

    Indexed GitHub, unslothai 79.6k ★Apache-2.0Updated yesterday

    git clone https://github.com/unslothai/unsloth.git
  12. yzma

    AI repositories

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    Stale GitHub, hybridgroup 652 ★Custom licence (see repository)Updated 33 days ago

    git clone https://github.com/hybridgroup/yzma.git
  13. mlx-serve

    AI repositories

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    Indexed GitHub, ddalcu 2,475 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/ddalcu/mlx-serve.git
  14. Atomic-Chat

    AI repositories

    Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

    Stale GitHub, AtomicBot-ai 1,808 ★Custom licence (see repository)Updated 31 days ago

    git clone https://github.com/AtomicBot-ai/Atomic-Chat.git
  15. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated yesterday

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  16. PS5LM

    AI repositories

    llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

    Stale GitHub, cobanov 673 ★GPL-3.0Updated 25 days ago

    git clone https://github.com/cobanov/PS5LM.git
  17. jev

    AI repositories

    jevos: an open-source alternative to Jev and Microsoft-Decision-1. Yes/no decisions, choices and scores with probabilities, on your laptop's CPU.

    Stale GitHub, feder-cr 1,342 ★MITUpdated 32 days ago

    git clone https://github.com/feder-cr/jev.git
  18. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated yesterday

    git clone https://github.com/prabanta-dev/janas.git
  19. PolyStrata

    AI repositories

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

    Stale GitHub, VecSzn 722 ★MITUpdated 17 days ago

    git clone https://github.com/VecSzn/PolyStrata.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.