InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 13 days ago

    git clone https://github.com/mw00/project-maya.git
  2. pooled

    AI repositories

    Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

    Stale GitHub, Nehanth 589 ★MITUpdated 32 days ago

    git clone https://github.com/Nehanth/pooled.git
  3. SwiftLM

    AI repositories

    ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.

    Indexed GitHub, SharpAI 799 ★MITUpdated yesterday

    git clone https://github.com/SharpAI/SwiftLM.git
  4. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated yesterday

    git clone https://github.com/carloslfu/slotstream.git
  5. mlx-serve

    AI repositories

    Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.

    Indexed GitHub, ddalcu 2,475 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/ddalcu/mlx-serve.git
  6. ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

    Stale Archived GitHub, intel 2,169 ★Apache-2.0Updated 2 years ago 1 note

    git clone https://github.com/intel/intel-extension-for-transformers.git
  7. vllm-mlx

    AI repositories

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

    Stale GitHub, waybarrios 1,646 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/waybarrios/vllm-mlx.git
  8. TensorSharp

    AI repositories

    A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

    Stale GitHub, zhongkaifu 675 ★BSD-3-ClauseUpdated 5 days ago

    git clone https://github.com/zhongkaifu/TensorSharp.git
  9. Llamatik

    AI repositories

    True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

    Indexed GitHub, llamatik 220 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/llamatik/Llamatik.git
  10. ipex-llm

    AI repositories

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Stale Archived GitHub, intel 8,846 ★Apache-2.0Updated 9 months ago 1 note

    git clone https://github.com/intel/ipex-llm.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.