InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

7 results with any of your words Clear search and filters
  1. turbo-fieldfare

    AI repositories

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    Stale GitHub, drumih 6,930 ★Apache-2.0Updated 33 days ago

    git clone https://github.com/drumih/turbo-fieldfare.git
  2. ai

    AI repositories

    On-device LLM execution in React Native with Vercel AI SDK compatibility

    Stale GitHub, callstackincubator 1,426 ★MITUpdated 17 days ago

    git clone https://github.com/callstackincubator/ai.git
  3. MNN

    AI repositories

    MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

    Indexed GitHub, alibaba 16.5k ★Apache-2.0Updated today

    git clone https://github.com/alibaba/MNN.git
  4. picollm

    AI repositories

    On-device LLM Inference Powered by X-Bit Quantization

    Indexed GitHub, Picovoice 320 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/Picovoice/picollm.git
  5. sentient-os

    AI repositories

    An on-device LLM understands your entire life, then proactively offers to get your work done through computer use.

    Stale GitHub, Sentient-OS-Labs 708 ★AGPL-3.0Updated 9 days ago

    git clone https://github.com/Sentient-OS-Labs/sentient-os.git
  6. localmind

    MCP servers

    A mobile application designed to provide a beautiful, fast, and privacy-respecting interface for on device LLM and local LLM servers and cloud providers

    Stale GitHub, abdulmominsakib 306 ★MITUpdated 10 days ago

    git clone https://github.com/abdulmominsakib/localmind.git
  7. apple-silicon-llm-bench

    Datasets & benchmarks

    Reproducible on-device LLM benchmarks for Apple Silicon (iPhone 17 Pro, M4 Max): Apple Core AI, MLX, llama.cpp, LiteRT-LM and Core ML on the same model and harness, every number with its quantization and capture session; hybrid Mamba-2 models (Nemotron-3 Nano, Granite-4.0-H, Falcon-H1) included.

    Indexed GitHub, john-rocky 73 ★MITUpdated today

    git clone https://github.com/john-rocky/apple-silicon-llm-bench.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.