InnerVault

BigMoeOnEdge

IndexedGitHub, Helldez

Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

Open the source (opens github.com) https://github.com/helldez/bigmoeonedge

What it is

AI repositories from Helldez.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/Helldez/BigMoeOnEdge.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. flutter_edge_ai

    AI repositories

    On-device AI for Flutter — Gemma and other LLMs, multimodal, function calling, embeddings, RAG and speech on Android, iOS, Web, macOS, Windows and Linux.

    Indexed GitHub, DenisovAV 665 ★MITUpdated today

    git clone https://github.com/DenisovAV/flutter_edge_ai.git
  2. litert-samples

    AI repositories

    LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.

    Indexed GitHub, google-ai-edge 496 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/google-ai-edge/litert-samples.git
  3. Llamatik

    AI repositories

    True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

    Indexed GitHub, llamatik 220 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/llamatik/Llamatik.git
  4. engine

    AI repositories

    2bit quants, kernels and runtime for consumer devices.

    Stale GitHub, cactus-compute 6,181 ★Custom licence (see repository)Updated 11 days ago

    git clone https://github.com/cactus-compute/engine.git
  5. llama.rn

    AI repositories

    React Native binding of llama.cpp

    Stale GitHub, mybigday 1,073 ★MITUpdated 4 days ago

    git clone https://github.com/mybigday/llama.rn.git
  6. LLM-Hub

    AI repositories

    Local LLM, image&video&music generator

    Indexed GitHub, timmyy123 646 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/timmyy123/LLM-Hub.git