InnerVault

picollm

IndexedGitHub, Picovoice

On-device LLM Inference Powered by X-Bit Quantization

Open the source (opens github.com) https://github.com/picovoice/picollm

What it is

AI repositories from Picovoice.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/Picovoice/picollm.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. litert-samples

    AI repositories

    LiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.

    Indexed GitHub, google-ai-edge 496 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/google-ai-edge/litert-samples.git
  2. intro_dgm

    AI repositories

    "Deep Generative Modeling": Introductory Examples

    Stale GitHub, jmtomczak 1,344 ★MITUpdated 6 months ago

    git clone https://github.com/jmtomczak/intro_dgm.git
  3. web-llm-chat

    AI repositories

    Chat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.

    Stale GitHub, mlc-ai 1,138 ★Apache-2.0Updated 14 days ago

    git clone https://github.com/mlc-ai/web-llm-chat.git
  4. repomix

    AI repositories

    📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

    Indexed GitHub, yamadashy 29.3k ★MITUpdated yesterday

    git clone https://github.com/yamadashy/repomix.git
  5. vllm

    AI repositories

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Indexed GitHub, vllm-project 97.0k ★Apache-2.0Updated today

    git clone https://github.com/vllm-project/vllm.git
  6. unsloth

    AI repositories

    Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

    Indexed GitHub, unslothai 79.6k ★Apache-2.0Updated today

    git clone https://github.com/unslothai/unsloth.git