picollm
On-device LLM Inference Powered by X-Bit Quantization
Open the source (opens github.com) https://github.com/picovoice/picollm
What it is
AI repositories from Picovoice.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/Picovoice/picollm.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
litert-samples
AI repositoriesLiteRT and LiteRT-LM sample apps, model recipes, agent skills and utilities.
git clone https://github.com/google-ai-edge/litert-samples.git -
intro_dgm
AI repositories"Deep Generative Modeling": Introductory Examples
git clone https://github.com/jmtomczak/intro_dgm.git -
web-llm-chat
AI repositoriesChat with AI large language models running natively in your browser. Enjoy private, server-free, seamless AI conversations.
git clone https://github.com/mlc-ai/web-llm-chat.git -
repomix
AI repositories📦 Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.
git clone https://github.com/yamadashy/repomix.git -
vllm
AI repositoriesA high-throughput and memory-efficient inference and serving engine for LLMs
git clone https://github.com/vllm-project/vllm.git -
unsloth
AI repositoriesLocal UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.
git clone https://github.com/unslothai/unsloth.git