SiliconScope
Sudoless Apple Silicon system monitor (native SwiftUI GUI) with ANE / Media Engine / memory-bandwidth tracking
Open the source (opens github.com) https://github.com/kennss/siliconscope
What it is
AI repositories from kennss.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/kennss/SiliconScope.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
inferssd
AI repositoriesRun models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
git clone https://github.com/wici-ai/inferssd.git -
ipex-llm
AI repositoriesAccelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.
git clone https://github.com/intel/ipex-llm.git -
janas
AI repositories37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
git clone https://github.com/prabanta-dev/janas.git -
omlx
AI repositoriesLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
git clone https://github.com/jundot/omlx.git -
vllm-metal
AI repositoriesCommunity maintained hardware plugin for vLLM on Apple Silicon
git clone https://github.com/vllm-project/vllm-metal.git -
Klee
AI repositoriesA native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift.
git clone https://github.com/signerlabs/Klee.git