Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
janas
AI repositories37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.
git clone https://github.com/prabanta-dev/janas.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
SeaGOAT
AI repositorieslocal-first semantic code search engine
git clone https://github.com/kantord/SeaGOAT.git -
daily_stock_analysis
AI repositoriesLLM 驱动的多市场股票智能分析系统:多源行情、实时新闻、决策看板与自动推送,支持零成本定时运行。 LLM-powered multi-market stock analysis system with multi-source market data, real-time news, decision dashboard, automated notifications, and cost-free scheduled runs.
git clone https://github.com/ZhuLinsen/daily_stock_analysis.git -
Introduction-to-Quantitative-Finance
AI repositoriesAI+金融(量化):1.多因子股票量化框架开源教程 2.学界和业界的经典资料收录 3.AI + 金融的相关工作,包括LLM, Agent, benchmark(evaluation), etc.
git clone https://github.com/Barca0412/Introduction-to-Quantitative-Finance.git -
turbovec
AI repositoriesA vector index built on TurboQuant, written in Rust with Python bindings
git clone https://github.com/RyanCodrai/turbovec.git -
llmfit
AI repositoriesHundreds of models & providers. One command to find what runs on your hardware.
git clone https://github.com/AlexsJones/llmfit.git -
bitsandbytes
AI repositoriesAccessible large language models via k-bit quantization for PyTorch.
git clone https://github.com/bitsandbytes-foundation/bitsandbytes.git -
tick-stock-panel
AI repositoriesTSP自托管、零运维的 A 股「自建策略 + 监控 + 回测」量化工作台 | LLM能力驱使策略定制+个股分析+复盘 | 自由接入第三方数据源与个性化扩展数据 | 个人开源
git clone https://github.com/shy3130/tick-stock-panel.git -
LlamaFactory
AI repositoriesUnified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
git clone https://github.com/hiyouga/LlamaFactory.git -
engine
AI repositories2bit quants, kernels and runtime for consumer devices.
git clone https://github.com/cactus-compute/engine.git -
Chinese-LLaMA-Alpaca
AI repositories中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)
git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca.git -
nncf
AI repositoriesNeural Network Compression Framework for enhanced OpenVINO™ inference
git clone https://github.com/openvinotoolkit/nncf.git -
handy-ollama
AI repositories动手学Ollama,CPU玩转大模型部署,在线阅读地址:https://datawhalechina.github.io/handy-ollama/
git clone https://github.com/datawhalechina/handy-ollama.git -
rag-time
AI repositoriesRAG Time: A 5-week Learning Journey to Mastering RAG
git clone https://github.com/microsoft/rag-time.git -
AngelSlim
AI repositoriesModel compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
git clone https://github.com/Tencent/AngelSlim.git -
mojo-dllm
AI repositoriesLocal inference for diffusion language models (LLaDA, Dream), written in Mojo
git clone https://github.com/vladimirrott/mojo-dllm.git -
Soup
AI repositoriesFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
git clone https://github.com/MakazhanAlpamys/Soup.git -
ai-engineering-interview-questions
AI repositoriesYour Cheat Sheet for AI Engineering Interview – Questions and Answers.
git clone https://github.com/amitshekhariitbhu/ai-engineering-interview-questions.git -
picollm
AI repositoriesOn-device LLM Inference Powered by X-Bit Quantization
git clone https://github.com/Picovoice/picollm.git -
inferssd
AI repositoriesRun models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.
git clone https://github.com/wici-ai/inferssd.git -
atomic-agent
AI repositoriesAtomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.
git clone https://github.com/AtomicBot-ai/atomic-agent.git -
project-maya
AI repositoriesProject Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
git clone https://github.com/mw00/project-maya.git -
TensorSharp
AI repositoriesA native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability
git clone https://github.com/zhongkaifu/TensorSharp.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.