Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git -
Jackrong-llm-finetuning-guide
AI repositoriesgit clone https://github.com/R6410418/Jackrong-llm-finetuning-guide.git -
halogen-flash-server
AI repositoriesLocal inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
git clone https://github.com/peonist-ai/halogen-flash-server.git -
PS5LM
AI repositoriesllama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8
git clone https://github.com/cobanov/PS5LM.git -
ReMe
AI repositoriesReMe: Memory Management Kit for Agents - Remember Me, Refine Me.
git clone https://github.com/agentscope-ai/ReMe.git -
PyTorch-Tutorial-2nd
AI repositories《Pytorch实用教程》(第二版)无论是零基础入门,还是CV、NLP、LLM项目应用,或是进阶工程化部署落地,在这里都有。相信在本书的帮助下,读者将能够轻松掌握 PyTorch 的使用,成为一名优秀的深度学习工程师。
git clone https://github.com/TingsongYu/PyTorch-Tutorial-2nd.git -
dyad
AI repositoriesLocal, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!
git clone https://github.com/dyad-sh/dyad.git -
UltraRAG
AI repositoriesA Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
git clone https://github.com/OpenBMB/UltraRAG.git -
LLaVA-OneVision-2
AI repositoriesFully Open Framework for Democratized Multimodal Training
git clone https://github.com/EvolvingLMMs-Lab/LLaVA-OneVision-2.git -
deep-searcher
AI repositoriesOpen Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
git clone https://github.com/zilliztech/deep-searcher.git -
AngelSlim
AI repositoriesModel compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
git clone https://github.com/Tencent/AngelSlim.git -
document.ai
AI repositories可溯源、带时效判断的企业知识库问答:每条结论标明出自哪份文档的哪个版本、哪一处,以及在目标时间是否有效(Traceable, version- and time-aware enterprise RAG)
git clone https://github.com/GanymedeNil/document.ai.git -
awesome-LLM-resources
AI repositories🧑🚀 全世界最好的LLM资料总结(多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型) | Summary of the world's best LLM resources.
git clone https://github.com/WangRongsheng/awesome-LLM-resources.git -
llm-architecture-from-scratch
AI repositoriesImplementing LLM architectures from scratch in PyTorch
git clone https://github.com/YeonwooSung/llm-architecture-from-scratch.git -
tokenspeed
AI repositoriesTokenSpeed is a speed-of-light LLM inference engine.
git clone https://github.com/lightseekorg/tokenspeed.git -
9router
AI repositoriesUnlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
git clone https://github.com/decolua/9router.git -
gpustack
AI repositoriesA GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
git clone https://github.com/gpustack/gpustack.git -
FastGPT
AI repositoriesFastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.
git clone https://github.com/labring/FastGPT.git -
surogate
AI repositoriesTrain and serve LLMs at extreme speed and massive throughput.
git clone https://github.com/invergent-ai/surogate.git -
slotstream
AI repositoriesRun a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
git clone https://github.com/carloslfu/slotstream.git -
VLMEvalKit
AI repositoriesOpen-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
git clone https://github.com/open-compass/VLMEvalKit.git -
DeepAnalyze
AI repositoriesDeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师,自动分析大量数据,一键生成专业分析报告!
git clone https://github.com/ruc-datalab/DeepAnalyze.git -
forgecode
AI repositoriesAI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models
git clone https://github.com/tailcallhq/forgecode.git -
PolyStrata
AI repositoriesRun large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.
git clone https://github.com/VecSzn/PolyStrata.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.