InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. pegainfer

    AI repositories

    Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

    Stale GitHub, pegainfer-project 729 ★Apache-2.0Updated 19 days ago

    git clone https://github.com/pegainfer-project/pegainfer.git
  2. Indexed GitHub, R6410418 1,750 ★Apache-2.0Updated yesterday

    git clone https://github.com/R6410418/Jackrong-llm-finetuning-guide.git
  3. halogen-flash-server

    AI repositories

    Local inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.

    Stale GitHub, peonist-ai 1,258 ★Custom licence (see repository)Updated 9 days ago

    git clone https://github.com/peonist-ai/halogen-flash-server.git
  4. PS5LM

    AI repositories

    llama.cpp on a jailbroken PS5: run any GGUF model natively on the console, starting with Qwen 3.8

    Stale GitHub, cobanov 673 ★GPL-3.0Updated 25 days ago

    git clone https://github.com/cobanov/PS5LM.git
  5. ReMe

    AI repositories

    ReMe: Memory Management Kit for Agents - Remember Me, Refine Me.

    Indexed GitHub, agentscope-ai 3,809 ★Apache-2.0Updated yesterday

    git clone https://github.com/agentscope-ai/ReMe.git
  6. PyTorch-Tutorial-2nd

    AI repositories

    《Pytorch实用教程》(第二版)无论是零基础入门,还是CV、NLP、LLM项目应用,或是进阶工程化部署落地,在这里都有。相信在本书的帮助下,读者将能够轻松掌握 PyTorch 的使用,成为一名优秀的深度学习工程师。

    Stale GitHub, TingsongYu 4,628 ★Updated 40 days ago

    git clone https://github.com/TingsongYu/PyTorch-Tutorial-2nd.git
  7. dyad

    AI repositories

    Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it!

    Indexed GitHub, dyad-sh 22.3k ★Custom licence (see repository)Updated 2 days ago

    git clone https://github.com/dyad-sh/dyad.git
  8. UltraRAG

    AI repositories

    A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines

    Indexed GitHub, OpenBMB 5,743 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/OpenBMB/UltraRAG.git
  9. LLaVA-OneVision-2

    AI repositories

    Fully Open Framework for Democratized Multimodal Training

    Stale GitHub, EvolvingLMMs-Lab 1,232 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/EvolvingLMMs-Lab/LLaVA-OneVision-2.git
  10. deep-searcher

    AI repositories

    Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.

    Stale GitHub, zilliztech 8,330 ★Apache-2.0Updated 56 days ago

    git clone https://github.com/zilliztech/deep-searcher.git
  11. AngelSlim

    AI repositories

    Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

    Stale GitHub, Tencent 1,779 ★Custom licence (see repository)Updated 17 days ago

    git clone https://github.com/Tencent/AngelSlim.git
  12. document.ai

    AI repositories

    可溯源、带时效判断的企业知识库问答:每条结论标明出自哪份文档的哪个版本、哪一处,以及在目标时间是否有效(Traceable, version- and time-aware enterprise RAG)

    Indexed GitHub, GanymedeNil 3,658 ★AGPL-3.0Updated yesterday

    git clone https://github.com/GanymedeNil/document.ai.git
  13. awesome-LLM-resources

    AI repositories

    🧑🚀 全世界最好的LLM资料总结(多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型) | Summary of the world's best LLM resources.

    Indexed GitHub, WangRongsheng 9,083 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/WangRongsheng/awesome-LLM-resources.git
  14. Implementing LLM architectures from scratch in PyTorch

    Stale GitHub, YeonwooSung 856 ★BSD-3-ClauseUpdated 6 days ago

    git clone https://github.com/YeonwooSung/llm-architecture-from-scratch.git
  15. tokenspeed

    AI repositories

    TokenSpeed is a speed-of-light LLM inference engine.

    Indexed GitHub, lightseekorg 2,932 ★MITUpdated yesterday

    git clone https://github.com/lightseekorg/tokenspeed.git
  16. 9router

    AI repositories

    Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

    Stale GitHub, decolua 32.1k ★MITUpdated 8 days ago

    git clone https://github.com/decolua/9router.git
  17. gpustack

    AI repositories

    A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

    Indexed GitHub, gpustack 6,039 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/gpustack/gpustack.git
  18. FastGPT

    AI repositories

    FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

    Indexed GitHub, labring 30.0k ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/labring/FastGPT.git
  19. surogate

    AI repositories

    Train and serve LLMs at extreme speed and massive throughput.

    Stale GitHub, invergent-ai 885 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/invergent-ai/surogate.git
  20. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated yesterday

    git clone https://github.com/carloslfu/slotstream.git
  21. VLMEvalKit

    AI repositories

    Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

    Indexed GitHub, open-compass 4,487 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/open-compass/VLMEvalKit.git
  22. DeepAnalyze

    AI repositories

    DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师,自动分析大量数据,一键生成专业分析报告!

    Stale GitHub, ruc-datalab 4,713 ★MITUpdated 35 days ago

    git clone https://github.com/ruc-datalab/DeepAnalyze.git
  23. forgecode

    AI repositories

    AI enabled pair programmer for Claude, GPT, O Series, Grok, Deepseek, Gemini and 300+ models

    Stale GitHub, tailcallhq 7,637 ★Apache-2.0Updated 17 days ago

    git clone https://github.com/tailcallhq/forgecode.git
  24. PolyStrata

    AI repositories

    Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

    Stale GitHub, VecSzn 722 ★MITUpdated 17 days ago

    git clone https://github.com/VecSzn/PolyStrata.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.