InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. llmgateway

    AI repositories

    Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

    Indexed GitHub, theopenco 1,743 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/theopenco/llmgateway.git
  2. nanocoder

    AI repositories

    An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.

    Indexed GitHub, Nano-Collective 2,573 ★Custom licence (see repository)Updated yesterday

    git clone https://github.com/Nano-Collective/nanocoder.git
  3. plano

    AI repositories

    Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

    Stale GitHub, katanemo 7,099 ★Apache-2.0Updated 24 days ago

    git clone https://github.com/katanemo/plano.git
  4. transformers

    AI repositories

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    Indexed GitHub, huggingface 169.0k ★Apache-2.0Updated yesterday

    git clone https://github.com/huggingface/transformers.git
  5. chitu

    AI repositories

    High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    Stale GitHub, thu-pacman 2,998 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/thu-pacman/chitu.git
  6. MNN

    AI repositories

    MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

    Indexed GitHub, alibaba 16.5k ★Apache-2.0Updated yesterday

    git clone https://github.com/alibaba/MNN.git
  7. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated yesterday

    git clone https://github.com/carloslfu/slotstream.git
  8. oneDNN

    AI repositories

    Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

    Indexed GitHub, uxlfoundation 4,094 ★Apache-2.0Updated yesterday

    git clone https://github.com/uxlfoundation/oneDNN.git
  9. ecologits

    AI repositories

    🌱 EcoLogits tracks the energy consumption and environmental footprint of using generative AI models through APIs.

    Stale GitHub, mlco2 354 ★MPL-2.0Updated 22 days ago

    git clone https://github.com/mlco2/ecologits.git
  10. neuron-ai

    AI repositories

    The Agentic Framework of the PHP ecosystem to build production-ready AI driven applications. Connect components (LLMs, Tools, vector DBs, memory) to agents that interact with your data and UI.

    Stale GitHub, neuron-core 2,162 ★MITUpdated 18 days ago

    git clone https://github.com/neuron-core/neuron-ai.git
  11. LLM-TPU

    AI repositories

    Run generative AI models in sophgo BM1684X/BM1688

    Stale GitHub, sophgo 321 ★Custom licence (see repository)Updated 8 days ago

    git clone https://github.com/sophgo/LLM-TPU.git
  12. aikit

    AI repositories

    🏗️ Fine-tune, build, and deploy open-source LLMs easily!

    Indexed GitHub, kaito-project 544 ★MITUpdated 3 days ago

    git clone https://github.com/kaito-project/aikit.git
  13. openlake

    AI repositories

    OpenLake is a high performance storage engine for efficient LLM inference and GPU Training

    Stale GitHub, openlake-project 2,851 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/openlake-project/openlake.git
  14. LLaSA_training

    AI repositories

    LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis

    Stale GitHub, zhenye234 658 ★Custom licence (see repository)Updated 7 days ago

    git clone https://github.com/zhenye234/LLaSA_training.git
  15. Llamatik

    AI repositories

    True on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.

    Indexed GitHub, llamatik 220 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/llamatik/Llamatik.git
  16. deepreasoning

    AI repositories

    A high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.

    Stale GitHub, winfunc 5,355 ★MITUpdated 13 months ago

    git clone https://github.com/winfunc/deepreasoning.git
  17. distrifuser

    AI repositories

    [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

    Stale GitHub, mit-han-lab 732 ★MITUpdated 23 months ago

    git clone https://github.com/mit-han-lab/distrifuser.git
  18. LightLLM

    AI repositories

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    Indexed GitHub, ModelTC 4,362 ★Apache-2.0Updated yesterday

    git clone https://github.com/ModelTC/LightLLM.git
  19. tokenspeed

    AI repositories

    TokenSpeed is a speed-of-light LLM inference engine.

    Indexed GitHub, lightseekorg 2,932 ★MITUpdated yesterday

    git clone https://github.com/lightseekorg/tokenspeed.git
  20. llm-internals

    AI repositories

    Learn LLM internals step by step - from tokenization to attention to inference optimization.

    Indexed GitHub, amitshekhariitbhu 1,773 ★Apache-2.0Updated yesterday

    git clone https://github.com/amitshekhariitbhu/llm-internals.git
  21. awesome-ai-web-search

    AI repositories

    List of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search

    Stale GitHub, felladrin 1,506 ★CC0-1.0Updated 11 days ago

    git clone https://github.com/felladrin/awesome-ai-web-search.git
  22. csghub

    AI repositories

    CSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It offers both open-source and on-premise/SaaS solutions, with features comparable to Hugging Face. Gain full control over the lifecycle of LLMs, datasets, and agents, with Python SDK compatibility with Hugging Face. Join us! ⭐️

    Stale GitHub, OpenCSGs 4,079 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/OpenCSGs/csghub.git
  23. MiniSearch

    AI repositories

    Minimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space

    Indexed GitHub, felladrin 609 ★Apache-2.0Updated yesterday

    git clone https://github.com/felladrin/MiniSearch.git
  24. ome

    AI repositories

    Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

    Stale GitHub, ome-projects 523 ★Apache-2.0Updated 14 days ago

    git clone https://github.com/ome-projects/ome.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.