Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
llmgateway
AI repositoriesRoute, manage, and analyze your LLM requests across multiple providers with a unified API interface.
git clone https://github.com/theopenco/llmgateway.git -
nanocoder
AI repositoriesAn open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.
git clone https://github.com/Nano-Collective/nanocoder.git -
plano
AI repositoriesPlano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
git clone https://github.com/katanemo/plano.git -
transformers
AI repositories🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
git clone https://github.com/huggingface/transformers.git -
chitu
AI repositoriesHigh-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
git clone https://github.com/thu-pacman/chitu.git -
MNN
AI repositoriesMNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.
git clone https://github.com/alibaba/MNN.git -
slotstream
AI repositoriesRun a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.
git clone https://github.com/carloslfu/slotstream.git -
oneDNN
AI repositoriesOpen-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.
git clone https://github.com/uxlfoundation/oneDNN.git -
ecologits
AI repositories🌱 EcoLogits tracks the energy consumption and environmental footprint of using generative AI models through APIs.
git clone https://github.com/mlco2/ecologits.git -
neuron-ai
AI repositoriesThe Agentic Framework of the PHP ecosystem to build production-ready AI driven applications. Connect components (LLMs, Tools, vector DBs, memory) to agents that interact with your data and UI.
git clone https://github.com/neuron-core/neuron-ai.git -
LLM-TPU
AI repositoriesRun generative AI models in sophgo BM1684X/BM1688
git clone https://github.com/sophgo/LLM-TPU.git -
aikit
AI repositories🏗️ Fine-tune, build, and deploy open-source LLMs easily!
git clone https://github.com/kaito-project/aikit.git -
openlake
AI repositoriesOpenLake is a high performance storage engine for efficient LLM inference and GPU Training
git clone https://github.com/openlake-project/openlake.git -
LLaSA_training
AI repositoriesLLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis
git clone https://github.com/zhenye234/LLaSA_training.git -
Llamatik
AI repositoriesTrue on-device AI SDK for Kotlin Multiplatform (Android, iOS, Desktop, JVM, WASM). LLM inference, Speech-to-Text, Image Generation, Agent Framework and RAG — powered by llama.cpp, whisper.cpp and stable-diffusion.cpp.
git clone https://github.com/llamatik/Llamatik.git -
deepreasoning
AI repositoriesA high-performance LLM inference API and Chat UI that integrates DeepSeek R1's CoT reasoning traces with Anthropic Claude models.
git clone https://github.com/winfunc/deepreasoning.git -
distrifuser
AI repositories[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
git clone https://github.com/mit-han-lab/distrifuser.git -
LightLLM
AI repositoriesLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
git clone https://github.com/ModelTC/LightLLM.git -
tokenspeed
AI repositoriesTokenSpeed is a speed-of-light LLM inference engine.
git clone https://github.com/lightseekorg/tokenspeed.git -
llm-internals
AI repositoriesLearn LLM internals step by step - from tokenization to attention to inference optimization.
git clone https://github.com/amitshekhariitbhu/llm-internals.git -
awesome-ai-web-search
AI repositoriesList of software that allows searching the web with the assistance of AI: https://hf.co/spaces/felladrin/awesome-ai-web-search
git clone https://github.com/felladrin/awesome-ai-web-search.git -
csghub
AI repositoriesCSGHub is a brand-new open-source platform for managing LLMs, developed by the OpenCSG team. It offers both open-source and on-premise/SaaS solutions, with features comparable to Hugging Face. Gain full control over the lifecycle of LLMs, datasets, and agents, with Python SDK compatibility with Hugging Face. Join us! ⭐️
git clone https://github.com/OpenCSGs/csghub.git -
MiniSearch
AI repositoriesMinimalist web-searching platform with an AI assistant that runs directly from your browser. Demo: https://felladrin-minisearch.hf.space
git clone https://github.com/felladrin/MiniSearch.git -
ome
AI repositoriesOpen Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
git clone https://github.com/ome-projects/ome.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.