Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
optimate
AI repositoriesA collection of libraries to optimise AI model performances
git clone https://github.com/nebuly-ai/optimate.git -
ray
AI repositoriesRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
git clone https://github.com/ray-project/ray.git -
pruna
AI repositoriesPruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
git clone https://github.com/PrunaAI/pruna.git -
openvino
AI repositoriesOpenVINO™ is an open source toolkit for optimizing and deploying AI inference
git clone https://github.com/openvinotoolkit/openvino.git -
metaflow
AI repositoriesBuild, Manage and Deploy AI/ML Systems
git clone https://github.com/Netflix/metaflow.git -
GenerativeAIExamples
AI repositoriesGenerative AI reference workflows optimized for accelerated infrastructure and microservice architecture.
git clone https://github.com/NVIDIA/GenerativeAIExamples.git -
llm-internals
AI repositoriesLearn LLM internals step by step - from tokenization to attention to inference optimization.
git clone https://github.com/amitshekhariitbhu/llm-internals.git -
ClawRouter
AI repositoriesThe agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402.
git clone https://github.com/BlockRunAI/ClawRouter.git -
BigMoeOnEdge
AI repositoriesRun MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.
git clone https://github.com/Helldez/BigMoeOnEdge.git -
nudgebee
AI repositoriesOpen-source agentic ops platform for cloud, SRE, DevOps, support and FinOps teams. AI agents investigate incidents, cut cloud and Kubernetes waste and run approval-gated runbooks across Kubernetes, AWS, Azure, GCP and your databases. Self-hosted, bring your own models.
git clone https://github.com/nudgebee/nudgebee.git -
intel-extension-for-transformers
AI repositories⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
git clone https://github.com/intel/intel-extension-for-transformers.git -
tensorzero
AI repositoriesTensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.
git clone https://github.com/tensorzero/tensorzero.git -
Chat2DB
AI repositoriesChat2DB is a free, cross-platform, local-first database client and SQL workspace for developers, DBAs, analysts, and data teams. Connect to 40+ databases, manage data, edit and run SQL, and use your own AI model to generate, explain, and optimize queries. Available on desktop, web, Docker, and CLI, with MCP support.
git clone https://github.com/OtterMind/Chat2DB.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.