InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. optimate

    AI repositories

    A collection of libraries to optimise AI model performances

    Stale GitHub, nebuly-ai 8,328 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/nebuly-ai/optimate.git
  2. ray

    AI repositories

    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

    Indexed GitHub, ray-project 44.3k ★Apache-2.0Updated today

    git clone https://github.com/ray-project/ray.git
  3. pruna

    AI repositories

    Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.

    Stale GitHub, PrunaAI 1,365 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/PrunaAI/pruna.git
  4. openvino

    AI repositories

    OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

    Indexed GitHub, openvinotoolkit 11.2k ★Apache-2.0Updated today

    git clone https://github.com/openvinotoolkit/openvino.git
  5. metaflow

    AI repositories

    Build, Manage and Deploy AI/ML Systems

    Stale GitHub, Netflix 10.3k ★Apache-2.0Updated 7 days ago

    git clone https://github.com/Netflix/metaflow.git
  6. GenerativeAIExamples

    AI repositories

    Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

    Stale GitHub, NVIDIA 4,210 ★Apache-2.0Updated 2 months ago

    git clone https://github.com/NVIDIA/GenerativeAIExamples.git
  7. llm-internals

    AI repositories

    Learn LLM internals step by step - from tokenization to attention to inference optimization.

    Indexed GitHub, amitshekhariitbhu 1,773 ★Apache-2.0Updated today

    git clone https://github.com/amitshekhariitbhu/llm-internals.git
  8. ClawRouter

    AI repositories

    The agent-native LLM router for autonomous agents. Every frontier model behind one wallet, <1ms local routing, USDC payments on Base & Solana via x402.

    Stale GitHub, BlockRunAI 6,661 ★MITUpdated 6 days ago

    git clone https://github.com/BlockRunAI/ClawRouter.git
  9. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated today

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  10. nudgebee

    AI repositories

    Open-source agentic ops platform for cloud, SRE, DevOps, support and FinOps teams. AI agents investigate incidents, cut cloud and Kubernetes waste and run approval-gated runbooks across Kubernetes, AWS, Azure, GCP and your databases. Self-hosted, bring your own models.

    Stale GitHub, nudgebee 521 ★Custom licence (see repository)Updated 4 days ago

    git clone https://github.com/nudgebee/nudgebee.git
  11. ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

    Stale Archived GitHub, intel 2,169 ★Apache-2.0Updated 2 years ago 1 note

    git clone https://github.com/intel/intel-extension-for-transformers.git
  12. tensorzero

    AI repositories

    TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

    Stale Archived GitHub, tensorzero 11.7k ★Apache-2.0Updated 5 months ago 1 note

    git clone https://github.com/tensorzero/tensorzero.git
  13. Chat2DB

    AI repositories

    Chat2DB is a free, cross-platform, local-first database client and SQL workspace for developers, DBAs, analysts, and data teams. Connect to 40+ databases, manage data, edit and run SQL, and use your own AI model to generate, explain, and optimize queries. Available on desktop, web, Docker, and CLI, with MCP support.

    Stale GitHub, OtterMind 28.3k ★Custom licence (see repository)Updated 33 days ago

    git clone https://github.com/OtterMind/Chat2DB.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.