InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. kvcached

    AI repositories

    Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

    Stale GitHub, ovg-project 2,033 ★Apache-2.0Updated 8 days ago

    git clone https://github.com/ovg-project/kvcached.git
  2. sglang

    AI repositories

    SGLang is a high-performance serving framework for large language models and multimodal models.

    Indexed GitHub, sgl-project 38.9k ★Apache-2.0Updated today

    git clone https://github.com/sgl-project/sglang.git
  3. mistral.rs

    AI repositories

    Fast, flexible LLM inference

    Stale GitHub, EricLBuehler 7,821 ★MITUpdated 7 days ago

    git clone https://github.com/EricLBuehler/mistral.rs.git
  4. lmdeploy

    AI repositories

    LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

    Stale GitHub, InternLM 8,136 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/InternLM/lmdeploy.git
  5. text generation model by Qwen · transformers

    Indexed Hugging Face Hub, Qwen 2,498 ♥apache-2.0Updated 22 months ago

    Qwen/Qwen2.5-7B-Instruct
  6. falcon-40b

    Models

    text generation model by tiiuae · transformers

    Indexed Hugging Face Hub, tiiuae 2,450 ♥apache-2.0Updated 2 years ago

    tiiuae/falcon-40b
  7. reef

    AI repositories

    Infrastructure for continually self‑improving agents

    Indexed GitHub, Human-Agent-Society 7,823 ★Apache-2.0Updated yesterday

    git clone https://github.com/Human-Agent-Society/reef.git
  8. text generation model by mistralai · transformers

    Indexed Hugging Face Hub, mistralai 3,281 ♥apache-2.0Updated 16 months ago

    mistralai/Mistral-7B-Instruct-v0.2
  9. text generation model by deepseek-ai · transformers

    Indexed Hugging Face Hub, deepseek-ai 3,223 ♥mitUpdated 19 months ago

    deepseek-ai/DeepSeek-V3-0324
  10. Flide

    Agents & frameworks

    🔥🔥 The extremely fast inference engine for decision model

    Stale GitHub, OmniJev 396 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/OmniJev/Flide.git
  11. sentence similarity model by sentence-transformers · sentence-transformers

    Indexed Hugging Face Hub, sentence-transformers 6,135 ♥apache-2.0Updated 5 months ago

    sentence-transformers/all-MiniLM-L6-v2
  12. text generation model by meta-llama · transformers

    Indexed Hugging Face Hub, meta-llama 8,957 ♥llama3.1Updated 2 years ago 1 note

    meta-llama/Llama-3.1-8B-Instruct
  13. text generation model by TinyLlama · transformers

    Indexed Hugging Face Hub, TinyLlama 1,913 ♥apache-2.0Updated 2 years ago

    TinyLlama/TinyLlama-1.1B-Chat-v1.0
  14. sentence similarity model by google · sentence-transformers

    Indexed Hugging Face Hub, google 2,123 ♥gemmaUpdated 13 months ago 1 note

    google/embeddinggemma-300m
  15. pooled

    AI repositories

    Peer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.

    Stale GitHub, Nehanth 589 ★MITUpdated 31 days ago

    git clone https://github.com/Nehanth/pooled.git
  16. gemma-2-2b-it

    Models

    text generation model by google · transformers

    Indexed Hugging Face Hub, google 1,617 ♥gemmaUpdated 2 years ago 1 note

    google/gemma-2-2b-it
  17. gemma-2b

    Models

    text generation model by google · transformers

    Stale Hugging Face Hub, google 1,265 ♥gemmaUpdated 2 years ago 1 note

    google/gemma-2b
  18. text generation model by Qwen · transformers

    Indexed Hugging Face Hub, Qwen 1,746 ♥apache-2.0Updated 22 months ago

    Qwen/QwQ-32B-Preview
  19. StableBeluga2

    Models

    text generation model by stabilityai · transformers

    Stale Hugging Face Hub, stabilityai 885 ♥Updated 3 years ago

    stabilityai/StableBeluga2
  20. text generation model by mattshumer · transformers

    Indexed Hugging Face Hub, mattshumer 1,719 ♥llama3.1Updated 2 years ago

    mattshumer/Reflection-Llama-3.1-70B
  21. Llama-2-7b-hf

    Models

    text generation model by meta-llama · transformers

    Indexed Hugging Face Hub, meta-llama 2,520 ♥llama2Updated 2 years ago 1 note

    meta-llama/Llama-2-7b-hf
  22. optillm

    Prompts

    Optimizing inference proxy for LLMs

    Stale GitHub, algorithmicsuperintelligence 4,337 ★Apache-2.0Updated 14 days ago

    git clone https://github.com/algorithmicsuperintelligence/optillm.git
  23. phi-4

    Models

    text generation model by microsoft · transformers

    Indexed Hugging Face Hub, microsoft 2,346 ♥mitUpdated 4 months ago

    microsoft/phi-4
  24. phi-1_5

    Models

    text generation model by microsoft · transformers

    Indexed Hugging Face Hub, microsoft 1,372 ♥mitUpdated 11 months ago

    microsoft/phi-1_5

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.