Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
kvcached
AI repositoriesVirtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
git clone https://github.com/ovg-project/kvcached.git -
sglang
AI repositoriesSGLang is a high-performance serving framework for large language models and multimodal models.
git clone https://github.com/sgl-project/sglang.git -
mistral.rs
AI repositoriesFast, flexible LLM inference
git clone https://github.com/EricLBuehler/mistral.rs.git -
lmdeploy
AI repositoriesLMDeploy is a toolkit for compressing, deploying, and serving LLMs.
git clone https://github.com/InternLM/lmdeploy.git -
Qwen2.5-7B-Instruct
Modelstext generation model by Qwen · transformers
Qwen/Qwen2.5-7B-Instruct -
falcon-40b
Modelstext generation model by tiiuae · transformers
tiiuae/falcon-40b -
reef
AI repositoriesInfrastructure for continually self‑improving agents
git clone https://github.com/Human-Agent-Society/reef.git -
Mistral-7B-Instruct-v0.2
Modelstext generation model by mistralai · transformers
mistralai/Mistral-7B-Instruct-v0.2 -
DeepSeek-V3-0324
Modelstext generation model by deepseek-ai · transformers
deepseek-ai/DeepSeek-V3-0324 -
Flide
Agents & frameworks🔥🔥 The extremely fast inference engine for decision model
git clone https://github.com/OmniJev/Flide.git -
all-MiniLM-L6-v2
Modelssentence similarity model by sentence-transformers · sentence-transformers
sentence-transformers/all-MiniLM-L6-v2 -
Llama-3.1-8B-Instruct
Modelstext generation model by meta-llama · transformers
meta-llama/Llama-3.1-8B-Instruct -
TinyLlama-1.1B-Chat-v1.0
Modelstext generation model by TinyLlama · transformers
TinyLlama/TinyLlama-1.1B-Chat-v1.0 -
embeddinggemma-300m
Modelssentence similarity model by google · sentence-transformers
google/embeddinggemma-300m -
pooled
AI repositoriesPeer-to-peer LLM inference in the browser: pool your devices to run big open models, for chat and coding agents.
git clone https://github.com/Nehanth/pooled.git -
gemma-2-2b-it
Modelstext generation model by google · transformers
google/gemma-2-2b-it -
gemma-2b
Modelstext generation model by google · transformers
google/gemma-2b -
QwQ-32B-Preview
Modelstext generation model by Qwen · transformers
Qwen/QwQ-32B-Preview -
StableBeluga2
Modelstext generation model by stabilityai · transformers
stabilityai/StableBeluga2 -
Reflection-Llama-3.1-70B
Modelstext generation model by mattshumer · transformers
mattshumer/Reflection-Llama-3.1-70B -
Llama-2-7b-hf
Modelstext generation model by meta-llama · transformers
meta-llama/Llama-2-7b-hf -
optillm
PromptsOptimizing inference proxy for LLMs
git clone https://github.com/algorithmicsuperintelligence/optillm.git -
phi-4
Modelstext generation model by microsoft · transformers
microsoft/phi-4 -
phi-1_5
Modelstext generation model by microsoft · transformers
microsoft/phi-1_5
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.