Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
GLM5.3-Flash-E192-DGX-Spark
Modelsimage text to text model by autotrust · vllm
autotrust/GLM5.3-Flash-E192-DGX-Spark -
ARC-1.0
Modelstext classification model by rayline-ai · vllm
rayline-ai/ARC-1.0 -
hass_local_openai_llm
Agents & frameworksHome Assistant LLM integration for local OpenAI-compatible services (llamacpp, vllm, etc)
git clone https://github.com/skye-harris/hass_local_openai_llm.git -
Qwen-Sharp-Chat-Templates
Modelsmodel by peculiar-ragdoll · mlx
peculiar-ragdoll/Qwen-Sharp-Chat-Templates -
OvisOCR2
Modelsimage text to text model by ATH-MaaS · transformers
ATH-MaaS/OvisOCR2 -
Devstral-Small-2507
Modelsmodel by mistralai · mistral-common
mistralai/Devstral-Small-2507 -
ome
AI repositoriesOpen Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton
git clone https://github.com/ome-projects/ome.git -
Qwen3.8-27B-Uncensored-FP8
Modelsimage text to text model by orcarouter · transformers
orcarouter/Qwen3.8-27B-Uncensored-FP8 -
GLM5.3-Flash-E256-DGX-Spark
Modelsimage text to text model by autotrust · vllm
autotrust/GLM5.3-Flash-E256-DGX-Spark -
Qwen3.8-27B-DFlash2
Modelstext generation model by z-lab · transformers
z-lab/Qwen3.8-27B-DFlash2 -
kvcached
AI repositoriesVirtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
git clone https://github.com/ovg-project/kvcached.git -
FunASR
MCP serversOpen-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenAI-compatible/MCP serving.
git clone https://github.com/modelscope/FunASR.git -
d3
Modelszero shot classification model by vllm-sr · transformers
vllm-sr/d3 -
BricksLLM
AI repositories🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
git clone https://github.com/bricks-cloud/BricksLLM.git -
Kimi-K3.1-Pro-pruned75
Modelsimage text to text model by vllm-project · transformers
vllm-project/Kimi-K3.1-Pro-pruned75 -
llama-cookbook
AI repositoriesWelcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
git clone https://github.com/meta-llama/llama-cookbook.git -
TinyLLM
AI repositoriesSetup and run a local LLM and Chatbot using consumer grade hardware.
git clone https://github.com/jasonacox/TinyLLM.git -
automatic speech recognition model by mistralai · vllm
mistralai/Voxtral-Mini-4B-Realtime-Arabic -
One-Eval
Datasets & benchmarksAutomated system for LLM evaluation via agents. Doc as below:
git clone https://github.com/OpenDCAI/One-Eval.git -
smg
AI repositoriesEngine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
git clone https://github.com/smg-project/smg.git -
image text to text model by LibertAIDAI · vllm
LibertAIDAI/DeepSeek-V4.1-Flash-1017-NVFP4 -
jina-embeddings-v4
Modelsvisual document retrieval model by jinaai · transformers
jinaai/jina-embeddings-v4 -
text generation model by NousResearch · transformers
NousResearch/DeepHermes-3-Llama-3-8B-Preview -
ramalama
AI repositoriesRamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.
git clone https://github.com/containers/ramalama.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.