InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. tiny-llm

    AI repositories

    learn LLM inference system on Apple Silicon for systems engineers: build a tiny vLLM + Qwen

    Stale GitHub, skyzh 5,680 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/skyzh/tiny-llm.git
  2. Llama-3.1-70B

    Models

    text generation model by meta-llama · transformers

    Stale Hugging Face Hub, meta-llama 444 ♥llama3.1Updated 2 years ago 1 note

    meta-llama/Llama-3.1-70B
  3. LLM-VM

    Agents & frameworks

    irresponsible innovation. Try now at https://chat.dev/

    Stale GitHub, anarchy-ai 492 ★MITUpdated 2 years ago

    git clone https://github.com/anarchy-ai/LLM-VM.git
  4. text generation model by Groq · transformers

    Stale Hugging Face Hub, Groq 319 ♥llama3Updated 2 years ago

    Groq/Llama-3-Groq-8B-Tool-Use
  5. llmgateway

    AI repositories

    Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

    Indexed GitHub, theopenco 1,743 ★Custom licence (see repository)Updated today

    git clone https://github.com/theopenco/llmgateway.git
  6. image to text model by numind · transformers

    Stale Hugging Face Hub, numind 497 ♥mitUpdated 5 months ago

    numind/NuMarkdown-8B-Thinking
  7. llm-price-compass

    Datasets & benchmarks

    This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider price comparison, gpu benchmarks to price per token calculation, gpu benchmark table

    Stale GitHub, arc53 221 ★MITUpdated 23 months ago

    git clone https://github.com/arc53/llm-price-compass.git
  8. text generation model by z-lab · transformers

    Stale Hugging Face Hub, z-lab 399 ♥mitUpdated 6 months ago

    z-lab/Qwen3.6-27B-DFlash
  9. text generation model by NousResearch · transformers

    Stale Hugging Face Hub, NousResearch 518 ♥llama3Updated 2 years ago

    NousResearch/Hermes-3-Llama-3.1-8B
  10. image text to text model by meta-llama · transformers

    Stale Hugging Face Hub, meta-llama 616 ♥llama3.2Updated 2 years ago 1 note

    meta-llama/Llama-3.2-11B-Vision
  11. sentence similarity model by sentence-transformers · sentence-transformers

    Stale Hugging Face Hub, sentence-transformers 551 ♥apache-2.0Updated 15 months ago

    sentence-transformers/paraphrase-multilingual-mpnet-base-v2
  12. s1-mini

    Models

    text generation model by superwhisper · transformers

    Stale Hugging Face Hub, superwhisper 378 ♥otherUpdated 2 months ago

    superwhisper/s1-mini
  13. nanocoder

    AI repositories

    An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.

    Indexed GitHub, Nano-Collective 2,573 ★Custom licence (see repository)Updated today

    git clone https://github.com/Nano-Collective/nanocoder.git
  14. plano

    AI repositories

    Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.

    Stale GitHub, katanemo 7,099 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/katanemo/plano.git
  15. transformers

    AI repositories

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    Indexed GitHub, huggingface 169.0k ★Apache-2.0Updated today

    git clone https://github.com/huggingface/transformers.git
  16. text generation model by NousResearch · transformers

    Stale Hugging Face Hub, NousResearch 456 ♥llama3Updated 2 years ago

    NousResearch/Hermes-2-Pro-Llama-3-8B
  17. chitu

    AI repositories

    High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.

    Stale GitHub, thu-pacman 2,998 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/thu-pacman/chitu.git
  18. sentence similarity model by Alibaba-NLP · sentence-transformers

    Stale Hugging Face Hub, Alibaba-NLP 387 ♥apache-2.0Updated 16 months ago

    Alibaba-NLP/gte-multilingual-base
  19. MNN

    AI repositories

    MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

    Indexed GitHub, alibaba 16.5k ★Apache-2.0Updated today

    git clone https://github.com/alibaba/MNN.git
  20. slotstream

    AI repositories

    Run a 105 GB AI model on a Mac that can't hold it. Qwen3.8-Flash-Next 4-bit, streamed from SSD on 16–64 GB Apple Silicon Macs. Fully native Swift, MLX and Metal. Offline, no Python. CLI, Swift library, and Ollama/OpenAI/Anthropic APIs. Works with Claude Code and Codex.

    Indexed GitHub, carloslfu 673 ★MITUpdated today

    git clone https://github.com/carloslfu/slotstream.git
  21. oneDNN

    AI repositories

    Open-source library of optimized deep learning operations (matmul, convolution, attention) for CPUs (x64, AArch64, RISC-V) and Intel GPUs. Used by PyTorch, TensorFlow, OpenVINO, and ONNX Runtime.

    Indexed GitHub, uxlfoundation 4,094 ★Apache-2.0Updated today

    git clone https://github.com/uxlfoundation/oneDNN.git
  22. bespoke_automata

    Tools & apps

    Bespoke Automata is a GUI and deployment pipline for making complex AI agents locally and offline

    Stale GitHub, C0deMunk33 223 ★GPL-3.0Updated 8 months ago

    git clone https://github.com/C0deMunk33/bespoke_automata.git
  23. text generation model by Edge0 · edge0

    Indexed Hugging Face Hub, Edge0 98 ♥otherUpdated yesterday

    Edge0/Edge0-145B-q3k
  24. modern-llm-notebook

    Docs & tutorials

    A hands-on course on modern LLM architectures, training, and inference, with step-by-step PyTorch implementations and runnable notebooks.

    Stale GitHub, walkinglabs 252 ★Custom licence (see repository)Updated 46 days ago

    git clone https://github.com/walkinglabs/modern-llm-notebook.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.