InnerVault

Library

85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

38 results with any of your words Clear search and filters
  1. janas

    AI repositories

    37 tok/s from Qwen3-Next-80B (48 GB) on a 32 GB laptop, 24 without drafts vs 2.8 for llama.cpp; reading 62 vs 16 tok/s. Faster than llama.cpp on all 13 models compared in Q4_K_M. LLMs bigger than your RAM, pure C, CPU or GPU.

    Indexed GitHub, prabanta-dev 717 ★GPL-3.0Updated yesterday

    git clone https://github.com/prabanta-dev/janas.git
  2. BigMoeOnEdge

    AI repositories

    Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming optimizer. Any hardware, any OS, any model, any quantization, behind a local OpenAI-compatible server.

    Indexed GitHub, Helldez 924 ★Apache-2.0Updated yesterday

    git clone https://github.com/Helldez/BigMoeOnEdge.git
  3. SeaGOAT

    AI repositories

    local-first semantic code search engine

    Stale GitHub, kantord 1,316 ★MITUpdated 16 days ago

    git clone https://github.com/kantord/SeaGOAT.git
  4. daily_stock_analysis

    AI repositories

    LLM 驱动的多市场股票智能分析系统:多源行情、实时新闻、决策看板与自动推送,支持零成本定时运行。 LLM-powered multi-market stock analysis system with multi-source market data, real-time news, decision dashboard, automated notifications, and cost-free scheduled runs.

    Indexed GitHub, ZhuLinsen 71.8k ★MITUpdated 3 days ago

    git clone https://github.com/ZhuLinsen/daily_stock_analysis.git
  5. AI+金融(量化):1.多因子股票量化框架开源教程 2.学界和业界的经典资料收录 3.AI + 金融的相关工作,包括LLM, Agent, benchmark(evaluation), etc.

    Indexed GitHub, Barca0412 1,883 ★MITUpdated 2 days ago

    git clone https://github.com/Barca0412/Introduction-to-Quantitative-Finance.git
  6. turbovec

    AI repositories

    A vector index built on TurboQuant, written in Rust with Python bindings

    Stale GitHub, RyanCodrai 17.4k ★MITUpdated 41 days ago

    git clone https://github.com/RyanCodrai/turbovec.git
  7. llmfit

    AI repositories

    Hundreds of models & providers. One command to find what runs on your hardware.

    Stale GitHub, AlexsJones 38.8k ★MITUpdated 8 days ago

    git clone https://github.com/AlexsJones/llmfit.git
  8. bitsandbytes

    AI repositories

    Accessible large language models via k-bit quantization for PyTorch.

    Stale GitHub, bitsandbytes-foundation 8,527 ★MITUpdated 2 months ago

    git clone https://github.com/bitsandbytes-foundation/bitsandbytes.git
  9. tick-stock-panel

    AI repositories

    TSP自托管、零运维的 A 股「自建策略 + 监控 + 回测」量化工作台 | LLM能力驱使策略定制+个股分析+复盘 | 自由接入第三方数据源与个性化扩展数据 | 个人开源

    Stale GitHub, shy3130 7,572 ★MITUpdated 6 days ago

    git clone https://github.com/shy3130/tick-stock-panel.git
  10. LlamaFactory

    AI repositories

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Indexed GitHub, hiyouga 76.1k ★Apache-2.0Updated yesterday

    git clone https://github.com/hiyouga/LlamaFactory.git
  11. engine

    AI repositories

    2bit quants, kernels and runtime for consumer devices.

    Stale GitHub, cactus-compute 6,181 ★Custom licence (see repository)Updated 12 days ago

    git clone https://github.com/cactus-compute/engine.git
  12. Chinese-LLaMA-Alpaca

    AI repositories

    中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

    Stale GitHub, ymcui 18.9k ★Apache-2.0Updated 7 months ago

    git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca.git
  13. nncf

    AI repositories

    Neural Network Compression Framework for enhanced OpenVINO™ inference

    Stale GitHub, openvinotoolkit 1,217 ★Apache-2.0Updated 13 days ago

    git clone https://github.com/openvinotoolkit/nncf.git
  14. handy-ollama

    AI repositories

    动手学Ollama,CPU玩转大模型部署,在线阅读地址:https://datawhalechina.github.io/handy-ollama/

    Stale GitHub, datawhalechina 2,543 ★Custom licence (see repository)Updated 10 months ago

    git clone https://github.com/datawhalechina/handy-ollama.git
  15. rag-time

    AI repositories

    RAG Time: A 5-week Learning Journey to Mastering RAG

    Stale GitHub, microsoft 911 ★MITUpdated 17 months ago

    git clone https://github.com/microsoft/rag-time.git
  16. AngelSlim

    AI repositories

    Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

    Stale GitHub, Tencent 1,779 ★Custom licence (see repository)Updated 17 days ago

    git clone https://github.com/Tencent/AngelSlim.git
  17. mojo-dllm

    AI repositories

    Local inference for diffusion language models (LLaDA, Dream), written in Mojo

    Stale GitHub, vladimirrott 506 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/vladimirrott/mojo-dllm.git
  18. Soup

    AI repositories

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    Stale GitHub, MakazhanAlpamys 10.3k ★Apache-2.0Updated 10 days ago

    git clone https://github.com/MakazhanAlpamys/Soup.git
  19. Your Cheat Sheet for AI Engineering Interview – Questions and Answers.

    Indexed GitHub, amitshekhariitbhu 3,659 ★Apache-2.0Updated yesterday

    git clone https://github.com/amitshekhariitbhu/ai-engineering-interview-questions.git
  20. picollm

    AI repositories

    On-device LLM Inference Powered by X-Bit Quantization

    Indexed GitHub, Picovoice 320 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/Picovoice/picollm.git
  21. inferssd

    AI repositories

    Run models larger than your RAM or VRAM by streaming MoE experts from SSD. Built on llama.cpp.

    Indexed GitHub, wici-ai 1,025 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/wici-ai/inferssd.git
  22. atomic-agent

    AI repositories

    Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp.

    Stale GitHub, AtomicBot-ai 3,460 ★MITUpdated 20 days ago

    git clone https://github.com/AtomicBot-ai/atomic-agent.git
  23. project-maya

    AI repositories

    Project Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.

    Stale GitHub, mw00 2,482 ★MITUpdated 13 days ago

    git clone https://github.com/mw00/project-maya.git
  24. TensorSharp

    AI repositories

    A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

    Stale GitHub, zhongkaifu 675 ★BSD-3-ClauseUpdated 5 days ago

    git clone https://github.com/zhongkaifu/TensorSharp.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.