InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. Bonsai-demo

    AI repositories

    Bonsai Demo

    Stale GitHub, PrismML-Eng 3,485 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/PrismML-Eng/Bonsai-demo.git
  2. jan

    AI repositories

    Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

    Indexed GitHub, janhq 45.7k ★Custom licence (see repository)Updated today

    git clone https://github.com/janhq/jan.git
  3. wllama

    AI repositories

    WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

    Stale GitHub, ngxson 1,363 ★MITUpdated 10 days ago

    git clone https://github.com/ngxson/wllama.git
  4. llmware

    AI repositories

    Unified framework for building enterprise RAG pipelines with small, specialized models

    Stale GitHub, llmware-ai 14.8k ★Apache-2.0Updated 46 days ago

    git clone https://github.com/llmware-ai/llmware.git
  5. kalosm

    AI repositories

    Instant, controllable, local pre-trained AI models in Rust

    Stale GitHub, floneum 2,227 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/floneum/kalosm.git
  6. LLamaSharp

    AI repositories

    A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

    Stale GitHub, SciSharp 3,810 ★MITUpdated 30 days ago

    git clone https://github.com/SciSharp/LLamaSharp.git
  7. runanywhere-sdks

    AI repositories

    Production ready toolkit to run AI locally

    Stale GitHub, RunanywhereAI 10.3k ★Custom licence (see repository)Updated 12 days ago

    git clone https://github.com/RunanywhereAI/runanywhere-sdks.git
  8. engine

    AI repositories

    2bit quants, kernels and runtime for consumer devices.

    Stale GitHub, cactus-compute 6,181 ★Custom licence (see repository)Updated 11 days ago

    git clone https://github.com/cactus-compute/engine.git
  9. Dot

    AI repositories

    Text-To-Speech, RAG, and LLMs. All local!

    Stale GitHub, alexpinel 1,914 ★GPL-3.0Updated 23 months ago

    git clone https://github.com/alexpinel/Dot.git
  10. phlox

    AI repositories

    Open source, local first AI medical agent for desktop and web.

    Stale GitHub, bloodworks-io 109 ★MITUpdated 23 days ago

    git clone https://github.com/bloodworks-io/phlox.git
  11. llama-gpt

    AI repositories

    A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

    Stale GitHub, getumbrel 10.9k ★MITUpdated 2 years ago

    git clone https://github.com/getumbrel/llama-gpt.git
  12. ramalama

    AI repositories

    RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

    Stale GitHub, containers 3,097 ★MITUpdated 16 days ago

    git clone https://github.com/containers/ramalama.git
  13. xybrid

    AI repositories

    Cross-platform on-device AI toolkit

    Stale GitHub, xybrid-ai 522 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/xybrid-ai/xybrid.git
  14. Box

    AI repositories

    The most advanced, fully offline client-side AI suite on Android today.

    Indexed GitHub, jegly 1,013 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/jegly/Box.git
  15. khoj

    AI repositories

    Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

    Stale GitHub, khoj-ai 37.7k ★AGPL-3.0Updated 3 months ago

    git clone https://github.com/khoj-ai/khoj.git
  16. inference

    AI repositories

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

    Indexed GitHub, xorbitsai 9,660 ★Apache-2.0Updated today

    git clone https://github.com/xorbitsai/inference.git
  17. yzma

    AI repositories

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    Stale GitHub, hybridgroup 652 ★Custom licence (see repository)Updated 32 days ago

    git clone https://github.com/hybridgroup/yzma.git
  18. reor

    AI repositories

    Private & local AI personal knowledge management app for high entropy people.

    Stale Archived GitHub, reorproject 8,543 ★AGPL-3.0Updated 18 months ago 1 note

    git clone https://github.com/reorproject/reor.git
  19. paddler

    AI repositories

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Stale GitHub, intentee 1,690 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/intentee/paddler.git
  20. Atomic-Chat

    AI repositories

    Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. Join our Discord: https://discord.com/invite/8wGSsvmg4V

    Stale GitHub, AtomicBot-ai 1,808 ★Custom licence (see repository)Updated 30 days ago

    git clone https://github.com/AtomicBot-ai/Atomic-Chat.git
  21. ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

    Stale Archived GitHub, intel 2,169 ★Apache-2.0Updated 2 years ago 1 note

    git clone https://github.com/intel/intel-extension-for-transformers.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.