InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. Bonsai-demo

    AI repositories

    Bonsai Demo

    Stale GitHub, PrismML-Eng 3,485 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/PrismML-Eng/Bonsai-demo.git
  2. jan

    AI repositories

    Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.

    Indexed GitHub, janhq 45.7k ★Custom licence (see repository)Updated today

    git clone https://github.com/janhq/jan.git
  3. wllama

    AI repositories

    WebAssembly binding for llama.cpp - Enabling on-browser LLM inference

    Stale GitHub, ngxson 1,363 ★MITUpdated 10 days ago

    git clone https://github.com/ngxson/wllama.git
  4. llmware

    AI repositories

    Unified framework for building enterprise RAG pipelines with small, specialized models

    Stale GitHub, llmware-ai 14.8k ★Apache-2.0Updated 46 days ago

    git clone https://github.com/llmware-ai/llmware.git
  5. kalosm

    AI repositories

    Instant, controllable, local pre-trained AI models in Rust

    Stale GitHub, floneum 2,227 ★Apache-2.0Updated 23 days ago

    git clone https://github.com/floneum/kalosm.git
  6. LLamaSharp

    AI repositories

    A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently.

    Stale GitHub, SciSharp 3,810 ★MITUpdated 30 days ago

    git clone https://github.com/SciSharp/LLamaSharp.git
  7. runanywhere-sdks

    AI repositories

    Production ready toolkit to run AI locally

    Stale GitHub, RunanywhereAI 10.3k ★Custom licence (see repository)Updated 12 days ago

    git clone https://github.com/RunanywhereAI/runanywhere-sdks.git
  8. engine

    AI repositories

    2bit quants, kernels and runtime for consumer devices.

    Stale GitHub, cactus-compute 6,181 ★Custom licence (see repository)Updated 11 days ago

    git clone https://github.com/cactus-compute/engine.git
  9. Dot

    AI repositories

    Text-To-Speech, RAG, and LLMs. All local!

    Stale GitHub, alexpinel 1,914 ★GPL-3.0Updated 23 months ago

    git clone https://github.com/alexpinel/Dot.git
  10. hass_local_openai_llm

    Agents & frameworks

    Home Assistant LLM integration for local OpenAI-compatible services (llamacpp, vllm, etc)

    Stale GitHub, skye-harris 305 ★Apache-2.0Updated 15 days ago

    git clone https://github.com/skye-harris/hass_local_openai_llm.git
  11. phlox

    AI repositories

    Open source, local first AI medical agent for desktop and web.

    Stale GitHub, bloodworks-io 109 ★MITUpdated 23 days ago

    git clone https://github.com/bloodworks-io/phlox.git
  12. llama-gpt

    AI repositories

    A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

    Stale GitHub, getumbrel 10.9k ★MITUpdated 2 years ago

    git clone https://github.com/getumbrel/llama-gpt.git
  13. lsp-ai

    Tools & apps

    LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

    Stale GitHub, SilasMarvin 3,210 ★MITUpdated 22 months ago

    git clone https://github.com/SilasMarvin/lsp-ai.git
  14. ramalama

    AI repositories

    RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of containers.

    Stale GitHub, containers 3,097 ★MITUpdated 16 days ago

    git clone https://github.com/containers/ramalama.git
  15. xybrid

    AI repositories

    Cross-platform on-device AI toolkit

    Stale GitHub, xybrid-ai 522 ★Apache-2.0Updated 5 days ago

    git clone https://github.com/xybrid-ai/xybrid.git
  16. Box

    AI repositories

    The most advanced, fully offline client-side AI suite on Android today.

    Indexed GitHub, jegly 1,013 ★Custom licence (see repository)Updated 3 days ago

    git clone https://github.com/jegly/Box.git
  17. khoj

    AI repositories

    Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

    Stale GitHub, khoj-ai 37.7k ★AGPL-3.0Updated 3 months ago

    git clone https://github.com/khoj-ai/khoj.git
  18. inference

    AI repositories

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

    Indexed GitHub, xorbitsai 9,660 ★Apache-2.0Updated today

    git clone https://github.com/xorbitsai/inference.git
  19. yzma

    AI repositories

    Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.

    Stale GitHub, hybridgroup 652 ★Custom licence (see repository)Updated 32 days ago

    git clone https://github.com/hybridgroup/yzma.git
  20. reor

    AI repositories

    Private & local AI personal knowledge management app for high entropy people.

    Stale Archived GitHub, reorproject 8,543 ★AGPL-3.0Updated 18 months ago 1 note

    git clone https://github.com/reorproject/reor.git
  21. paddler

    AI repositories

    Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

    Stale GitHub, intentee 1,690 ★Apache-2.0Updated 9 days ago

    git clone https://github.com/intentee/paddler.git
  22. mac-ml-speed-test

    Datasets & benchmarks

    A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.

    Stale GitHub, mrdbourke 203 ★Updated 2 years ago

    git clone https://github.com/mrdbourke/mac-ml-speed-test.git
  23. Lynkr

    Tools & apps

    Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

    Indexed GitHub, Fast-Editor 640 ★Apache-2.0Updated yesterday

    git clone https://github.com/Fast-Editor/Lynkr.git
  24. CLIO

    Tools & apps

    An AI-assisted coding agent that runs in your terminal and supports many providers and models.

    Indexed GitHub, SyntheticAutonomicMind 233 ★GPL-3.0Updated today

    git clone https://github.com/SyntheticAutonomicMind/CLIO.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.