Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
Sidekick
Agents & frameworksA native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.
git clone https://github.com/johnbean393/Sidekick.git -
LLMCompiler
Agents & frameworks[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
git clone https://github.com/SqueezeAILab/LLMCompiler.git -
llama-cpp-agent
Agents & frameworksThe llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
git clone https://github.com/Maximilian-Winter/llama-cpp-agent.git -
llama-modchip
Agents & frameworksRun 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).
git clone https://github.com/synchopate/llama-modchip.git -
parlant
Agents & frameworksBuild reliable customer-facing AI agents with Parlant: an interaction control harness optimized for controlled, consistent, and predictable LLM interactions.
git clone https://github.com/emcie-co/parlant.git -
langroid
Agents & frameworksHarness LLMs with Multi-Agent Programming
git clone https://github.com/langroid/langroid.git -
ai-agents-from-scratch
Agents & frameworksDemystify AI agents by building them yourself. Local LLMs, no black boxes, real understanding of function calling, memory, and ReAct patterns.
git clone https://github.com/pguso/ai-agents-from-scratch.git -
hass_local_openai_llm
Agents & frameworksHome Assistant LLM integration for local OpenAI-compatible services (llamacpp, vllm, etc)
git clone https://github.com/skye-harris/hass_local_openai_llm.git -
Observer
Agents & frameworksThe orchestrator that deploys micro-agents that monitor anything for you. Running completely locally. Open Source.
git clone https://github.com/Roy3838/Observer.git -
ODS
Agents & frameworksODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
git clone https://github.com/Osmantic/ODS.git -
rag-from-scratch
Agents & frameworksDemystify RAG by building it from scratch. Local LLMs, no black boxes - real understanding of embeddings, vector search, retrieval, and context-augmented generation.
git clone https://github.com/pguso/rag-from-scratch.git -
bolna
Agents & frameworksConversational voice AI agents
git clone https://github.com/bolna-ai/bolna.git -
RongxinAI
Agents & frameworksOpen-source desktop AI agent: built-in free model, local GGUF models via llama.cpp, dispatch tasks from WeChat/Feishu/DingTalk. Files, browser & MCP tools. | 开源桌面 AI 智能体:内置免费模型,llama.cpp 本地 GGUF 模型,微信/飞书/钉钉直接派任务。
git clone https://github.com/rongxinzy/RongxinAI.git -
ICLR2025-Papers-with-Code
Agents & frameworks历年ICLR论文和开源项目合集,包含ICLR2021、ICLR2022、ICLR2023、ICLR2024、ICLR2025.
git clone https://github.com/yinizhilian/ICLR2025-Papers-with-Code.git -
palico-ai
Agents & frameworksBuild, Improve Performance, and Productionize your AI Application
git clone https://github.com/palico-ai/palico-ai.git -
llm-course-zh
Agents & frameworks大型語言模型(LLM)的讀書會內容code部分整理,此github提供簡單、免費、易實作code範例,並由淺入深帶你一步步了解如何基於python建置LLM流程、部屬功能等
git clone https://github.com/PipiHi0926/llm-course-zh.git -
Lexora
Agents & frameworksA self-evolved, sovereign desktop AI agent built for real-world action — beyond model wrappers and coding copilots. / 真实实践中自我演化的独立桌面 AI Agent。
git clone https://github.com/useLexora/Lexora.git -
edsl
Agents & frameworksDesign, conduct and analyze results of AI-powered surveys and experiments. Simulate social science and market research with large numbers of AI agents and LLMs.
git clone https://github.com/expectedparrot/edsl.git -
hands-on-llm
Agents & frameworks动手学大模型全栈:CS336 中文精讲 · PyTorch 手搓 Transformer · 单卡复现 Pretrain/SFT/LoRA/DPO/GRPO/RLVR · PEFT/Agent/RAG 落地(含真实实验、曲线与复现脚本)
git clone https://github.com/FRS2003/hands-on-llm.git -
capri-ai
Agents & frameworksCapri from Cyberpunk: Edgerunners 2 living on your desktop. A local AI desktop companion: talks, remembers you, DJs your music. 100% local, no API keys. Topics
git clone https://github.com/capri-desktop/capri-ai.git -
chinese-llm-benchmark
Agents & frameworks非线智能 NoneLinear - ReLE评测:中文AI大模型能力评测(持续更新):目前已囊括374个大模型,覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、qwen3.6-plus、百川、讯飞星火、商汤senseChat等商用模型, 以及step3.5-flash、kimi-k2.6、ernie4.5、MiniMax-M2.7、deepseek-v4、Qwen3.6、llama4、智谱GLM-5.1、MiMo-V2、LongCat、gemma4、mistral等开源大模型。不仅提供排行榜,也提供规模超200万的大模型缺陷库!方便广大社区研究分析、改进大模型。
git clone https://github.com/jeinlee1991/chinese-llm-benchmark.git -
Capri-AI-Desktop
Agents & frameworksCapri — Edgerunners-inspired AI agent for your desktop. Supports Claude 3.7, Claude Code, OpenAI, and local Ollama/LLaMA. Custom AI Waifu Companion with voice chat.
git clone https://github.com/PotterRemember37/Capri-AI-Desktop.git -
localharness
Agents & frameworksAn open-source, coding agent harness designed specifically for local LLMs. Designed as everything a user needs to jumpstart their own harness (detailed event steams, logs, and performance data) or quickly replace closed source one (featuring out of the box plugins for web search, image gen, memory, auto research and more in dev).
git clone https://github.com/ahwurm/localharness.git -
Lynn
Agents & frameworks开源桌面 AI Agent 与 CLI:长期记忆、多 Agent、实时语音;Qwen3.8-27B Coder390 EfficientThink 本地 GGUF(llama.cpp Q2/Q3,内置 Q4 MTP)· Open-source desktop AI agent & CLI with Coder390 local models
git clone https://github.com/MerkyorLynn/Lynn.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.