Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
Looks like a goal we have a starting path for: I want to connect AI to my tools
-
OpenAI Cookbook
AI repositoriesExamples and guides for building with the OpenAI API.
-
omlx
AI repositoriesLLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
git clone https://github.com/jundot/omlx.git -
gorilla
AI repositoriesGorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
git clone https://github.com/ShishirPatil/gorilla.git -
WebAI2API
AI repositoriesWebAI2API: 基于 Camoufox 的网页 AI 转 API 工具,支持 LMArena/Gemini等,多窗口并发与账号隔离。 | Web AI to OpenAI API via Camoufox. Supports LMArena/Gemini and more, multi-window concurrency & account isolation.
git clone https://github.com/foxhui/WebAI2API.git -
open-webui
AI repositoriesUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)
git clone https://github.com/open-webui/open-webui.git -
VLMEvalKit
AI repositoriesOpen-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
git clone https://github.com/open-compass/VLMEvalKit.git -
larql
AI repositoriesRun, serve, query and edit AI models — a Rust model runtime built on VINDEX3, an executable, inspectable model format.
git clone https://github.com/chrishayuk/larql.git -
langchain-kr
AI repositoriesLangChain 공식 Document, Cookbook, 그 밖의 실용 예제를 바탕으로 작성한 한국어 튜토리얼입니다. 본 튜토리얼을 통해 LangChain을 더 쉽고 효과적으로 사용하는 방법을 배울 수 있습니다.
git clone https://github.com/teddylee777/langchain-kr.git -
OlliteRT
AI repositoriesTurn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source
git clone https://github.com/NightMean/OlliteRT.git -
SwiftLM
AI repositories⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache compression, MACOS + iOS iPhone app.
git clone https://github.com/SharpAI/SwiftLM.git -
folkbench
AI repositories帮你的 AI 编程工具找到不降智、不断连、高性价比的好线路 · Live LLM relay rankings, model integrity probes & Tauri/Rust switcher for Claude Code, Codex & Gemini CLI
git clone https://github.com/Folkbench/folkbench.git -
openai-kotlin
AI repositoriesOpenAI API client for Kotlin with multiplatform and coroutines capabilities.
git clone https://github.com/aallam/openai-kotlin.git -
inference
AI repositoriesOpen-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.
git clone https://github.com/xorbitsai/inference.git -
pegainfer
AI repositoriesPure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
git clone https://github.com/pegainfer-project/pegainfer.git -
mlx-serve
AI repositoriesNative LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
git clone https://github.com/ddalcu/mlx-serve.git -
TTS-WebUI
AI repositoriesA single Gradio + React WebUI with extensions for ACE-Step, OmniVoice, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet, AudioGen, MusicGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, and Bark!
git clone https://github.com/rsxdalv/TTS-WebUI.git -
END-TO-END-GENERATIVE-AI-PROJECTS
AI repositoriesEnd to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
git clone https://github.com/GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS.git -
langchain4j
AI repositoriesLangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.
git clone https://github.com/langchain4j/langchain4j.git -
vllm-mlx
AI repositoriesHigh-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.
git clone https://github.com/waybarrios/vllm-mlx.git -
halogen-flash-server
AI repositoriesLocal inference that behaves like a frontier API: Qwen3.8-Flash-Next on AMD Strix Halo plus small NPU models, over the OpenAI and Anthropic APIs on one port.
git clone https://github.com/peonist-ai/halogen-flash-server.git -
memmy-agent
AI repositories🍙 A personal AI agent & local memory hub for all AI agents, gives every AI one shared, fully controlled memory and persistent context — all AI remember the same you. Now supports Claude Code, Codex, OpenClaw and Hermes Agent etc.
git clone https://github.com/MemTensor/memmy-agent.git -
RWKV-Runner
AI repositoriesA RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.
git clone https://github.com/josStorer/RWKV-Runner.git -
project-maya
AI repositoriesProject Maya - run GLM-5.3-Flash (321B MoE), DeepSeek-V4.1-Flash-1017 (748B MoE) and MiniMax-M3.1-Flash (428B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, server, dashboard, OpenAI- and Anthropic-compatible API, quant tools.
git clone https://github.com/mw00/project-maya.git -
RAGLight
AI repositoriesRAGLight is a modular framework for Retrieval-Augmented Generation (RAG). It makes it easy to plug in different LLMs, embeddings, and vector stores, and now includes seamless MCP integration to connect external tools and data sources.
git clone https://github.com/Bessouat40/RAGLight.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.