Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
mlc-llm
AI repositoriesUniversal LLM Deployment Engine with ML Compilation
git clone https://github.com/mlc-ai/mlc-llm.git -
PowerInfer
AI repositoriesHigh-speed Large Language Model Serving for Local Deployment
git clone https://github.com/Tiiny-AI/PowerInfer.git -
ray
AI repositoriesRay is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
git clone https://github.com/ray-project/ray.git -
AgentVerse
AI repositories🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation
git clone https://github.com/OpenBMB/AgentVerse.git -
council
AI repositoriesCouncil is an open-source platform for the rapid development and robust deployment of customized generative AI applications
git clone https://github.com/chain-ml/council.git -
coze-studio
AI repositoriesAn AI agent development platform with all-in-one visual tools, simplifying agent creation, debugging, and deployment like never before. Coze your way to AI Agent creation.
git clone https://github.com/coze-dev/coze-studio.git -
petercat
AI repositoriesA conversational Q&A agent configuration system, self-hosted deployment solutions, and a convenient all-in-one application SDK, allowing you to create intelligent Q&A bots for your GitHub repositories
git clone https://github.com/afx-team/petercat.git -
cognita
AI repositoriesRAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
git clone https://github.com/truefoundry/cognita.git -
paddler
AI repositoriesOpen-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
git clone https://github.com/intentee/paddler.git -
hope-agent
AI repositories🦭 A cross-device desktop AI agent with memory, autonomous goals, dynamic workflows, and headless deployment | 会记忆、能持续推进目标、会动态编排多 Agent 的跨端桌面 AI 助手,也可服务化常驻 NAS / 云端
git clone https://github.com/shiwenwen/hope-agent.git -
END-TO-END-GENERATIVE-AI-PROJECTS
AI repositoriesEnd to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects
git clone https://github.com/GURPREETKAURJETHRA/END-TO-END-GENERATIVE-AI-PROJECTS.git -
qKnow
AI repositoriesqKnow is an open-source agent platform for enterprise knowledge intelligence and industry AI. It provides knowledge graphs, RAG, and bot building, encapsulating industry AI into standardized modules for rapid deployment. Supporting unified integration of documents and data, it helps enterprises quickly build knowledge hubs and AI solutions.
git clone https://github.com/qiantongtech/qKnow.git -
lmc-5
AI repositoriesLiving Memory Coordinate-5: five-axis memory architecture for long-running LLM agents. Minimal SQLite + production PostgreSQL/pgvector reference impls, multi-channel recall pipeline, LLM-proposed hippocampus, persona policies, VPS 7×24 deployment shape. Not another vector DB.
git clone https://github.com/wuxuyun0606-collab/lmc-5.git -
generative-ai-application-builder-on-aws
AI repositoriesGenerative AI Application Builder on AWS facilitates the development, rapid experimentation, and deployment of generative artificial intelligence (AI) applications without requiring deep experience in AI. The solution includes integrations with Amazon Bedrock and its included LLMs, such as Amazon Titan, and pre-built connectors for 3rd-party LLMs.
git clone https://github.com/aws-solutions/generative-ai-application-builder-on-aws.git -
restai
AI repositoriesRESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...
git clone https://github.com/apocas/restai.git -
iq-series
AI repositoriesThe IQ Series is a hands-on learning experience for Microsoft IQ: Microsoft's unified intelligence layer for the enterprise, spanning Foundry IQ, Work IQ, and Fabric IQ. The series includes video episodes, Jupyter notebooks, and Azure deployment templates.
git clone https://github.com/microsoft/iq-series.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.