Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
gateway
AI repositoriesA blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
git clone https://github.com/Portkey-AI/gateway.git -
zenml
AI repositoriesZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
git clone https://github.com/zenml-io/zenml.git -
openllmetry
AI repositoriesOpen-source observability for your GenAI or LLM application, based on OpenTelemetry
git clone https://github.com/traceloop/openllmetry.git -
superduper
AI repositoriesSuperduper: End-to-end framework for building custom AI applications and agents.
git clone https://github.com/superduper-io/superduper.git -
Soup
AI repositoriesFine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
git clone https://github.com/MakazhanAlpamys/Soup.git -
llm-python
Docs & tutorialsLarge Language Models (LLMs) tutorials & sample scripts, ft. langchain, openai, llamaindex, gpt, chromadb & pinecone
git clone https://github.com/onlyphantom/llm-python.git -
LLMStack
AI repositoriesNo-code multi-agent framework to build LLM Agents, workflows and applications with your data
git clone https://github.com/trypromptly/LLMStack.git -
litellm
AI repositoriesThe fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
git clone https://github.com/BerriAI/litellm.git -
llmflows
PromptsLLMFlows - Simple, Explicit and Transparent LLM Apps
git clone https://github.com/stoyan-stoyanov/llmflows.git -
nextpy
Agents & frameworks🤖Self-Modifying Framework from the Future 🔮 World's First AMS
git clone https://github.com/dot-agent/nextpy.git -
OpenLLM
AI repositoriesRun any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
git clone https://github.com/bentoml/OpenLLM.git -
giskard-oss
AI repositories🐢 Open-Source Evaluation & Testing library for LLM Agents
git clone https://github.com/Giskard-AI/giskard-oss.git -
burr
AI repositoriesBuild applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.
git clone https://github.com/apache/burr.git -
langwatch
PromptsOpen-Source Agent Observability & Evals for AI Platform teams. Trace, test, route and govern every agent & coding assistant in the company.
git clone https://github.com/langwatch/langwatch.git -
bosquet
PromptsTooling to build LLM applications: prompt templating and composition, agents, LLM memory, and other instruments for builders of AI applications.
git clone https://github.com/zmedelis/bosquet.git -
lmnr
Tools & appsLaminar - open-source observability platform purpose-built for AI agents. YC S24.
git clone https://github.com/lmnr-ai/lmnr.git -
BentoML
AI repositoriesThe easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
git clone https://github.com/bentoml/BentoML.git -
helicone
Prompts🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓
git clone https://github.com/Helicone/helicone.git -
langfuse
Prompts🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
git clone https://github.com/langfuse/langfuse.git -
mlflow
PromptsThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.
git clone https://github.com/mlflow/mlflow.git -
awesome-ai-engineering
Prompts🚀 A curated collection of AI engineering resources, roadmaps, tools, and projects covering LLMs, RAG, AI Agents, MCP, fine-tuning, evaluations, and production AI systems.
git clone https://github.com/dipakkr/awesome-ai-engineering.git -
evidently
AI repositoriesEvidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
git clone https://github.com/evidentlyai/evidently.git -
gateway
PromptsThe only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.
git clone https://github.com/adaline/gateway.git -
promptfoo
PromptsTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
git clone https://github.com/promptfoo/promptfoo.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.