LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
Open the source (opens github.com) https://github.com/lightning-ai/litserve
What it is
Tools & apps from Lightning-AI.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/Lightning-AI/LitServe.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
AgentPilot
Tools & appsA versatile workflow automation platform to create, organize, and execute AI workflows, from a single LLM to complex AI-driven workflows.
git clone https://github.com/jbexta/AgentPilot.git -
companion-vscode
Tools & appsVSCode extension of Quack Companion 💻 Turn your team insights into a portable plug-and-play context for code generation. Alternative to GitHub Copilot powered by OSS LLMs (Mistral, Gemma, etc.), served with Ollama.
git clone https://github.com/quack-ai/companion-vscode.git -
AiAllSupport
Tools & appssupport all servers in Ai
git clone https://github.com/wjszxli/AiAllSupport.git -
violit
Tools & appsPure Python Web Framework. Streamlit simplicity, no reruns.
git clone https://github.com/violit-dev/violit.git -
covalent
Tools & appsPythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
git clone https://github.com/AgnostiqHQ/covalent.git -
frontman
Tools & appsThe AI agent that lives in your framework/browser
git clone https://github.com/frontman-ai/frontman.git