InnerVault

LitServe

Stale GitHub, Lightning-AI

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Open the source (opens github.com) https://github.com/lightning-ai/litserve

What it is

Tools & apps from Lightning-AI.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/Lightning-AI/LitServe.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. AgentPilot

    Tools & apps

    A versatile workflow automation platform to create, organize, and execute AI workflows, from a single LLM to complex AI-driven workflows.

    Stale GitHub, jbexta 571 ★AGPL-3.0Updated 10 days ago

    git clone https://github.com/jbexta/AgentPilot.git
  2. companion-vscode

    Tools & apps

    VSCode extension of Quack Companion 💻 Turn your team insights into a portable plug-and-play context for code generation. Alternative to GitHub Copilot powered by OSS LLMs (Mistral, Gemma, etc.), served with Ollama.

    Stale Archived GitHub, quack-ai 234 ★Apache-2.0Updated 2 years ago 1 note

    git clone https://github.com/quack-ai/companion-vscode.git
  3. AiAllSupport

    Tools & apps

    support all servers in Ai

    Stale GitHub, wjszxli 214 ★MITUpdated 2 months ago

    git clone https://github.com/wjszxli/AiAllSupport.git
  4. violit

    Tools & apps

    Pure Python Web Framework. Streamlit simplicity, no reruns.

    Stale GitHub, violit-dev 475 ★MITUpdated 5 months ago

    git clone https://github.com/violit-dev/violit.git
  5. covalent

    Tools & apps

    Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

    Stale GitHub, AgnostiqHQ 868 ★Apache-2.0Updated 35 days ago

    git clone https://github.com/AgnostiqHQ/covalent.git
  6. frontman

    Tools & apps

    The AI agent that lives in your framework/browser

    Indexed GitHub, frontman-ai 725 ★Custom licence (see repository)Updated today

    git clone https://github.com/frontman-ai/frontman.git