InnerVault

OpenLLM

Stale GitHub, bentoml

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Open the source (opens github.com) https://github.com/bentoml/openllm

What it is

AI repositories from bentoml.

The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.

How to get it

Get the code

git clone https://github.com/bentoml/OpenLLM.git

Standard git access to a public repository

Setup steps: not provided by the source. Follow the instructions on the source.

Related

  1. h2o-llmstudio

    AI repositories

    H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/

    Indexed GitHub, h2oai 5,197 ★Apache-2.0Updated 4 days ago

    git clone https://github.com/h2oai/h2o-llmstudio.git
  2. ludwig

    AI repositories

    Low-code framework for building custom LLMs, neural networks, and other AI models

    Stale GitHub, ludwig-ai 11.8k ★Apache-2.0Updated 20 days ago

    git clone https://github.com/ludwig-ai/ludwig.git
  3. llama-cookbook

    AI repositories

    Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

    Stale GitHub, meta-llama 18.6k ★MITUpdated 6 months ago

    git clone https://github.com/meta-llama/llama-cookbook.git
  4. maxtext

    AI repositories

    A simple, performant, and scalable Jax LLM!

    Indexed GitHub, AI-Hypercomputer 2,461 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/AI-Hypercomputer/maxtext.git
  5. Chinese-LLaMA-Alpaca-2

    AI repositories

    中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

    Stale GitHub, ymcui 7,104 ★Apache-2.0Updated 7 months ago

    git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca-2.git
  6. llama-gpt

    AI repositories

    A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

    Stale GitHub, getumbrel 10.9k ★MITUpdated 2 years ago

    git clone https://github.com/getumbrel/llama-gpt.git