OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Open the source (opens github.com) https://github.com/bentoml/openllm
What it is
AI repositories from bentoml.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/bentoml/OpenLLM.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
h2o-llmstudio
AI repositoriesH2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
git clone https://github.com/h2oai/h2o-llmstudio.git -
ludwig
AI repositoriesLow-code framework for building custom LLMs, neural networks, and other AI models
git clone https://github.com/ludwig-ai/ludwig.git -
llama-cookbook
AI repositoriesWelcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
git clone https://github.com/meta-llama/llama-cookbook.git -
maxtext
AI repositoriesA simple, performant, and scalable Jax LLM!
git clone https://github.com/AI-Hypercomputer/maxtext.git -
Chinese-LLaMA-Alpaca-2
AI repositories中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
git clone https://github.com/ymcui/Chinese-LLaMA-Alpaca-2.git -
llama-gpt
AI repositoriesA self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
git clone https://github.com/getumbrel/llama-gpt.git