SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
Open the source (opens github.com) https://github.com/sgl-project/specforge
What it is
AI repositories from sgl-project.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/sgl-project/SpecForge.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
labs-molt
AI repositoriesA scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).
git clone https://github.com/NVIDIA-NeMo/labs-molt.git -
AngelSlim
AI repositoriesModel compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.
git clone https://github.com/Tencent/AngelSlim.git -
open-webui
AI repositoriesUser-friendly AI Interface (Supports Ollama, OpenAI API, ...)
git clone https://github.com/open-webui/open-webui.git -
awesome-llm-apps
AI repositories100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.
git clone https://github.com/Shubhamsaboo/awesome-llm-apps.git -
llm-course
AI repositoriesCourse to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
git clone https://github.com/mlabonne/llm-course.git -
TradingAgents
AI repositoriesTradingAgents: Multi-Agents LLM Financial Trading Framework
git clone https://github.com/TauricResearch/TradingAgents.git