Library
85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
6 results with any of your words
Clear search and filters
-
LMCache
AI repositoriesLMCache: Supercharge Your LLM with the Fastest KV Cache Layer
git clone https://github.com/LMCache/LMCache.git -
tokenspeed
AI repositoriesTokenSpeed is a speed-of-light LLM inference engine.
git clone https://github.com/lightseekorg/tokenspeed.git -
PowerInfer
AI repositoriesHigh-speed Large Language Model Serving for Local Deployment
git clone https://github.com/Tiiny-AI/PowerInfer.git -
dust
AI repositoriesCustom AI agent platform to speed up your work.
git clone https://github.com/dust-tt/dust.git -
surogate
AI repositoriesTrain and serve LLMs at extreme speed and massive throughput.
git clone https://github.com/invergent-ai/surogate.git -
LightLLM
AI repositoriesLightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
git clone https://github.com/ModelTC/LightLLM.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.