InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

6 results with any of your words Clear search and filters
  1. LMCache

    AI repositories

    LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

    Indexed GitHub, LMCache 12.4k ★Apache-2.0Updated 2 days ago

    git clone https://github.com/LMCache/LMCache.git
  2. tokenspeed

    AI repositories

    TokenSpeed is a speed-of-light LLM inference engine.

    Indexed GitHub, lightseekorg 2,932 ★MITUpdated today

    git clone https://github.com/lightseekorg/tokenspeed.git
  3. PowerInfer

    AI repositories

    High-speed Large Language Model Serving for Local Deployment

    Stale GitHub, Tiiny-AI 9,828 ★MITUpdated 6 months ago

    git clone https://github.com/Tiiny-AI/PowerInfer.git
  4. dust

    AI repositories

    Custom AI agent platform to speed up your work.

    Stale GitHub, dust-tt 1,492 ★MITUpdated 25 days ago

    git clone https://github.com/dust-tt/dust.git
  5. surogate

    AI repositories

    Train and serve LLMs at extreme speed and massive throughput.

    Stale GitHub, invergent-ai 885 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/invergent-ai/surogate.git
  6. LightLLM

    AI repositories

    LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

    Indexed GitHub, ModelTC 4,362 ★Apache-2.0Updated today

    git clone https://github.com/ModelTC/LightLLM.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.