InnerVault

Library

85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.

Results

  1. rtk

    AI repositories

    CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies

    Stale GitHub, rtk-ai 86.3k ★Apache-2.0Updated 4 days ago

    git clone https://github.com/rtk-ai/rtk.git
  2. toon

    AI repositories

    🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.

    Stale GitHub, toon-format 25.5k ★MITUpdated 38 days ago

    git clone https://github.com/toon-format/toon.git
  3. TokenEconomizer

    AI repositories

    Experience-Driven Black-Box Cost Control for Coding Agents

    Indexed GitHub, microsoft 6,748 ★Apache-2.0Updated today

    git clone https://github.com/microsoft/TokenEconomizer.git
  4. tokenspeed

    AI repositories

    TokenSpeed is a speed-of-light LLM inference engine.

    Indexed GitHub, lightseekorg 2,932 ★MITUpdated today

    git clone https://github.com/lightseekorg/tokenspeed.git
  5. token-monitor

    AI repositories

    Local-first desktop widget for tracking token usage, costs, limits, and session activity across 54+ AI coding tools—including Claude Code, Codex, Cursor, OpenCode, OpenClaw, and more—with multi-device sync.

    Indexed GitHub, Javis603 3,704 ★MITUpdated today

    git clone https://github.com/Javis603/token-monitor.git
  6. 9router

    AI repositories

    Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

    Stale GitHub, decolua 32.1k ★MITUpdated 7 days ago

    git clone https://github.com/decolua/9router.git
  7. LLMs-from-scratch

    AI repositories

    Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

    Stale GitHub, rasbt 108.3k ★Custom licence (see repository)Updated 7 days ago

    git clone https://github.com/rasbt/LLMs-from-scratch.git
  8. MemOS

    AI repositories

    Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings and DeepSeek Harness support.

    Stale GitHub, MemTensor 12.4k ★Apache-2.0Updated 5 days ago

    git clone https://github.com/MemTensor/MemOS.git
  9. distill

    AI repositories

    Get FAR MORE done with FAR FEWER tokens 🔥

    Indexed GitHub, samuelfaj 781 ★Apache-2.0Updated 3 days ago

    git clone https://github.com/samuelfaj/distill.git
  10. Mooncake

    AI repositories

    Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

    Indexed GitHub, kvcache-ai 7,047 ★Apache-2.0Updated today

    git clone https://github.com/kvcache-ai/Mooncake.git
  11. dsh-see-now

    AI repositories

    让 AI 实时看见你的屏幕:按变化量筛选帧、多帧拼进一张图,静止画面几乎不花 token

    Stale GitHub, SAOS-3624 534 ★Apache-2.0Updated 6 days ago

    git clone https://github.com/SAOS-3624/dsh-see-now.git
  12. clawcodex

    AI repositories

    Token efficient Claude Code full Python rebuild. AI Coding Agent in 310K LoC Python.

    Stale GitHub, agentforce314 924 ★MITUpdated 15 days ago

    git clone https://github.com/agentforce314/clawcodex.git
  13. smg

    AI repositories

    Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

    Indexed GitHub, smg-project 723 ★Apache-2.0Updated today

    git clone https://github.com/smg-project/smg.git
  14. dsh-cost-meter

    AI repositories

    Cost tracking for DeepSeek Harness: session and model costs, token usage, budgets, provider balances, and coding-plan quotas. Bilingual English/Chinese UI.

    Indexed GitHub, Han-1413141 706 ★MITUpdated today

    git clone https://github.com/Han-1413141/dsh-cost-meter.git
  15. rizzo-pii

    AI repositories

    Local-first privacy guard: anonymize your documents before sharing with LLMs.

    Indexed GitHub, Rizzo-AI-Academy 1,271 ★MITUpdated yesterday

    git clone https://github.com/Rizzo-AI-Academy/rizzo-pii.git
  16. beat-ai

    AI repositories

    不玩晦涩不搞少数派的 AI 入门圣经,从学生到工程师都能轻松掌握。涵盖神经网络到大模型、顶层设计到微观原理、工程实现到算法基础。 学完后,大家能彻底看懂为什么下一 token 预测这个看似不起眼的能力可以改变世界,也能发现原来 AI 并没有想象中那么神秘、那么高不可攀。 Let's just beat it !

    Stale GitHub, origin-brain 4,729 ★Updated 2 months ago

    git clone https://github.com/origin-brain/beat-ai.git
  17. mercury-agent

    AI repositories

    Soul-driven AI agent with permission-hardened tools, token budgets, and multi-channel access. Runs 24/7 from CLI, Telegram or More.

    Indexed GitHub, cosmicstack-labs 4,010 ★MITUpdated today

    git clone https://github.com/cosmicstack-labs/mercury-agent.git
  18. llm-internals

    AI repositories

    Learn LLM internals step by step - from tokenization to attention to inference optimization.

    Indexed GitHub, amitshekhariitbhu 1,773 ★Apache-2.0Updated today

    git clone https://github.com/amitshekhariitbhu/llm-internals.git
  19. cevahir-ai

    AI repositories

    Cevahir Zihin: a mind that learns by living, not a Transformer. It keeps knowledge as evidence on ties, attends with a Seven-Place Focus and learns from every conversation. Also: a Turkish BPE tokenizer, a Transformer language-model core and cognitive systems.

    Indexed GitHub, myylogic 297 ★Apache-2.0Updated today

    git clone https://github.com/myylogic/cevahir-ai.git
  20. codemap

    AI repositories

    a project brain for your AI. Give LLMs instant architectural context without burning tokens

    Stale GitHub, JordanCoin 705 ★MITUpdated 16 days ago

    git clone https://github.com/JordanCoin/codemap.git
  21. diy-llm

    AI repositories

    Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识

    Stale GitHub, datawhalechina 2,648 ★Updated 14 days ago

    git clone https://github.com/datawhalechina/diy-llm.git
  22. memex

    AI repositories

    Search Claude Code, Codex, Pi, OpenCode, Github Copilot & Cursor transcripts. Resume sessions. Track tokens.

    Stale GitHub, nicosuave 311 ★MITUpdated 6 days ago

    git clone https://github.com/nicosuave/memex.git
  23. mdflux

    AI repositories

    Turn any document into clean, AI-ready Markdown. Local-first desktop app: reads scanned PDFs, batches folders, runs offline, and uses far fewer tokens than vision models.

    Stale GitHub, ibrahimqureshae 577 ★MITUpdated 18 days ago

    git clone https://github.com/ibrahimqureshae/mdflux.git
  24. atmosphere

    AI repositories

    Portable AI agent runtime for the JVM. One @Agent class runs on Spring AI, LangChain4j, Anthropic, or 9 more behind one SPI. Token streaming, tool calls, human approvals, and governance over WebSocket, SSE, gRPC, or WebTransport/HTTP3. Speaks MCP, A2A, and AG-UI.

    Indexed GitHub, Atmosphere 3,834 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/Atmosphere/atmosphere.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.