Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
rtk
AI repositoriesCLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
git clone https://github.com/rtk-ai/rtk.git -
toon
AI repositories🎒 Token-Oriented Object Notation (TOON) – compact, human-readable serialization of JSON data for LLM prompts. TypeScript SDK, CLI, benchmarks.
git clone https://github.com/toon-format/toon.git -
TokenEconomizer
AI repositoriesExperience-Driven Black-Box Cost Control for Coding Agents
git clone https://github.com/microsoft/TokenEconomizer.git -
tokenspeed
AI repositoriesTokenSpeed is a speed-of-light LLM inference engine.
git clone https://github.com/lightseekorg/tokenspeed.git -
token-monitor
AI repositoriesLocal-first desktop widget for tracking token usage, costs, limits, and session activity across 54+ AI coding tools—including Claude Code, Codex, Cursor, OpenCode, OpenClaw, and more—with multi-device sync.
git clone https://github.com/Javis603/token-monitor.git -
9router
AI repositoriesUnlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
git clone https://github.com/decolua/9router.git -
LLMs-from-scratch
AI repositoriesImplement a ChatGPT-like LLM in PyTorch from scratch, step by step
git clone https://github.com/rasbt/LLMs-from-scratch.git -
MemOS
AI repositoriesSelf-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savings and DeepSeek Harness support.
git clone https://github.com/MemTensor/MemOS.git -
distill
AI repositoriesGet FAR MORE done with FAR FEWER tokens 🔥
git clone https://github.com/samuelfaj/distill.git -
Mooncake
AI repositoriesMooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
git clone https://github.com/kvcache-ai/Mooncake.git -
dsh-see-now
AI repositories让 AI 实时看见你的屏幕:按变化量筛选帧、多帧拼进一张图,静止画面几乎不花 token
git clone https://github.com/SAOS-3624/dsh-see-now.git -
clawcodex
AI repositoriesToken efficient Claude Code full Python rebuild. AI Coding Agent in 310K LoC Python.
git clone https://github.com/agentforce314/clawcodex.git -
smg
AI repositoriesEngine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
git clone https://github.com/smg-project/smg.git -
dsh-cost-meter
AI repositoriesCost tracking for DeepSeek Harness: session and model costs, token usage, budgets, provider balances, and coding-plan quotas. Bilingual English/Chinese UI.
git clone https://github.com/Han-1413141/dsh-cost-meter.git -
rizzo-pii
AI repositoriesLocal-first privacy guard: anonymize your documents before sharing with LLMs.
git clone https://github.com/Rizzo-AI-Academy/rizzo-pii.git -
beat-ai
AI repositories不玩晦涩不搞少数派的 AI 入门圣经,从学生到工程师都能轻松掌握。涵盖神经网络到大模型、顶层设计到微观原理、工程实现到算法基础。 学完后,大家能彻底看懂为什么下一 token 预测这个看似不起眼的能力可以改变世界,也能发现原来 AI 并没有想象中那么神秘、那么高不可攀。 Let's just beat it !
git clone https://github.com/origin-brain/beat-ai.git -
mercury-agent
AI repositoriesSoul-driven AI agent with permission-hardened tools, token budgets, and multi-channel access. Runs 24/7 from CLI, Telegram or More.
git clone https://github.com/cosmicstack-labs/mercury-agent.git -
llm-internals
AI repositoriesLearn LLM internals step by step - from tokenization to attention to inference optimization.
git clone https://github.com/amitshekhariitbhu/llm-internals.git -
cevahir-ai
AI repositoriesCevahir Zihin: a mind that learns by living, not a Transformer. It keeps knowledge as evidence on ties, attends with a Seven-Place Focus and learns from every conversation. Also: a Turkish BPE tokenizer, a Transformer language-model core and cognitive systems.
git clone https://github.com/myylogic/cevahir-ai.git -
codemap
AI repositoriesa project brain for your AI. Give LLMs instant architectural context without burning tokens
git clone https://github.com/JordanCoin/codemap.git -
diy-llm
AI repositoriesCovers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识
git clone https://github.com/datawhalechina/diy-llm.git -
memex
AI repositoriesSearch Claude Code, Codex, Pi, OpenCode, Github Copilot & Cursor transcripts. Resume sessions. Track tokens.
git clone https://github.com/nicosuave/memex.git -
mdflux
AI repositoriesTurn any document into clean, AI-ready Markdown. Local-first desktop app: reads scanned PDFs, batches folders, runs offline, and uses far fewer tokens than vision models.
git clone https://github.com/ibrahimqureshae/mdflux.git -
atmosphere
AI repositoriesPortable AI agent runtime for the JVM. One @Agent class runs on Spring AI, LangChain4j, Anthropic, or 9 more behind one SPI. Token streaming, tool calls, human approvals, and governance over WebSocket, SSE, gRPC, or WebTransport/HTTP3. Speaks MCP, A2A, and AG-UI.
git clone https://github.com/Atmosphere/atmosphere.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.