Library
85,762 resources from 11 public sources. 53 checked by hand; the rest are unreviewed.
Results
-
groundingLMM
Agents & frameworks[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.
git clone https://github.com/mbzuai-oryx/groundingLMM.git -
VideoGLaMM
Agents & frameworks[CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos
git clone https://github.com/mbzuai-oryx/VideoGLaMM.git -
NEWTON
Agents & frameworksNEWTON: Agentic Planning for Physically Grounded Video Generation
git clone https://github.com/CUTEPKQ/NEWTON.git -
wechat-mac-rpa
Agents & frameworks基于多模态视觉感知与 LLM Agent 的 macOS 微信自动化框架 | Visual RPA for WeChat
git clone https://github.com/wq19901103wq/wechat-mac-rpa.git -
cerul
Agents & frameworksOpen-source video processing core and CLI. Search and annotate local videos with your own model endpoints.
git clone https://github.com/cerul-ai/cerul.git -
GPA-LM
Agents & frameworksThis repo is a live list of papers on game playing and large multimodality model - "A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges".
git clone https://github.com/BAAI-Agents/GPA-LM.git -
aiml-companion
Agents & frameworksAI-ML Companion: an interactive platform to learn AI & ML by watching it work - 28 tracks, 400+ modules, live visualizations - plus 20+ end-to-end real world projects from classical ML, DL, Computer Vision to production LLM & multi-agent systems.
git clone https://github.com/genieincodebottle/aiml-companion.git -
Vision-Agents
Agents & frameworksOpen Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider. Uses Stream's edge network for ultra-low latency.
git clone https://github.com/GetStream/Vision-Agents.git -
dsh-video-storyboard
Agents & frameworksScene-aware storyboard for DeepSeek Harness: 9-16 numbered cells with timestamps + transcript + an audio envelope, packed into ONE image (384 tokens). Two tools: video_storyboard and video_zoom.
git clone https://github.com/SAOS-3624/dsh-video-storyboard.git -
MulmoChat
Agents & frameworksResearch prototype for chat that is not a text stream: keep talking while images, maps and playable games appear on the canvas. Each kind of answer is a plugin on the GUI Chat Protocol.
git clone https://github.com/receptron/MulmoChat.git -
ai-engineering-from-scratch
Agents & frameworksLearn AI Engineering! Learn it. Build it. Ship it for others.
git clone https://github.com/rohitg00/ai-engineering-from-scratch.git -
virtualhome
Agents & frameworksAPI to run VirtualHome, a Multi-Agent Household Simulator
git clone https://github.com/xavierpuigf/virtualhome.git -
open-webui-tools
Agents & frameworksOpen‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. With a suite of over 15 specialized tools, function pipelines, and filters, this project supports academic research, agentic autonomy, multimodal creativity, workflows, and more
git clone https://github.com/Haervwe/open-webui-tools.git -
ChatSim
Agents & frameworks[CVPR2024 Highlight] Editable Scene Simulation for Autonomous Driving via LLM-Agent Collaboration
git clone https://github.com/yifanlu0227/ChatSim.git -
roubao
Agents & frameworksAndroid Automation Tool Based on Vision-Language Models
git clone https://github.com/Turbo1123/roubao.git -
ai-agent-book
Agents & frameworks《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码
git clone https://github.com/bojieli/ai-agent-book.git -
Interactive-LLM-Powered-NPCs
Agents & frameworksInteractive LLM Powered NPCs, is an open-source project that completely transforms your interaction with non-player characters (NPCs) in any game! 🎮🤖🚀
git clone https://github.com/AkshitIreddy/Interactive-LLM-Powered-NPCs.git -
VisualAgentBench
Agents & frameworksTowards Large Multimodal Models as Visual Foundation Agents
git clone https://github.com/THUDM/VisualAgentBench.git -
CaPtain
Agents & frameworksCaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents — CaPtain-Harness, SFT and RL training code, benchmark adapters
git clone https://github.com/waltstephen/CaPtain.git -
antfly
Agents & frameworksgit clone https://github.com/antflydb/antfly.git -
ruby_llm
Agents & frameworksThe Ruby AI framework.
git clone https://github.com/crmne/ruby_llm.git -
Awesome-CUA
Agents & frameworksOpen, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.
git clone https://github.com/reacher-z/Awesome-CUA.git -
datachain
Agents & frameworksThe Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure
git clone https://github.com/datachain-ai/datachain.git -
Relax
Agents & frameworksAn Asynchronous Reinforcement Learning Engine for Omni-Modal Post-Training at Scale
git clone https://github.com/redai-studio/Relax.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.