Library
85,762 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.
Results
-
NEWTON
Agents & frameworksNEWTON: Agentic Planning for Physically Grounded Video Generation
git clone https://github.com/CUTEPKQ/NEWTON.git -
VideoGLaMM
Agents & frameworks[CVPR 2025 🔥]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos
git clone https://github.com/mbzuai-oryx/VideoGLaMM.git -
groundingLMM
Agents & frameworks[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.
git clone https://github.com/mbzuai-oryx/groundingLMM.git -
wechat-mac-rpa
Agents & frameworks基于多模态视觉感知与 LLM Agent 的 macOS 微信自动化框架 | Visual RPA for WeChat
git clone https://github.com/wq19901103wq/wechat-mac-rpa.git -
cerul
Agents & frameworksOpen-source video processing core and CLI. Search and annotate local videos with your own model endpoints.
git clone https://github.com/cerul-ai/cerul.git -
GPA-LM
Agents & frameworksThis repo is a live list of papers on game playing and large multimodality model - "A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges".
git clone https://github.com/BAAI-Agents/GPA-LM.git -
aiml-companion
Agents & frameworksAI-ML Companion: an interactive platform to learn AI & ML by watching it work - 28 tracks, 400+ modules, live visualizations - plus 20+ end-to-end real world projects from classical ML, DL, Computer Vision to production LLM & multi-agent systems.
git clone https://github.com/genieincodebottle/aiml-companion.git -
MulmoChat
Agents & frameworksResearch prototype for chat that is not a text stream: keep talking while images, maps and playable games appear on the canvas. Each kind of answer is a plugin on the GUI Chat Protocol.
git clone https://github.com/receptron/MulmoChat.git -
Vision-Agents
Agents & frameworksOpen Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider. Uses Stream's edge network for ultra-low latency.
git clone https://github.com/GetStream/Vision-Agents.git -
dsh-video-storyboard
Agents & frameworksScene-aware storyboard for DeepSeek Harness: 9-16 numbered cells with timestamps + transcript + an audio envelope, packed into ONE image (384 tokens). Two tools: video_storyboard and video_zoom.
git clone https://github.com/SAOS-3624/dsh-video-storyboard.git -
ai-engineering-from-scratch
Agents & frameworksLearn AI Engineering! Learn it. Build it. Ship it for others.
git clone https://github.com/rohitg00/ai-engineering-from-scratch.git -
opencode-gpt-imagegen
Agents & frameworksOpenCode plugin: image generation via your ChatGPT subscription
git clone https://github.com/yuji-hatakeyama/opencode-gpt-imagegen.git -
virtualhome
Agents & frameworksAPI to run VirtualHome, a Multi-Agent Household Simulator
git clone https://github.com/xavierpuigf/virtualhome.git -
open-webui-tools
Agents & frameworksOpen‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. With a suite of over 15 specialized tools, function pipelines, and filters, this project supports academic research, agentic autonomy, multimodal creativity, workflows, and more
git clone https://github.com/Haervwe/open-webui-tools.git -
ai-moive-studio
Agents & frameworks自然语言驱动的无限画布工作流 Agent,让 AI 视频创作第一次真正变成可编辑的工作流。 AICON 面向创作者,提供从剧本拆解、分镜生成、素材生成、视频合成到内容分发的一整套能力。 不是只给你一个输入框,而是让你用自然语言和无限画布一起驱动创作,把文本、图片、视频节点组织成完整链路,真正把“从灵感到 成片”放进一个系统里完成。
git clone https://github.com/869413421/ai-moive-studio.git -
ChatSim
Agents & frameworks[CVPR2024 Highlight] Editable Scene Simulation for Autonomous Driving via LLM-Agent Collaboration
git clone https://github.com/yifanlu0227/ChatSim.git -
roubao
Agents & frameworksAndroid Automation Tool Based on Vision-Language Models
git clone https://github.com/Turbo1123/roubao.git -
ai-agent-book
Agents & frameworks《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码
git clone https://github.com/bojieli/ai-agent-book.git -
Interactive-LLM-Powered-NPCs
Agents & frameworksInteractive LLM Powered NPCs, is an open-source project that completely transforms your interaction with non-player characters (NPCs) in any game! 🎮🤖🚀
git clone https://github.com/AkshitIreddy/Interactive-LLM-Powered-NPCs.git -
VisualAgentBench
Agents & frameworksTowards Large Multimodal Models as Visual Foundation Agents
git clone https://github.com/THUDM/VisualAgentBench.git -
CaPtain
Agents & frameworksCaPtain: A Pipeline for Post-Training Code-as-Policy Robot Agents — CaPtain-Harness, SFT and RL training code, benchmark adapters
git clone https://github.com/waltstephen/CaPtain.git -
antfly
Agents & frameworksgit clone https://github.com/antflydb/antfly.git -
ruby_llm
Agents & frameworksThe Ruby AI framework.
git clone https://github.com/crmne/ruby_llm.git -
Awesome-CUA
Agents & frameworksOpen, source-backed catalog of computer-use agents: reviewed papers, GUI models, datasets, benchmarks, tools, and reusable JSONL/SQLite data.
git clone https://github.com/reacher-z/Awesome-CUA.git
Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.