InnerVault

Library

85,340 resources from 11 public sources. 54 checked by hand; the rest are unreviewed.

Results

  1. 🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

    Stale GitHub, YingqingHe 551 ★Updated 6 days ago

    git clone https://github.com/YingqingHe/Awesome-LLMs-meet-Multimodal-Generation.git
  2. mmagic

    AI repositories

    OpenMMLab Multimodal Advanced, Generative, and Intelligent Creation Toolbox. Unlock the magic 🪄: Generative-AI (AIGC), easy-to-use APIs, awsome model zoo, diffusion models, for text-to-image generation, image/video restoration/enhancement, etc.

    Stale GitHub, open-mmlab 7,474 ★Apache-2.0Updated 2 years ago

    git clone https://github.com/open-mmlab/mmagic.git
  3. Janus

    AI repositories

    Janus-Series: Unified Multimodal Understanding and Generation Models

    Stale GitHub, deepseek-ai 17.8k ★MITUpdated 21 months ago

    git clone https://github.com/deepseek-ai/Janus.git
  4. SimpleMem

    AI repositories

    [ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal

    Stale GitHub, aiming-lab 3,832 ★MITUpdated 3 months ago

    git clone https://github.com/aiming-lab/SimpleMem.git
  5. OmAgent

    AI repositories

    [EMNLP-2024] Build multimodal language agents for fast prototype and production

    Stale GitHub, om-ai-lab 2,669 ★Apache-2.0Updated 31 days ago

    git clone https://github.com/om-ai-lab/OmAgent.git
  6. awesome-japanese-llm

    AI repositories

    日本語LLMまとめ - Overview of Japanese LLMs

    Stale GitHub, llm-jp 1,446 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/llm-jp/awesome-japanese-llm.git
  7. PixelRAG

    AI repositories

    https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/

    Stale GitHub, StarTrail-org 10.9k ★Apache-2.0Updated 5 days ago

    git clone https://github.com/StarTrail-org/PixelRAG.git
  8. pixeltable

    AI repositories

    The backend agents build with - Multimodal database, orchestration, and serving in one file

    Indexed GitHub, pixeltable 1,662 ★Apache-2.0Updated 2 days ago

    git clone https://github.com/pixeltable/pixeltable.git
  9. vectordb-recipes

    AI repositories

    Resource, examples & tutorials for multimodal AI, RAG and agents using vector search and LLMs

    Stale GitHub, lancedb 986 ★Apache-2.0Updated 12 days ago

    git clone https://github.com/lancedb/vectordb-recipes.git
  10. deeplake

    AI repositories

    Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.

    Stale GitHub, activeloopai 9,251 ★Apache-2.0Updated 5 months ago

    git clone https://github.com/activeloopai/deeplake.git
  11. LLaVA-OneVision-2

    AI repositories

    Fully Open Framework for Democratized Multimodal Training

    Stale GitHub, EvolvingLMMs-Lab 1,232 ★Apache-2.0Updated 7 days ago

    git clone https://github.com/EvolvingLMMs-Lab/LLaVA-OneVision-2.git
  12. awesome-vla-for-ad

    AI repositories

    🌐 Vision-Language-Action Models for Autonomous Driving: Past, Present, and Future

    Stale GitHub, worldbench 524 ★MITUpdated 10 days ago

    git clone https://github.com/worldbench/awesome-vla-for-ad.git
  13. screenpipe

    AI repositories

    YC (S26) | Open Computer History | Continuously record your company computer work, map your workflows, help you find work worth automating, and power your agents' context

    Indexed GitHub, screenpipe 22.4k ★Custom licence (see repository)Updated 2 days ago

    git clone https://github.com/screenpipe/screenpipe.git
  14. NVIDIA AI Blueprint for video search and summarization (VSS) is a GPU-accelerated reference architecture for building video analytics agents with real-time verified alerts, visual Q&A, and automated reporting. The VSS Blueprint uses vision language models (VLMs) such as NVIDIA Cosmos, LLMs such as NVIDIA Nemotron, RAG, and NVIDIA NIMs.

    Indexed GitHub, NVIDIA-AI-Blueprints 1,986 ★Apache-2.0Updated today

    git clone https://github.com/NVIDIA-AI-Blueprints/video-search-and-summarization.git
  15. GIMP-ML

    AI repositories

    AI for GNU Image Manipulation Program

    Stale GitHub, kritiksoman 1,556 ★MITUpdated 9 days ago

    git clone https://github.com/kritiksoman/GIMP-ML.git
  16. vllm-mlx

    AI repositories

    High-performance OpenAI and Anthropic compatible LLM inference server for Apple Silicon. Native MLX, continuous batching, multimodal models, MCP tool calling, and Claude Code support.

    Stale GitHub, waybarrios 1,646 ★Apache-2.0Updated 11 days ago

    git clone https://github.com/waybarrios/vllm-mlx.git
  17. InternVL

    AI repositories

    [CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型

    Stale GitHub, OpenGVLab 10.2k ★MITUpdated 14 months ago

    git clone https://github.com/OpenGVLab/InternVL.git
  18. proper-pixel-art

    AI repositories

    Fixes AI pixel art images, video, or sprite web uploads

    Stale GitHub, KennethJAllen 593 ★MITUpdated 15 days ago

    git clone https://github.com/KennethJAllen/proper-pixel-art.git
  19. t2v_metrics

    AI repositories

    Evaluating text-to-image/video/3D models with VQAScore

    Stale GitHub, linzhiqiu 603 ★Apache-2.0Updated 5 months ago

    git clone https://github.com/linzhiqiu/t2v_metrics.git
  20. star-vector

    AI repositories

    StarVector is a foundation model for SVG generation that transforms vectorization into a code generation task. Using a vision-language modeling architecture, StarVector processes both visual and textual inputs to produce high-quality SVG code with remarkable precision.

    Stale GitHub, joanrod 4,622 ★Apache-2.0Updated 12 months ago

    git clone https://github.com/joanrod/star-vector.git
  21. Cradle

    AI repositories

    The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

    Stale GitHub, BAAI-Agents 2,594 ★MITUpdated 2 years ago

    git clone https://github.com/BAAI-Agents/Cradle.git
  22. transformers

    AI repositories

    🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

    Indexed GitHub, huggingface 169.0k ★Apache-2.0Updated today

    git clone https://github.com/huggingface/transformers.git
  23. LocalAI

    AI repositories

    LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

    Indexed GitHub, mudler 50.4k ★MITUpdated today

    git clone https://github.com/mudler/LocalAI.git
  24. VAR

    AI repositories

    [NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

    Stale GitHub, FoundationVision 8,753 ★MITUpdated 12 months ago

    git clone https://github.com/FoundationVision/VAR.git

Indexed entries aren't reviewed or tested by InnerVault. Details come straight from each source. Anything that can reach your accounts, files or browser can do damage, so read the source before you install it.