Multimodal Video Generation

Latest papers

CardsList

34 papers6 papers in the last four weeks, up 20% on the four weeks before. 0.0% of all new papers.

  1. JVT: Just Video Transformer makes pixel-space video diffusion simple

    Nov 13, 2026Jianjun Zhou, Hua Geng, Haoyu GuoVideo Diffusion ModelsPixel-Space Diffusion Models

  2. PhysLoop: Harnessing LLMs' Physics Awareness for Self-Improving Video Generation Models

    Nov 12, 2026Yuxuan Chen, Xiaojie Li, Hao Chen +11Video GenerationPhysical Consistency in Video Generation

  3. UGG: Unified Generative Geometry Model

    Nov 10, 2026Amani Kiruga, Zhiyi Li, Ruojin Cai +44D Scene UnderstandingCamera Pose Estimation

  4. OmniOPD: Stable On-Policy Distillation for Joint Audio-Video Generation

    Nov 2, 2026Zihao Fan, Xin Lu, Jie Huang +3Audio-Video GenerationOn-Policy Distillation

  5. Seeing and Imagining as One: Unified Video Generation and 4D Perception for Embodied World Modeling

    Oct 29, 2026Haitang Feng, Zhuoman Liu, Zhennan Wang +5Embodied World ModelsMultimodal Video Generation

  6. Making MLLM Latents Matter: Factor-Aware Predictive Learning for Cinematic Video Generation

    Oct 22, 2026Songlin Yang, Zhe Wang, Xiaotong Zhao +8Multimodal Video GenerationVideo Generation

  7. Drive2Gauss: FeedForward 4D Gaussian Reconstruction from Multimodal Generative Driving Videos

    Oct 19, 2026Tong Zhao, Zhiyuan Han, Lin Chen +10Multimodal Video GenerationDynamic Scene Reconstruction

  8. ProactGen: Learning Proactive Clarification for Video Generation

    Oct 15, 2026Zhixiao Wang, Yang Chen, Yifan Xu +5Video GenerationMultimodal Video Generation

  9. PreCoG: Preview-Edit for Efficient Video Correction in Generation-Time

    Oct 9, 2026Yilai Liu, Wenqi Pei, Zhifeng Lu +3Efficient Video GenerationT2V Generation

  10. Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generation

    Sep 29, 2026Xingtong Ge, Yutong Wang, Lunjie Zhu +7Streaming Video GenerationVideo Diffusion Models

  11. DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution

    Aug 31, 2026Jiashu Zhu, Yanhao Zheng, Ruitian Tian +7Audio-Video GenerationVideo Diffusion Models

  12. Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation

    Aug 14, 2026Yanbo Ding, Yijia Fan, Caihua Shan +8Multimodal Video GenerationT2V Generation

  13. Ex-Omni-2D: Expressive Omni-Modal Dialogue Models with Native Visual Presence

    Aug 11, 2026Haoyu Zhang, Zhipeng Li, Xiaoying Tang +2Audio-Video GenerationStreaming Video Generation

  14. MoRoute: Dynamic Routing for In-Context Multimodal Video Generation

    Jul 31, 2026Chong Gao, Jie Ma, Zhan Peng +5Video Diffusion ModelsMultimodal ICL

  15. DramaDirector: Geometry-Guided Short Drama Generation

    Jun 23, 2026Hengji Zhou, Sijie Liu, Jianrun Chen +3T2V GenerationVideo Generation

  16. LoomVideo: Unifying Multimodal Inputs into Video Generation and Editing

    Jun 4, 2026Jianzong Wu, Hao Lian, Jiongfan Yang +12Video Diffusion ModelsVideo Editing

  17. Bernini: Latent Semantic Planning for Video Diffusion

    May 21, 2026Bernini Team, Chenchen Liu, Junyi Chen +9Video Diffusion ModelsUnified Multimodal Models

  18. Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaboration

    May 17, 2026Yiren Song, Huilin Zhong, Kevin Qinghong Lin +2Temporal Consistency in Video GenerationMulti-Shot Video Generation

  19. Divide and Conquer: Decoupled Representation Alignment for Multimodal World Models

    May 3, 2026Junyuan Xiao, Dingkang Liang, Xin Zhou +9World ModelsCross-Modal Alignment

  20. Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling

    Apr 26, 2026Zhen Ye, Xu Tan, Aoxiong Yin +8Talking Head GenerationAudio-Video Generation

  21. Uni-ViGU: Towards Unified Video Generation and Understanding via A Diffusion-Based Video Generator

    Apr 9, 2026Luozheng Qin, Jia Gong, Qian Qiao +6Unified Multimodal ModelsVideo Generation

  22. OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning

    Mar 25, 2026Kaihang Pan, Qi Tian, Jianwei Zhang +12Multimodal GenerationVideo Generation