Multimodal Generation

Ask about this topic

Momentum

22 papers in the last four weeks, up 175% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 135

All topics
CardsList

  1. Wasserstein Gradient Flows and Forward-Only Diffusion Are Not Enough for Multimodal Sampling

    Oct 1, 2026Daniel McBride, Pratik Khandagale, Cristina Garcia-Cardona +1Wasserstein Gradient FlowsLatent Transport

    Los Alamos National Laboratory, Los Alamos, NM 87545, USA

  2. Form and Void: Entangled Composition through an Autonomous AI Agent

    Oct 1, 2026Shiwen Wang, Jian Yang, Xu Wang +2Visual GenerationMultimodal Generation

    School of AI, University of Chinese Academy of Sciences · Renmin University of China · Shanghai Theatre Academy +1

  3. Personalized Image Generation with Reasoning and Reflection

    Sep 30, 2026Bo Ni, Ngoc N. Tran, Qinwen Ge +10Image GenerationPersonalization

    Vanderbilt University · Adobe Systems · University of Maryland, College Park +1

  4. ScaffoldM3C: A Multimodal Sequential Monte Carlo Framework for Generative Stable Construction Planning

    Sep 30, 2026Gadiel Sznaier Camps, Chengyang He, Guillaume Sartoretti +2ScaffoldsAssembly

    Multi-robot Systems Lab (MSL), Stanford University, Stanford, CA, USA · Multi-Agent Robotic Motion Lab (MARMot), National University of Singapore, Singapore · Perception-Oriented Control Team (POC), Universidad de Zaragoza, Zaragoza, Spain

  5. EvoGen-Harness: Learning Where and How to Evolve Image-Generation Harnesses

    Sep 30, 2026Jiabin Luo, Yinan Liu, Chunlei Meng +1Multi-Reference Image GenerationMultimodal Generation

    Peking University · Beijing University of Technology · Fudan University

  6. VIF-Bench: Evaluating Visual Instruction Following in Multi-Reference Image Generation

    Sep 29, 2026Yuta Oshima, Masakazu Yoshimura, Masahiro Suzuki +2Multi-Reference Image GenerationMultimodal Generation

    The University of Tokyo

  7. What Comes Next? Omni-StoryBench for Evaluating Story-Grounded Omnimodal Generation

    Sep 29, 2026Sieun Hyeon, Yejoon Lee, Mintaek Lim +3Omni-ModalMultimodal Generation

    AIDAS Laboratory, 1ECE & 2IPAI, Seoul National University

  8. Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generation

    Sep 29, 2026Xingtong Ge, Yutong Wang, Lunjie Zhu +7Audio-Video GenerationFew-Step Generation

    The Hong Kong University of Science and Technology · Vivix Group Limited · The University of Sydney +1

  9. Trajectory-Level Mode Guidance for Controllable Diffusion-Based Multi-Robot Motion Planning

    Sep 29, 2026Tianyou Yu, Shengze Cai, Chao XuDiffusion PlanningMulti-Robot Motion Planning

    Institute of Cyber-System and Control, College of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China

  10. FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planning

    Sep 28, 2026Ziyao Huang, Zhengkun Rong, Shiyang Qin +5Human Motion GenerationMultimodal Generation

    Bytedance Intelligent Creation

  11. ORAV: Benchmarking Audio-Video Generation from Multimodal Contexts

    Sep 28, 2026Jiacheng Hua, Xiaokun Feng, Jiaqi Hua +3Audio-Video GenerationMultimodal Generation

    College of AI, Tsinghua University · Tencent Hy

  12. Joint and Cross-Modal Video-Audio Generation and Editing: A Unified Formulation and Design Taxonomy

    Sep 28, 2026Abhinav Sharma, Sai Karthik Navuluru, Wang Wei +21Audio-Video GenerationAudio-Visual Consistency

    University of Massachusetts Amherst · University of Texas at Dallas · Virginia Tech +10

  13. SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation

    Sep 27, 2026Jiali Chen, Zhengteng Lin, Zuqi Wang +6Scientific FigureReference-Guided Multimodal In-Context Verification

    South China University of Technology, The Hong Kong Polytechnic University · South China University of Technology · The Hong Kong Polytechnic University

  14. Beyond Emotion Prompts: Fine-Grained Text-to-Image Generation Driven by Valence-Arousal-Dominance

    Sep 21, 2026Minglang Li, Yueyue Fang, Xieping GaoLarge-Scale Image DatasetsEmotion Recognition

    College of Information Science and Engineering Hunan Normal University, Changsha, China

  15. A Multi-Modal Generative Model for Tomato Disease Leaves Understanding

    Sep 17, 2026Khang Nguyen Quoc, Minh-Phuoc Tran, Gia-Han Truong +1Tomato DiseasesMultimodal Clinical Data

  16. NeMo Data Designer: An Extensible Framework for Multimodal Synthetic Data Generation

    Sep 15, 2026Johnny Greco, Nabin Mulepati, Andre Manoel +8Synthetic DataMultimodal Generation

    NVIDIA

  17. LynnReal-Omni: Native multi-modal Video Generation for Agentic Visual Workflows

    Sep 14, 2026Xiaofeng Mao, Peijia Lin, Shaohao Rui +3Interactive Video GenerationVideo Generation

    LynnReal AI

  18. One Model, Two Physical Stories: Auditing Misalignment in Multi-Modal World Modeling

    Sep 13, 2026Geigh Zollicoffer, Minh Vu, Rajiv Ranasinghe +1Cross-Modal ConflictsMultimodal Model

    1Theoretical Division, Los Alamos National Laboratory · 2Computing and Artificial Intelligence Division, Los Alamos National Laboratory · 3Earth and Environmental Sciences Division, Los Alamos National Laboratory

  19. Multi-Modal Controlled Coherent Motion Generation

    Sep 11, 2026Yifei Liu, Qiong Cao, Hongwei Yi +2Human Motion GenerationMultimodal Generation

    South China University of Technology · Joy Future Academy · Peking University

  20. UFO: Chain-of-Evaluation for Omni-Condition Alignment in Multi-Modal Image Generation

    Sep 11, 2026Danning Zhang, Yijing Lin, Shuhan Zhuang +4Multimodal GenerationMulti-Reference Image Generation

    University of Science and Technology of China · Independent Rsesearcher · Shenzhen University +1

  21. Dreaming in Flow: Generative Grounding Feedback for Self-Evolving Unified Multimodal Models

    Sep 8, 2026Ke Hao, Yuanzhi Liang, Tingxi Chen +5Multimodal GenerationMultimodal Model

    Shanghai Jiao Tong University, Shanghai, China · Institute of Artificial Intelligence, China Telecom (TeleAI), Shanghai, China · University of Science and Technology of China, Hefei, China

  22. The Price of Consistency: Exploiting Visual Anchors for Multimodal Jailbreaking in Video Generation

    Sep 7, 2026Peng Li, Qianqian Xu, Yangbangyan Jiang +2Generative Video ModelsVideo Generation

    School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China · State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence and Robotics, Hunan University, Changsha, China +1

  23. Who Drives the Probability Game of VLMs? A Temporal Causal Drive Evaluation Framework

    Sep 2, 2026Shuyao Xiao, Shengling Wang, Haoyu Niu +4Multimodal GenerationAutoregressive Decoding

    College of Artificial Intelligence, Beijing Normal University · Kuaishou Technology

  24. DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution

    Aug 31, 2026Jiashu Zhu, Yanhao Zheng, Ruitian Tian +7Audio-Video GenerationMultimodal Generation

    DreamX Team, Alibaba Group

  25. GarmentWeaver: Schema-Aware Structured Synthesis for Multimodal Sewing Patterns

    Aug 31, 2026Yinwen Lu, Weihao Luo, Yueqi ZhongSewingGarments

    Donghua University · College of Textiles · Shanghai, China +3

  26. Beyond Attention Masks: Instruction Anchoring for Efficient In-Context Diffusion Generation

    Aug 21, 2026Yangshuai Liu, Zheming Li, Jiaao Li +4Diffusion TransformersMultimodal Generation

    Harbin Institute of Technology · KlingAI Research

  27. From Visual Widgets to UI Code: Efficient Tool-Grounded Generation

    Aug 12, 2026Houston H. Zhang, Tao Zhang, Li Gu +5Image-To-Code GenerationGenerative User Interface

    McMaster University · University of Toronto · Concordia University

  28. CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation

    Aug 12, 2026Haowei Lou, Hye-Young Paik, Dai Jia +2Singing Voice ConversionMultimodal Generation

    UNSW Sydney · Dolby Laboratories

  29. MRIComp4Flow: Compression of 3D Brain MRI for Training Multi-Modal Generative Models

    Aug 10, 2026Lisa K. Fischer, Mykhailo Riabets, Daniel Rueckert +3Magnetic Resonance Imaging DatasetMedical Image Generation

    Technical University of Munich (TUM), Germany · Chair for AI in Healthcare and Medicine, TUM and TUM University Hospital, Munich, Germany · Imperial College London +4

  30. Towards Expressive and Faithful Audio-to-Image Generation: A Unified Multimodal Dataset and Synthesis Framework

    Aug 10, 2026Dongxu Ge, Shansong Liu, Cheng Gong +3Audio-Video GenerationMultimodal Generation

    University of Science and Technology of China Hefei, China · Institute of Artificial Intelligence, China Telecom (TeleAI) Beijing, China · Northwest Polytechnical University Xi’an, China

  31. Aero Realtime: Fully Aligned Input-Output Streams for Low-Latency Streaming Multimodal Generation

    Aug 9, 2026Kaichen Zhang, Wei Huang, Keming Wu +2Multimodal GenerationStreaming

    1The University of Hong Kong · 2LMMs-Lab · 3Tsinghua University

  32. Surg-UniWorld: A Unified Surgical World Model with Multimodal Control Experts

    Aug 7, 2026Rulin Zhou, Wanhao Liu, Guoheng Ma +8Surgical VideosVideo World Models

    Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR 999077, China · Shenzhen Loop Area Institute, Shen Zhen 518055, China · School of Electrical and Computer Engineering, Faculty of Engineering, the University of Sydney, Sydney, NSW 2006, Australia

  33. Vorch-Omni: Multi-Task Orchestration of Sight and Sound

    Aug 6, 2026Vorch Team, Xiaoyu Chen, Yang Ding +25Audio-Video GenerationGenerative Video Models

  34. ToolArtist: Tool-Using Unified Multimodal Models for Agentic Image Generation

    Aug 5, 2026Jiahao Zhao, Xiaomin Yu, Zhongxiang Sun +5Image GenerationMultimodal Generation

    1RUC · 2HKUST(GZ) · 3NUS +1

  35. UniWorld-Design: From Pixel Generation to Layer-Native Design

    Aug 4, 2026Zongjian Li, Zhiyuan Yan, Chenxu Bai +9Image GenerationMultimodal Generation

    UniWorld Team1,2∗

  36. PosterMELD: Multi-Agent Paper-to-Poster Generation for Controllable Design Diversity with Editable Print-Ready Outputs

    Aug 3, 2026Haojie Hu, Chenhao Dang, Yaojia Liu +3Multimodal Generation

    Tsinghua Shenzhen International Graduate School, Tsinghua University · Tongji University · Shanghai Jiao Tong University +2

  37. MoRoute: Dynamic Routing for In-Context Multimodal Video Generation

    Jul 31, 2026Chong Gao, Jie Ma, Zhan Peng +5Interactive Video GenerationMultimodal Generation

    Sun Yat-sen University · Orange Team, Moku Lab, HUJING Digital Media & Entertainment Group · Huazhong University of Science and Technology

  38. JarvisHub: An Open Harness for Canvas-Native Multimodal Creative Agents

    Jul 26, 2026Yunlong Lin, Zixu Lin, Zhaohu Xing +23Multimodal AgentsCreativity

  39. M3^3-Gen: Interpretable Multimodal Generation of Gene Expression Profiles Using Clinical and Imaging Data

    Jul 23, 2026Francesca Pia Panaccione, Carlo Sgaravatti, Marco VenereMultimodal Clinical DataTranscriptomics

    DEIB - Dipartimento Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Milan, 20133, Italy

  40. ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis

    Jul 21, 2026Yuan Wang, Yongchao Du, Mengting Chen +4Multimodal Reasoning BenchmarksVisual Generation

    1Alibaba Group · 2Tsinghua University · 3Johns Hopkins University‌

  41. FlowMimic: Mask-free Visual Editing and Generation with Pixel-pair Warped Flow Field for Online Video Editing Data Generation and Modality Mimicry

    Jul 20, 2026Dingyun Zhang, Lixue Gong, Wei LiuVideo EditingLong Video Generation

    1ByteDance

  42. StructGen: Disambiguating Multi-Reference Image Generation via Structured Context Modeling

    Jul 17, 2026Jianing Peng, Mengyu Wang, Henghui Ding +6Multi-Reference Image GenerationMultimodal Generation

    Institute of Information Science, Beijing Jiaotong University, Beijing, China · Visual Intelligence + X International Joint Laboratory of the Ministry of Education, Beijing, China · MT Lab, Meitu Inc, Beijing, China +2

  43. VQ-Touch: A Data-Efficient Tactile Generation Framework Across Sensors and Scenarios

    Jul 16, 2026Kailin Lyu, Long Xiao, Jianing Zeng +3TactileContact-Rich Dexterous Manipulation

    Institute of Automation, Chinese Academy of Sciences

  44. MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generation

    Jul 15, 2026Xiaohan Zhang, Yuqing Wen, Junlin Chen +9Audio-Video GenerationAudio-Visual Consistency

    Nanjing University · Kling Team · National University of Singapore +3

  45. Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes

    Jul 14, 2026Minh-Quan Le, Armand Comas, Alexandros Lattas +7Multimodal GenerationMulti-Reference Image Generation

    Google · Stony Brook University · Google DeepMind

  46. Boogu-Image-0.1: Boosting Open-Source Unified Multimodal Understanding and Generation

    Jul 14, 2026Guoxuan Chen, Chufeng Xiao, Haoran Yang +30Modern Text-To-Image ModelsText-To-Image

    Boogu Team

  47. SymbOmni: Evolving Agentic Omni Models via Symbolic Concept Learning

    Jul 13, 2026Jinxiu Liu, Jianru Li, Tanqing Kuang +4Visual GenerationMultimodal Generation

    South China University of Technology · Westlake University · Johns Hopkins University +2

  48. Latent graph encoding of multimodal neuroimaging features with generative AI architectures

    Jul 8, 2026Ishaan Batta, Meenu Ajith, Vince CalhounMultimodal NeuroimagingFunctional Magnetic Resonance Imaging

    Center for Translational Research in Neuroimaging and Data Science (TReNDS): Georgia State University, Georgia Institute of Technology, and Emory University, Atlanta, USA

  49. Vision as Unified Multimodal Generation

    Jul 7, 2026Xiaoyang Han, Jianhua Li, Kewang Deng +14Multimodal GenerationComputer Vision

    SenseTime Research · Peking University · Shanghai Jiao Tong University +3

  50. Light-Omni: Reflex over Reasoning in Agentic Video Understanding with Long-Term Memory

    Jul 6, 2026Chang Nie, Jiaju Wei, Junlan Feng +2Video AgentMultimodal Agents

    Nanjing University

  51. CanvasAgent: Enabling Complex Image Creation and Editing via Visual Tool Orchestration

    Jul 6, 2026Hairui Zhu, Yiying Yang, Tengjin Weng +5Multimodal AgentsMultimodal Generation

    Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) Shenzhen, China

  52. Attending to Multimodal Generation One Token at a Time

    Jul 4, 2026Varun Gupta, Vineet Gandhi, Makarand TapaswiMultimodal Large Language ModelsMultimodal Generation

    CVIT, IIIT Hyderabad

  53. PedestrianDiffusion: Multimodal Generative Denoising and Dense State Estimation for Inertial Navigation

    Jul 3, 2026I-Hao Lu, Dongsoo HanInertial Navigation SystemsState Estimation

  54. InterCMDM: Block-Causal Diffusion for Autoregressive Human Interaction Generation

    Jul 2, 2026Qing Yu, Kent FujiwaraHuman Motion GenerationAutoregressive Diffusion

    LY Corporation, Tokyo, Japan

  55. Illuminating Unified Multimodal Model for Free-form Interleaved Text-Image Generation

    Jun 29, 2026Chonghuinan Wang, Zhikai Chen, Chunwei Wang +9Multimodal Generation

    Harbin Institute of Technology, Harbin, China · Huawei Noah’s Ark Lab, Shenzhen, China · Zhengzhou Advanced Research Institute of Harbin Institute of Technology, Zhengzhou, China +1

  56. SICAGE: Speaker-Independent Culture-Aware Gesture Generation using TED4C-L Dataset

    Jun 29, 2026Ariel Gjaci, Antonio Sgorbissa, Vittorio MurinoCo-Speech Gesture GenerationMultimodal Generation

    Italian Institute of Technology, Genoa, Italy · University of Genoa, Genoa, Italy

  57. Mural: Transferring LLM knowledge to image generation via Mixture-of-Transformers

    Jun 27, 2026Achin Jain, Jie An, Siddharth Chaudhary +1Modern Text-To-Image ModelsImage Generation

    Amazon AGI

  58. Ask, Solve, Generate: Self-Evolving Unified Multimodal Understanding and Generation via Self-Consistency Rewards

    Jun 25, 2026Ritesh Thawkar, Shravan Venkatraman, Omkar Thawakar +5Multimodal GenerationLarge Multimodal Models

    1Mohamed bin Zayed University of Artificial Intelligence · 4Linköping University · 3Australian National University +1

  59. LCG: Long-Context Consistent Image Generation with Sparse Relational Attention

    Jun 24, 2026Zihao Wang, Yijia Xu, Haoze Zheng +3Multi-Reference Image GenerationText-To-Image

    Huazhong University of Science and Technology, China · Peking University, China · Hong Kong University of Science and Technology, Hong Kong

  60. IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation

    Jun 23, 2026Zixuan Li, Haokun Lin, Yicheng Xiao +10Multi-Reference Image GenerationText-To-Image

    NLPR, Institute of Automation, Chinese Academy of Sciences · The University of Hong Kong · Ant Group