Multimodal Diffusion Models

Ask about this topic

Momentum

3 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 35

All topics
CardsList

  1. Gestalt: Large Multimodal Interplay Model

    Sep 30, 2026Zequn Yang, Yu Miao, Haotian Ni +8Multimodal ModelMultimodal Diffusion Models

    Gaoling School of Artificial Intelligence, Renmin University of China · Beijing Key Laboratory of Research on Large Models and Intelligent Governance · Beihang University +3

  2. Synchronous Multi-view Neural Diffusion

    Sep 30, 2026Yongquan Shi, Weijun Huang, Yueyang Pi +3Multimodal Diffusion ModelsGlobal-Local Fusion Framework

  3. StreetDiff: Multi-view Street Scenes Generation via Cross-view Consistent Multi-view Stable Diffusion with Structure Prompts

    Sep 9, 2026Qi Zhang, Yanyifan Wang, Weiyuan Zhang +1Cross-ViewVideo Diffusion Models

    College of Computer Science and Software Engineering, Shenzhen University, China

  4. Differentially Private Paired Table-Image Multimodal Synthesis

    Sep 1, 2026Kai Chen, Josephine Lamp, Somesh Jha +1Synthetic Tabular DataMedical Image Generation

    University of Virginia · Dexcom · University of Wisconsin-Madison

  5. Toward a Foundation Plug-and-Play Prior for Computed Tomography Reconstruction via a Multimodal Diffusion Model

    Aug 24, 2026Haley Duba-Sullivan, Patxi Fernandez-Zelaia, Obaidullah Rahman +1Cone-Beam Computed TomographyDiffusion Priors

    Oak Ridge National Laboratory Oak Ridge, TN, USA

  6. Dual Modality Prompted Diffusion Priors for Zero Shot Hyperspectral Pansharpening

    Aug 12, 2026Pengwei Xie, Fei Zhu, Jiajun Li +4Hyperspectral ImageMultimodal Diffusion Models

    School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China · School of GeoAI and Hinton STAI Institute, and the Key Laboratory of Geographic Information Science (Ministry of Education), East China Normal University, Shanghai 200241, China · Peking University, Beijing 100871, China +3

  7. CSGen: A Multi-Domain Curvilinear Structure Generation Model via Hierarchical Multimodal Diffusion

    Aug 5, 2026Zhe Shan, Ziming Yang, Lei Zhou +3Multimodal Diffusion ModelsMotion Generation

    Hainan University Haikou, China · Guangdong Ocean University Zhanjiang, China

  8. MTVDiff: Multimodal Conditional Latent Diffusion for Enhanced Thermal-to-Visible Face Translation

    Jul 22, 2026Zhiyuan Xia, Haojie Li, Jingyu Lin +2Multimodal Diffusion Models

    School of Computer Science and Engineering, Southeast University, Nanjing, China · Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China · Monash University, Australia

  9. Rarity-Aware Discrete Diffusion with Spatially Consistent Decoding for Photo-Realistic Image Super-Resolution

    Jul 20, 2026Ao Li, Yapeng Du, Yi Xin +5Real-World Image Super-ResolutionMultimodal Diffusion Models

    University of Electronic Science and Technology of China · 2Nanjing University · 3The Hong Kong University of Science and Technology (Guangzhou) +2

  10. Asynchronous Multimodal Diffusion Policy Composition via Latency-Aware Guidance Fusion

    Jul 19, 2026Zihao He, Hongjie Fang, Shirun Tang +2Diffusion PoliciesMultimodal Diffusion Models

    Shanghai Jiao Tong University · Noematrix · Shanghai Innovation Institute +1

  11. Multimodal 3D LUT Generation via StatLUT with Statistical Features for Photorealistic Style Transfer

    Jul 9, 2026Yifan Wang, Zhixiang Hao, Yu Wang +1Photorealistic Style TransferMultimodal Diffusion Models

    Honor Device Co., Ltd.

  12. Straight-Path Flow Matching for Incomplete Multi-View Clustering

    Jul 7, 2026Yiteng Yuan, Junyan Wang, Zheyuan Liu +4Multi-ViewConditional Flow Matching

    School of Software Engineering, Huazhong University of Science and Technology, Wuhan, China · Australian Institute for Machine Learning, Adelaide University, Adelaide, Australia · University of Auckland, Auckland, New Zealand +2

  13. Editing Everything Everywhere All at Once

    Jun 30, 2026Fabio Quattrini, Carmine Zaccagnino, Enis Simsar +4Precise EditingEdit

    University of Modena and Reggio Emilia · ETH Zurich · Google

  14. Spatio-Temporal Mixture-of-Modality-Experts Diffusion for Quantitative DCE-MRI Synthesis from Incomplete MR Sequences

    Jun 24, 2026Junhyeok Lee, Kyu Sung ChoiMedical Image GenerationMultimodal Diffusion Models

    Interdisciplinary Program in Cancer Biology, Seoul National University College of Medicine · Department of Radiology, Seoul National University Hospital · Department of Radiology, Seoul National University College of Medicine +1

  15. Modular Diffusion Models for Structured Visual Recognition

    Jun 21, 2026Siddhesh Khandelwal, Björn Ommer, Leonid SigalAmodal SegmentationMultimodal Diffusion Models

    Department of Compute Science, University of British Columbia · Vector Institute for AI · CompVis, Ludwig Maximilian University of Munich +2

  16. Physically-guided Image Generation for Multi-Projection Mapping

    Jun 21, 2026Xingyun Liu, Yuqi Li, Jinhui Xiang +2ProjectionMultimodal Diffusion Models

    Ningbo University, Ningbo, 315211 P.R.China.

  17. BindEdit: Taming Attention Leakage for Precise Multi-Object Image Editing

    Jun 17, 2026Chaewon Park, Soyoon Lee, Naeun Lee +3Diffusion-Based Image EditingImage Editing

    1Sookmyung Women’s University · 2Yonsei University · 3Samsung Research

  18. MUNI: Multimodal Unified Latent Diffusion for Coherent Any-to-Any Generation

    Jun 15, 2026Kyeongmin Yeo, Yunhong Min, Minhyuk SungMultimodal GenerationMultimodal Diffusion Models

    KAIST

  19. ParetoPilot: Zero-Surrogate Offline Multi-Objective Optimization via Infer-Perturb-Guide Diffusion

    Jun 3, 2026Ruiqing Sun, Sen Yang, Dawei Feng +3Multi-Objective OptimizationOptimal Design

    College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China · Bioinformatics Center of AMMS, Beijing 100080, China

  20. Wavelet-Fusion Diffusion Model for Multimodal Brain MRI Synthesis with Modality and Metadata Conditioning

    May 30, 2026Muhammad Nabi Yasinzai, Remika Mito, Mangor PedersenMedical Image GenerationMultimodal Diffusion Models

    Department of Psychology & Neuroscience, Auckland University of Technology, Auckland, New Zealand. · Department of Psychiatry, University of Melbourne, Melbourne, Victoria 3053, Australia. · Auckland University of Technology, Auckland, New Zealand.

  21. MIND: Multi-Scale Intent Diffusion for Text-Driven Physics-Based Humanoid Control

    May 25, 2026Bin Li, Ruichi Zhang, Han Liang +4Full-Body Humanoid ControlHuman Motion Generation

    ShanghaiTech University, China · University of Pennsylvania, USA · Bytedance Seed, China +3

  22. Visual-Redundancy-Controlled Parallel Decoding for Diffusion-Based Multimodal Large Language Models

    May 25, 2026Yulin Yuan, Hongshuo Zhao, Xiangming MengMultimodal Diffusion ModelsMultimodal Large Language Models

    Zhejiang University · ZJUI-UIUC Institute

  23. OMGTex: One-stage Multi-style Facial Texture Reconstruction without Geometry Guidance

    May 25, 2026Zitong Xiao, Yuda Qiu, Zisheng Ye +1Blind Face RestorationTexture

    School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen · Guangdong Provincial Key Laboratory of Future Networks of Intelligence · FNii-Shenzhen

  24. Don't Retrain, Just Reuse: Recovering Dual-Target Molecules from Single-Target Diffusion Models

    May 25, 2026Qingyuan Zeng, Pengxiang Cai, Zixin Guan +5MoleculesMoleculenet

    The Hong Kong University of Science and Technology (Guangzhou) · Guangzhou University of Chinese Medicine

  25. HierEdit: Region-Aware Hierarchical Diffusion for Efficient High-Resolution Editing

    May 17, 2026Yuyao Zhang, Alexander Huang-Menders, Yu-Wing TaiDiffusion-Based Image EditingImage Editing

    Dartmouth College

  26. Sketch Then Paint: Hierarchical Reinforcement Learning for Diffusion Multi-Modal Large Language Models

    May 16, 2026Siqi Luo, Jianghan Shen, Yi Xin +9Multimodal Diffusion ModelsHierarchical Reinforcement Learning

    1Shanghai Jiao Tong University · 2Shanghai Artificial Intelligence Laboratory · 3Nanjing University +2

  27. Multimodal synthesis of MRI and tabular data with diffusion in a joint latent space via cross-attention

    May 5, 2026Daniel Mensing, Jan Kapar, Jochen G. Hirsch +3Multimodal Diffusion ModelsMedical Image Generation

    Fraunhofer Institute for Digital Medicine MEVIS, Bremen, Germany · Leibniz Institute for Prevention Research and Epidemiology – BIPS, Bremen, Germany · Faculty of Mathematics and Computer Science, University of Bremen, Bremen, Germany +1

  28. UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priors

    May 1, 2026Houyuan Chen, Hong Li, Xianghao Kong +8Video Diffusion ModelsMultimodal Diffusion Models

    Beihang University, Beijing, China · Nanjing University, Nanjing, China · BAAI, Beijing, China +3

  29. The Thinking Pixel: Recursive Sparse Reasoning in Multimodal Diffusion Latents

    Apr 28, 2026Yuwei Sun, Yuxuan Yao, Hui Li +1Multimodal Diffusion ModelsDiffusion Models

    Shanghai Academy of AI for Science · Fudan University

  30. Multimodal Diffusion to Mutually Enhance Polarized Light and Low Resolution EBSD Data

    Apr 24, 2026Harry Dong, Timofey Efimov, Megna Shah +4Powder X-Ray DiffractionMultimodal Diffusion Models

    Department of Electrical and Computer Engineering, Carnegie Mellon University, USA · Materials and Manufacturing Directorate, Air Force Research Laboratory, USA · Department of Materials Science and Engineering, Carnegie Mellon University, USA +1

  31. WFM: 3D Wavelet Flow Matching for Ultrafast Multi-Modal MRI Synthesis

    Apr 22, 2026Yalcin Tur, Mihajlo Stojkovic, Ulas BagciMagnetic Resonance ImagingMultimodal Diffusion Models

    Department of Computer Science, Stanford University, Stanford, CA, USA · Machine and Hybrid Intelligence Lab, Feinberg School of Medicine, Northwestern University, Chicago, IL, USA

  32. Diff-SBSR: Learning Multimodal Feature-Enhanced Diffusion Models for Zero-Shot Sketch-Based 3D Shape Retrieval

    Apr 21, 2026Hang Cheng, Fanhe Dong, Long Zeng3D Generative ModelsSketches

    Tsinghua Shenzhen International Graduate School, Tsinghua University · Shenzhen, Guangdong, China

  33. Dress-ED: Instruction-Guided Editing for Virtual Try-On and Try-Off

    Mar 23, 2026Davide Lobba, Fulvio Sanguigni, Bin Ren +3GarmentsVirtual Try-On

    University of Trento, Italy · University of Modena and Reggio Emilia, Italy · MBZUAI, United Arab Emirates

  34. NAMD: Virtual Follow-up Computed Tomography Synthesis via Nodule-Aligned Multimodal Diffusion Models for Early Lung Cancer Diagnosis

    Mar 16, 2026James Song, Yifan Wang, Chuan Zhou +1Lung-Nodule Artificial IntelligenceCancer Detection

    University of Michigan · University of Michigan Medical School

  35. Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion

    Mar 6, 2026Lijiang Li, Zuwei Long, Yunhang Shen +6Multimodal Diffusion ModelsMultimodal Foundation Model

    Nanjing University · Tencent Youtu Lab · CASIA