Latent Diffusion Models

Follow this topic Ask about this topic

Momentum

9 papers in the last four weeks, up 13% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 143

All topics

Learning When to Denoise: Optimizing Asynchronous Schedules for Latent Diffusion
Jun 18, 2026Bingshuo Qian, Xiang ChengFlow Matching Latent Diffusion Models
Department of Electrical and Computer Engineering Duke University
BrainG3N: A Dual-Purpose Tokenizer for Controllable 3D Brain MRI Generation
Jun 17, 2026Max Van Puyvelde, Ibrahim Gulluk, Wim Van Criekinge +1Masked Autoencoders Latent Diffusion Models
Department of Biomedical Data Science, Stanford University School of Medicine · Department of Mathematical Modelling, Statistics & Bioinformatics, Ghent University · Department of Electrical Engineering, Stanford University
The Market in the Model: Latent Diffusion as Neural Economy
Jun 17, 2026Eryk SalvaggioLatent Diffusion Models Diffusion-Based Image Generation
Cambridge Digital Humanities, University of Cambridge · Machine Visual Culture Research Group, Max Planck Institute
MUNI: Multimodal Unified Latent Diffusion for Coherent Any-to-Any Generation
Jun 15, 2026Kyeongmin Yeo, Yunhong Min, Minhyuk SungLatent Diffusion Models Multimodal Generation
KAIST
Structure-Semantic Co-optimized Latent Diffusion Model for Fast Visual Anagram Synthesis
Jun 15, 2026Xiang Gao, Yunpeng JiaLatent Diffusion Models Image Generation
School of Digital Media and Design Arts Beijing University of Posts and Telecommunications
Smoothing Dark Areas in Molecular Latent Diffusion
Jun 11, 2026Xi Wang, Jiahan Li, Yuxuan Xia +3Variational Autoencoders Latent Diffusion Models
New York University · Stanford University
Diffusion Transformer World-Action Model for AV Scene Prediction
Jun 11, 2026Ruslan Sharifullin, Benjamin Jiang, Kai Xi ChewAction-Conditioned Video Generation Diffusion Transformer
Stanford University
VOID: Defeating Unauthorized Mimicry in Latent Diffusion Models
Jun 10, 2026Chunlin Qiu, Ang Li, Tianxiao Huang +7Latent Diffusion Models Image Generation
School of Cyber Science and Engineering, Wuhan University · School of Computer Science, Wuhan University · Institute for Math&AI, Wuhan University +2
Data assimilation for subsurface flow using latent diffusion model parameterization: performance of ensemble-Kalman and Monte Carlo techniques
Jun 9, 2026Guido Di Federico, Wenchao Teng, Louis J. DurlofskyMarkov Chain Monte Carlo Latent Diffusion Models
Department of Energy Science & Engineering, Stanford University, Stanford, CA, 94305, USA
Echo-DM: Ultrasound Marker Removal via Conditional Latent Diffusion and Region-Aware Fusion
Jun 8, 2026Zhiwei Wang, Tao Huang, Wentao Jiang +7Diffusion Models for Image Restoration Latent Diffusion Models
School of Computer Science, Wuhan University, China · The Central Hospital of Wuhan, China · School of Computer Science, Hubei University of Technology, China
Continuous Language Diffusion as a Decoder-Interface Problem
Jun 7, 2026Zhicheng Du, Lan MaLatent Diffusion Models Diffusion Language Model Decoding
Tsinghua Shenzhen International Graduate School, Tsinghua University
Bypassing Copyright Protection in Diffusion-based Customization via Two-Stage Latent Feature Optimization
Jun 6, 2026Ziang Xu, Wenbo Yu, Hongyao Yu +6Latent Diffusion Models Adversarial Attacks
Harbin Institute of Technology, Shenzhen Shenzhen, Guangdong, China · Tsinghua Shenzhen International Graduate School Shenzhen, Guangdong, China
TargetSEC: Plug-and-Play In-the-Wild Speech Emotion Conversion via Arousal-Conditioned Latent Style Diffusion
Jun 5, 2026Constantin Alexander AugaLatent Diffusion Models Audio Diffusion Models
Hasso Plattner Institute / University of Potsdam, Potsdam, Germany
ARAPDiffusion: ARAP Regularization for Diffusion-Based Deformable Shape Space Learning
Jun 5, 2026Haibo Liu, Jinghan Ke, Haitao Yang +3Latent Diffusion Models 3D Shape Generation
University of Texas at Austin · 2Westlake University
Reflection Separation from a Single Image via Joint Latent Diffusion
Jun 2, 2026Zheng-Hui Huang, Zhixiang Wang, Yu-Lun Liu +1Diffusion Models for Image Restoration Latent Diffusion Models
Shanda AI Research Tokyo · National Yang Ming Chiao Tung University · National Taiwan University
Diffusing in the Right Space: A Systematic Study of Latent Diffusability
Jun 2, 2026Tianxiong Zhong, Xingye Tian, Xuebo Wang +2Latent Diffusion Models Image Tokenization
Kling Team, Kuaishou Technology
Improving Combined Detection and Classification of TEM Defects via Mask-Conditioned Latent Diffusion Augmentation
Jun 1, 2026Ni Li, Nuohao Liu, Ryan Jacobs +5Synthetic Data Augmentation Latent Diffusion Models
University of Wisconsin-Madison, Madison, WI · University of Michigan-Ann Arbor, Ann Arbor, MI
DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Images
May 31, 2026Changyue Shi, Wangbo Yu, Chaoran Feng +1Latent Diffusion Models 3D Reconstruction
School of AI for Science, Peking University Shenzhen Graduate School, Shenzhen, 518055 China · School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Shenzhen, 518055 China
Data Enrichment for Symbolic Regression Using Diffusion Models
May 31, 2026Simon De Reuver, Tamas Kristof Toth, Teddy LazebnikPhysics-Informed Diffusion Models Physics-Informed Generative Modeling
Department of Computing, Jönköping University, Jönköping, Sweden · Department of Information Science, University of Haifa, Haifa, Israel
Latent Diffusion Pretraining for Crystal Property Prediction
May 30, 2026Shrimon Mukherjee, Kishalay Das, Partha Basuchowdhuri +2Latent Diffusion Models Self-Supervised Pre-Training
School of Mathematical & Computational Sciences, Indian Association for the Cultivation of Science, Kolkata, India · Computer Science and Engineering, Indian Institute of Technology Kharagpur, India.
Wavelet-Fusion Diffusion Model for Multimodal Brain MRI Synthesis with Modality and Metadata Conditioning
May 30, 2026Muhammad Nabi Yasinzai, Remika Mito, Mangor PedersenVariational Autoencoders Latent Diffusion Models
Department of Psychology & Neuroscience, Auckland University of Technology, Auckland, New Zealand. · Department of Psychiatry, University of Melbourne, Melbourne, Victoria 3053, Australia. · Auckland University of Technology, Auckland, New Zealand.
UNISON: A Unified Sound Generation and Editing Framework via Deep LLM Fusion
May 29, 2026Zhaoqing Li, Haoning Xu, Jingran Su +9Text-to-Audio Generation TTS Synthesis
The Chinese University of Hong Kong · The Hong Kong Polytechnic University · City University of Hong Kong +3
DiffCrossGait: Trajectory-Level Alignment for 2D-3D Cross-Modal Gait Recognition via Latent Diffusion
May 29, 2026Zhiyang Lu, Ming ChengDiffusion Model Alignment Latent Diffusion Models
1Fujian Key Laboratory of Urban Intelligent Sensing and Com · 2Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Min
Controllable Lung Nodule Synthesis via Histogram-Regularized Latent Diffusion Models
May 28, 2026Arunkumar Kannan, Yanbo Zhang, Han Liu +5Synthetic Data Augmentation Latent Diffusion Models
aDigital Technology and Innovation, Siemens Healthineers, Princeton, NJ, USA · bJohns Hopkins University, Baltimore, MD, USA · cDigital Technology and Innovation, Siemens Healthineers, Erlangen, Germany +1
Latent Diffusion for Missing Data
May 27, 2026Alberte Heering Estad, Ignacio Peis, Jes FrellsenIncomplete Data Imputation Latent Diffusion Models
Technical University of Denmark · Pioneer Centre for Artificial Intelligence
PhAME: Phenotype-Aware Molecular Editing via Latent Diffusion
May 27, 2026Łukasz Janisiów, Sebastian Musiał, Bartosz Zieliński +2Molecular Optimization Classifier-Free Guidance
Faculty of Mathematics and Computer Science, Jagiellonian University · Doctoral School of Exact and Natural Sciences, Jagiellonian University · Jagiellonian Center for Artificial Intelligence, Jagiellonian University +2
Representation-Conditioned Diffusion Models for Guided Training Data Generation
May 26, 2026Nithesh Chandher Karthikeyan, Jonas Unger, Gabriel EilertsenSynthetic Data Augmentation Latent Diffusion Models
Linkoping University
Diffusion-Based Ukrainian Handwritten Text Generation with Cross-Domain Style Transfer
May 26, 2026Andrii Ahitoliev, Pavlo BerezinLatent Diffusion Models Image Style Transfer
Ukrainian Catholic University, Lviv, Ukraine · National University of “Kyiv-Mohyla Academy”, Kyiv, Ukraine
Equivalent Flows, Unequal Learning: Clean-Latent Prediction in Transformers
May 26, 2026Funing Fu, Tenghui Wang, Guanyu Zhou +2Flow Matching Diffusion Transformer
Independent Researcher · Wuhan University of Technology · Hangzhou Jiyi Artificial Intelligence Co., Ltd.
DGLD: Domain-Gated Latent Diffusion for the Discovery of Novel Energetic Materials
May 26, 2026Yehudit Aperstein, Alexander ApartsinMolecular Optimization Latent Diffusion Models
Department of Intelligent Systems, Afeka Tel-Aviv College of Engineering, Israel. · School of Computer Science, Faculty of Sciences, HIT-Holon Institute of Technology, Israel.
PiD: Fast and High-Resolution Latent Decoding with Pixel Diffusion
May 22, 2026Yifan Lu, Qi Wu, Jay Zhangjie Wu +4Latent Diffusion Models Pixel-Space Diffusion Models
NVIDIA
DecQ: Detail-Condensing Queries for Enhanced Reconstruction and Generation in Representation Autoencoders
May 21, 2026Tianhang Wang, Yitong Chen, Wei Song +3Latent Diffusion Models Autoencoders
Zhejiang University · Shanghai Innovation Institute · Fudan University +1
PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Models
May 21, 2026Jose Edgar Hernandez Cancino Estrada, Mauro Díaz Lupone, Žiga Emeršič +3Latent Diffusion Models Image Generation
University of Ljubljana, Faculty of Computer and Information Science, Ljubljana, Slovenia · University of Ljubljana, Faculty of Electrical Engineering, Ljubljana, Slovenia
Spatial Gram Alignment for Ultra-High-Resolution Image Synthesis
May 20, 2026Jinjin Zhang, Xiefan Guo, Di HuangDiffusion Model Alignment Latent Diffusion Models
Beihang University
EPC-3D-Diff: Equivariant Physics Consistent Conditional 3D Latent Diffusion for CBCT to CT Synthesis
May 19, 2026Alzahra Altalib, Chunhui Li, Haytham Ahmad Alewaidat +3Physics-Informed Diffusion Models Cone-Beam CT
School of Science and Engineering, University of Dundee UK · Faculty of Applied Medical Sciences, Jordan University of Science and Technology · Experia Healthcare, Jordan +1
AirfoilGen: A valid-by-construction and performance-aware latent diffusion model for airfoil generation
May 19, 2026Zhijie Yang, Min Tang, Peng Du +1Latent Diffusion Models Conditional Diffusion Models
State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, 310027, China
Stable Audio 3
May 18, 2026Zach Evans, Julian D. Parker, Matthew Rice +4Text-to-Audio Generation Latent Diffusion Models
Stability AI
VAMP-Diff: VampPrior Latent Diffusion for Photoplethysmography Modeling
May 17, 2026Fatemeh Ghasemi Balouei, Nathan Willemsen, Mahesh Banavar +1Latent Diffusion Models Photoplethysmography
Department of Electrical and Computer Engineering, Clarkson University, Potsdam, USA · Data Science, Worcester Polytechnic Institute, Worcester, USA · Department of Computer Science, Data Science, and Artificial Intelligence, Worcester Polytechnic Institute, Worcester, USA
The Learnability Gap in Medical Latent Diffusion
May 16, 2026Mischa Dombrowski, Felix Nützel, Bernhard KainzLatent Diffusion Models Medical Image Classification
FAU Erlangen-Nürnberg, Erlangen, DE · Department of Computing, Imperial College London, London, UK
Provably Learning Diffusion Models under the Manifold Hypothesis: Collapse and Refine
May 16, 2026Wei Huang, Andi Han, Mingyuan Bai +4Latent Diffusion Models Manifold Learning
RIKEN AIP & The Institute of Statistical Mathematics · University of Sydney · Agency for Science, Technology and Research & The Institute of Statistical Mathematics +4
Face inpainting with Identity Preserving Latent Diffusion Models
May 15, 2026João Santos, Carlos Santiago, Manuel MarquesLatent Diffusion Models Identity-Preserving Image Generation
Institute for Systems and Robotics, Instituto Superior Técnico, Lisboa, Portugal
Efficient Image Synthesis with Sphere Latent Encoder
May 15, 2026Tung Do, Thuan Hoang Nguyen, Hao LiLatent Diffusion Models Few-Step Diffusion Sampling
Mohamed Bin Zayed University of Artificial Intelligence, UAE
Di-BiLPS: Denoising induced Bidirectional Latent-PDE-Solver under Sparse Observations
May 13, 2026Zhonghao Li, Chaoyu Liu, Qian ZhangNeural PDE Solvers Latent Diffusion Models
School of Science, Harbin Institute of Technology, Shenzhen, China · Department of Theoretical Physics and Applied Mathematics, University of Cambridge, Cambridge, United Kingdom
On the Limits of Latent Reuse in Diffusion Models
May 13, 2026Yifeng Yu, Lu YuLatent Diffusion Models Domain Adaptation
Department of Mathematical Sciences, Tsinghua University · Department of Data Science, City University of Hong Kong
Seconds-Aligned PCA-DAC Latent Diffusion for Symbolic-to-Audio Drum Rendering
May 13, 2026Konstantinos Soiledis, Maximos Kaliakatsos Papakostas, Dimos Makris +1Latent Diffusion Models Symbolic Music Generation
1Dept. of Music Technology and Acoustics, Hellenic Mediterranean University, Rethymno & Athens, Greece · 2Athena RC, Athens, Greece
Generative Motion In-betweening by Diffusion over Continuous Implicit Representations
May 12, 2026Shiyu Fan, Paul Henderson, Edmond S. L. HoImplicit Neural Representations Latent Diffusion Models
School of Computing Science, University of Glasgow, United Kingdom.
L2P: Unlocking Latent Potential for Pixel Generation
May 12, 2026Zhennan Chen, Junwei Zhu, Xu Chen +7Latent Diffusion Models Pixel-Space Diffusion Models
Nanjing University · Tencent Youtu Lab · Hainan-biuh +1
LatentHDR: Decoupling Exposure from Diffusion via Conditional Latent-to-Latent Mapping for Text/Image-to-Panoramic HDR
May 11, 2026Pedram Fekri, WenChen Li, William Chen +1Latent Diffusion Models HDR Imaging
Monks AI Research Lab, Toronto, Ontario, Canada
PoDAR: Power-Disentangled Audio Representation for Generative Modeling
May 11, 2026Alejandro Luebs, Mithilesh Vaidya, Ishaan Kumar +5Audio Representation Learning Latent Diffusion Models
Descript
Supersampling Stable Diffusion and Beyond: A Seamless, Training-Free Approach for Scaling Neural Networks Using Common Interpolation Methods
May 9, 2026Md Abu Obaida Zishan, Jannatun Noor, Annajiat Alim RaselLatent Diffusion Models Diffusion-Based Image Generation
School of Data and Sciences BRAC University, Dhaka · Computing for Sustainability and Social Good (C2SG) Research Group Department of Computer Science and Engineering United Internation University, Dhaka
Generative 3D Gaussians with Learned Density Control
May 8, 2026Runjie Yan, Yan-Pei Cao, Peng Wang +23D Gaussian Splatting 3D Asset Generation
Institute for Interdisciplinary Information Sciences, Tsinghua University, China · VAST
How to Train Your Latent Diffusion Language Model Jointly With the Latent Space
May 8, 2026Viacheslav Meshchaninov, Alexander Shabalin, Egor Chimbulatov +4Non-Autoregressive Text Generation Latent Diffusion Models
Constructor University, Bremen, Germany · HSE University, Moscow, Russia · Applied AI Institute, Moscow, Russia +2
What Matters for Diffusion-Friendly Latent Manifold? Prior-Aligned Autoencoders for Latent Diffusion
May 8, 2026Zhengrong Yue, Taihang Hu, Mengting Chen +8Latent Diffusion Models Autoencoders
Shanghai Jiao Tong University · Alibaba Group · Beihang University +4
Consistency Regularised Gradient Flows for Inverse Problems
May 8, 2026Alessio Spagnoletti, Tim Y. J. Wang, Marcelo Pereyra +1Latent Diffusion Models Wasserstein Gradient Flows
Laboratoire MAP5, UMR 8145, Université Paris Cité, CNRS · Department of Mathematics, Imperial College London · Heriot-Watt University, MACS & Maxwell Institute
TextLDM: Language Modeling with Continuous Latent Diffusion
May 8, 2026Jiaxiu Jiang, Jingjing Ren, Wenbo Li +10Diffusion Transformer Latent Diffusion Models
Joy Future Academy · HIT · HKUST(GZ)
Continuous Latent Diffusion Language Model
May 7, 2026Hongcan Guo, Qinyu Zhao, Yian Zhao +8Non-Autoregressive Text Generation Diffusion Transformer
ByteDance Seed · The Australian National University · Peking University +2
Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models
May 7, 2026Nilaksh, Saurav Jha, Artem Zholus +1World Model Learning World Models for Robotics
Chandar Research Lab · Mila – Quebec AI Institute · Polytechnique Montréal +1
Fusion in Your Way: Aligning Image Fusion with Heterogeneous Demands via Direct Preference Optimization
May 7, 2026Weijian Su, Songqian Zhang, Yuqi Han +3Diffusion Model Alignment Multi-Source Image Fusion
School of Computer Science and Technology, Dalian University of Technology · Key Laboratory of Social Computing and Cognitive Intelligence (Dalian University of Technology), Ministry of Education · Institute of Image Processing and Understanding, North Minzu University
Deep Dreams Are Made of This: Visualizing Monosemantic Features in Diffusion Models
May 6, 2026Adam Szokalski, Mateusz ModrzejewskiDisentangled Representation Learning Latent Diffusion Models
Institute of Computer Science, Warsaw University of Technology, Warsaw, Poland
MuCALD-SplitFed: Causal-Latent Diffusion for Privacy-Preserving Multi-Task Split-Federated Medical Image Segmentation
May 4, 2026Chamani Shiranthika, Hadi Hadizadeh, Parvaneh SaeediLatent Diffusion Models Split Federated Learning
School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada

Jun 18, 2026, cs.CVJ/K move · Enter open · S save

Learning When to Denoise: Optimizing Asynchronous Schedules for Latent Diffusion

Bingshuo Qian, Xiang Cheng

Department of Electrical and Computer Engineering Duke University

Flow Matching Latent Diffusion Models Diffusion-Based Image Generation Diffusion Timestep Scheduling Diffusion Models

Open paper AskPDF arXiv

Multi-representation diffusion models can improve visual synthesis by denoising complementary views of an image, but their performance depends critically on the asynchronous schedule that determines when each representation is denoised. We propose to learn this schedule. Our method formulates asynchronous flow matching over multiple representation spaces and uses a schedule-corrected objective that keeps each representation's local noising-time weights fixed as the schedule changes. We instantiate the schedule with a flexible parametric class that is convex and monotone by construction, and learn it using a fast joint probe with less than 1% additional training compute. On ImageNet 256x256, the learned schedule substantially improves both convergence speed and final quality under a matched 675M-parameter XL backbone. With AutoGuidance, our 200-epoch model reaches FID 1.05, matching the 800-epoch SFD-XL baseline with 4x less training. Training to 600 epochs further improves to FID 1.02, outperforming the 1B-parameter SFD-XXL result of FID 1.04 while using a smaller model. In the unguided setting, our 200-epoch model reaches FID 2.37, already below the best 800-epoch SFD-XL result (2.54) at 4x less training, and improves to FID 2.14 at 600 epochs. Code is available at https://github.com/bsq532087/LWD

Momentum

Related topics

Latest papers 143