Latent Diffusion Models

Ask about this topic

Overview

Latent diffusion models first encode data into a compact space, often with a variational autoencoder, then learn to generate it by reversing a noise process. Researchers use U-Nets and diffusion transformers, with text, images, masks, or physical variables as conditions, for tasks ranging from ImageNet image generation to medical imaging, audio, 3D shapes, and scientific reconstruction. Current work explores better latent spaces, faster sampling, and controls for detail, structure, and uncertainty. A central tension is that stronger compression can reduce compute but lose fine detail or physical fidelity, while good reconstruction alone does not guarantee that a latent space is easy to model.

Latest papers

CardsList

207 papers19 papers in the last four weeks, up 36% on the four weeks before. 0.1% of all new papers.

  1. Latent Diffusion-Based 3D Molecular Recovery from Vibrational Spectra

    Mar 6, 2026Wenjin Wu, Aleš Leonardis, Linjiang Chen +1Infrared Spectroscopy3D Molecular Generation

    School of Computer Science, University of Birmingham · School of Chemistry, University of Birmingham · State Key Laboratory of Precision and Intelligent Chemistry, University of Science and Technology of China

  2. Making Reconstruction FID Predictive of Diffusion Generation FID

    Mar 5, 2026Tongda Xu, Mingwei He, Shady Abu-Hussein +6Diffusion ModelsVariational Autoencoders

    Tsinghua University · University of Cambridge · Peking University +1

  3. Low-Resource Guidance for Controllable Latent Audio Diffusion

    Mar 4, 2026Zachary Novack, Zack Zukowski, CJ Carr +6Audio GenerationDiffusion Model Guidance

    UC – San Diego · Stability AI

  4. Semi-Supervised Generative Learning via Latent Space Distribution Matching

    Mar 4, 2026Kwong Yu Chong, Long FengConditional Generative ModelingSemi-Supervised Learning

    School of Computing & Data Science, University of Hong Kong

  5. Phys-Diff: A Physics-Inspired Latent Diffusion Model for Tropical Cyclone Forecasting

    Feb 28, 2026Lei Liu, Xiaoning Yu, Kang Chen +4Tropical Cyclone Intensity ForecastingWeather Forecasting

    University of Science and Technology of China, Hefei, China · Hefei University of Technology, Hefei, China

  6. Ordinal Diffusion Models for Color Fundus Images

    Feb 27, 2026Gustav Schmidt, Philipp Berens, Sarah MüllerDiffusion-Based Image GenerationDiffusion Models

    Hertie Institute for AI in Brain Health, University of Tübingen, Germany

  7. GraspLDP: Towards Generalizable Grasping Policy via Latent Diffusion

    Feb 26, 2026Enda Xiang, Haoxiang Ma, Xinzhu Ma +2Robotic GraspingGeneralization in Robotic Manipulation

    State Key Laboratory of Complex and Critical Software Environment, Beihang University, Beijing, 100191, China · School of Computer Science and Engineering, Beihang University, Beijing, 100191, China

  8. No Caption, No Problem: Caption-Free Membership Inference via Model-Fitted Embeddings

    Feb 26, 2026Joonsung Jeon, Woo Jae Kim, Suhyeon Ha +2Membership Inference AttacksT2I Diffusion Models

    Korea Advanced Institute of Science and Technology (KAIST)

  9. Unified Latents (UL): How to train your latents

    Feb 19, 2026Jonathan Heek, Emiel Hoogeboom, Thomas Mensink +1Diffusion AutoencoderLatent Diffusion Models

    Google DeepMind Amsterdam

  10. Semi-Supervised Domain Adaptation with Latent Diffusion for Pathology Image Classification

    Jan 23, 2026Tengyue Zhang, Ruiwen Ding, Luoting Zhuang +3Computational PathologySynthetic Data Augmentation

    Medical & Imaging Informatics, Department of Radiological Sciences, David Geffen School of Medicine, University of California, Los Angeles (UCLA), Los Angeles, CA 90024, USA · Bioengineering Department, Henry Samueli School of Engineering, UCLA, Los Angeles, CA 90024, USA · Department of Pathology & Laboratory Sciences, David Geffen School of Medicine, UCLA, Los Angeles, CA 90024, USA

  11. Anatomically Guided Latent Diffusion for Brain MRI Progression Modeling

    Jan 21, 2026Cheng Wan, Bahram Jafrasteh, Ehsan Adeli +2Latent Diffusion ModelsLongitudinal Medical Image Analysis

    Cornell University · Weill Cornell Medicine · Stanford University +1

  12. MatLat: Material Latent Space for PBR Texture Generation

    Dec 19, 2025Kyeongmin Yeo, Yunhong Min, Jaihoon Kim +1Texture SynthesisLatent Diffusion Models

    KAIST

  13. GMODiff: One-Step Gain Map Refinement with Diffusion Priors for HDR Reconstruction

    Dec 18, 2025Tao Hu, Weiyu Zhou, Yanjie Tu +4Diffusion Models for Image RestorationLatent Diffusion Models

    Northwestern Polytechnical University, Xi’an 710072, China · Xi’an University of Architecture and Technology, Xi’an 710055, China · The Shenzhen Research Institute of Northwestern Polytechnical University, Shenzhen 518057, China

  14. MoLingo: Motion-Language Alignment for Text-to-Human Motion Generation

    Dec 15, 2025Yannan He, Garvita Tiwari, Xiaohan Zhang +4Latent Diffusion ModelsText-to-Motion Generation

    University of Tübingen, Germany · Tübingen AI Center, Germany · Max Planck Institute for Informatics, Saarland Informatics Campus, Germany +2

  15. Latent Nonlinear Denoising Score Matching for Enhanced Learning of Structured Distributions

    Dec 7, 2025Kaichen Shen, Wei ZhuScore-Based Generative ModelingDiffusion Models

    School of Mathematics, Georgia Institute of Technology, Atlanta, GA

  16. Delving into Latent Spectral Biasing of Video VAEs for Superior Diffusability

    Dec 5, 2025Shizhan Liu, Xinran Deng, Zhuoyi Yang +3Variational AutoencodersSpectral Regularization

    Zhipu AI, Beijing, China · University of Chinese Academy of Sciences, Beijing, China · Tsinghua University, Beijing, China

  17. Diffusion Model in Latent Space for Medical Image Segmentation Task

    Dec 1, 2025Ngoc Huynh Trinh, Hai Toan Nguyen, Son Ba Luong +1Latent Diffusion ModelsDiffusion Models for Medical Image Segmentation

    Institute for Artificial Intelligence, University of Engineering and Technology, Vietnam National University, Hanoi, Vietnam

  18. scTREAT: Latent Diffusion for Single-Cell Drug-Response Prediction

    Oct 8, 2025Zhaokang Liang, Shuyang Zhuang, Xiaoran Jiao +2Single-Cell Perturbation ModelingCancer Drug Response Prediction

    Zhejiang University, China · Massachusetts Institute of Technology, USA

  19. FICGen: Frequency-Inspired Contextual Disentanglement for Layout-driven Degraded Image Generation

    Sep 1, 2025Wenzhuang Wang, Yifan Zhao, Mingcan Ma +4Image GenerationGenerative Modeling

    State Key Laboratory of Virtual Reality Technology and Systems, SCSE&QRI, Beihang University · Geely Automobile Research Institute (Ningbo) Co., Ltd

  20. EEGDM: Learning EEG Representation with Latent Diffusion Model

    Aug 28, 2025Shaocong Wang, Tong Liu, Yihan Li +6ElectroencephalographyEEG Signal Generation

    Tsinghua University · Tianjin University

  21. Novel View Synthesis using DDIM Inversion

    Aug 14, 2025Sehajdeep Singh, A V Subramanyam, Aditya Gupta +1Novel View SynthesisDiffusion Model Guidance

    Indraprastha Institute of Information Technology, Delhi

  22. Stochastic and Non-local Closure Modeling for Nonlinear Dynamical Systems via Latent Score-based Generative Models

    Jun 25, 2025Xinghao Dong, Huchen Yang, Jin-Long WuDynamical SystemsLatent Diffusion Models

    Department of Mechanical Engineering, University of Wisconsin-Madison, Madison, WI, 53706, USA

  23. From Alignment to Synthesis: Contrastive Volumetric Grounding for Text-to-CT Generation

    May 31, 2025Daniele Molino, Camillo Maria Caruso, Filippo Ruffini +2Latent Diffusion ModelsMedical Image Synthesis

    Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy · Department of Diagnostics and Intervention, Biomedical Engineering and Radiation Physics, Umeå University, Umeå, Sweden · UniCamillus – Saint Camillus International University of Health Sciences, Rome, Italy

  24. TraceMark-LDM: Authenticatable Watermarking for Latent Diffusion Models via Binary-Guided Rearrangement

    Mar 30, 2025Wenhao Luo, Zhangyi Shen, Ye Yao +3Diffusion Model WatermarkingLatent Diffusion Models

    Hangzhou Dianzi University, Hangzhou, ZJ 310018, China · Nanchang University, Nanchang, JX 330031, China · School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China +1

  25. LVMark: Robust Watermark for Latent Video Diffusion Models

    Dec 12, 2024Youngdong Jang, MinHyuk Jang, JaeHyeok Lee +4Diffusion Model WatermarkingVideo Diffusion Models

    Department of Artificial Intelligence, Korea University, Seoul 02841, Republic of Korea · Google DeepMind, Mountain View, CA 94043, USA

  26. C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generation

    Nov 16, 2024Jeonghyeok Do, Jaehyup Lee, Munchurl KimImage-to-Image TranslationLatent Diffusion Models

    KAIST · KNU

  27. Zero-Shot Paragraph-level Handwriting Imitation with Latent Diffusion Models

    Sep 1, 2024Martin Mayr, Marcel Dreier, Florian Kordon +5Latent Diffusion ModelsImage Generation

    Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany. · Planet AI GmbH, Rostock, Germany.