Identity-Conditioned Latent Diffusion Models

Follow this topic Ask about this topic

Momentum

5 papers in the last four weeks, up 25% on the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 51

All topics

LDM-is-AE: Latent Diffusion Model is an Auto-Encoder for End-to-End Image Generation
Sep 29, 2026Zhengqiang Zhang, Lingchen Sun, Rongyuan Wu +4Latent Diffusion Model Identity-Conditioned Latent Diffusion Models
The Hong Kong Polytechnic University · OPPO Research Institute
Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Images
Sep 29, 2026Junhee Lee, Donghyeon Jeon, Taeoh Kim +2Diffusion-Based Image Editing Face Forgery Detection
Kyung Hee University · NAVER Cloud
HYDRO: Towards Non-Reversible Face De-Identification Using a High-Fidelity Hybrid Diffusion and Target-Oriented Approach
Sep 22, 2026Felix Rosberg, Vitomir Štruc, Cristofer Englund +2Blind Face Restoration Facial Images
MedDiME: Efficient Latent Diffusion with Adaptive Masking for Medical Counterfactual Generation
Sep 14, 2026Yan Zeng, Changlu Guo, Anders Nymark Christensen +2Identity-Conditioned Latent Diffusion Models Diffusion-Based Image Editing
Department of Applied Mathematics and Computer Science, Technical University of Denmark
Topologically Consistent Agricultural Parcel Vectorization with Semantic-Guided Diffusion and Topology-Aware Polygonization
Sep 7, 2026Weiqin Jiao, Xiaolong Zuo, Claudio PerselloDelineation Partitioning
Department of Earth Observation Science, Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente, Enschede, 7522 NH, The Netherlands · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan, 430072, China
ToPO: Token-Conditioned Preference Routing for Attention-Based Latent Diffusion Models
Sep 3, 2026Juntao Xu, Shihong Li, Hoi Fan Au +1Identity-Conditioned Latent Diffusion Models Diffusion Models
Tsinghua University · University of Electronic Science and Technology of China · Stanford University
HarmoCore: Functional Latent Diffusion for Sparse Reconstruction of Oscillatory Wave Fields
Sep 1, 2026Lihao Chen, Xinyu Zhang, Panqi Chen +4Complex Wavefield Signal Reconstruction
College of Information Science and Electronic Engineering, Zhejiang University
Identity-Conditioned Latent Consistency Distillation for Face Synthesis
Aug 31, 2026Tiago Kienen Chaves, Bernardo Biesseck, David MenottiIdentity-Conditioned Latent Diffusion Models Dataset Distillation
Department of Informatics, Federal University of Paraná, Curitiba, Brazil · Federal Institute of Mato Grosso (IFMT), Pontes e Lacerda, MT, Brazil
AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation
Aug 24, 2026Huiwen Han, Lulin Liu, Bangya Liu +8Magnetic Resonance Imaging Identity-Conditioned Latent Diffusion Models
Stanford University · Texas A&M University · University of Minnesota +4
Intrinsic-Hybrid Latent Diffusion Models for Generative Modeling on Unknown Manifolds
Aug 5, 2026Yizhu Wang, Mu Niu, Xiaochen YangIdentity-Conditioned Latent Diffusion Models Latent Diffusion Model
School of Mathematics and Statistics, University of Glasgow, Glasgow, U.K.
DiffImaginE: Imagine to Verify Entity Types with Diffusion
Aug 4, 2026Feng Zhang, Feiyu Han, Rongxin Yang +11Named-Entity Recognition Identity-Conditioned Latent Diffusion Models
1Fuzhou University · 2Chinese Academy of Sciences · 6Fullive Innovation (Beijing) AI Technology Co., Ltd. +5
Separate-and-Detect: Unified Drum Transcription and Stem Generation via Latent Diffusion
Aug 2, 2026Wei-Han Hsu, Chih-Cheng Chang, Bo-Yu Chen +2Multi-Instrument Music Transcription Speech Separation
Data Science Degree Program, National Taiwan University and Academia Sinica, Taipei, Taiwan · Institute of Information Science, Academia Sinica, Taiwan · Rhythm Culture Corporation +1
Reconstruction-Shift Discrimination via Mask-Guided Latent Diffusion for Medical Anomaly Detection
Aug 1, 2026Yibo Wan, Jinyu Cai, Yunhe Zhang +2Identity-Conditioned Latent Diffusion Models
School of Computing, National University of Singapore, Singapore · Institute of Data Science, National University of Singapore, Singapore · Department of Computer and Information Science, SKL-IOTSC, University of Macau, China +1
Diff-ID: Identity Consistent Facial Image Generation and Morphing via Diffusion Models
Jul 27, 2026Taimoor Rizwan, Sara Atito, Muhammad Awais +2Identity-Conditioned Latent Diffusion Models Diffusion Models
Centre for Vision, Speech and Signal Processing (CVSSP) University of Surrey Guildford, United Kingdom · School of Artificial Intelligence and Computer Science Jiangnan University Wuxi, China
BeyondFusion: Self-Aligned Latent Diffusion for Calibration-Free Infrared Super-Resolution and Infrared-Visible Fusion
Jul 27, 2026Minchong Chen, Xiaoyun Yuan, Minyu Cao +4Infrared-Visible Image Fusion Infrared
MoE Key Lab of Artificial Intelligence, Institute of AI, School of Computer Science, Shanghai Jiao Tong University, Shanghai, China · Tsinghua University, Beijing, China · Institute of Modern Optics, Nankai University, Tianjin, China
DS@GT ARC at ImageCLEFmed GANs 2026: Geometric Filtering for Privacy-Preserving CT Slice Generation
Jul 22, 2026Eric Regina, Richard Arnaud, Samir Hadi CisnerosMedical Image Generation Conditional Gans
Georgia Institute of Technology, North Ave NW, Atlanta, GA 30332
CLDRoute: Conditional Latent Diffusion for Routability Map Generation in Physical Design
Jul 18, 2026Kiran Thorat, Nicole Meng, Caiwen Ding +2Road Networks Identity-Conditioned Latent Diffusion Models
University of Connecticut · Tufts University · University of Minnesota Twin Cities
Slot-RAE: Streamlining Object-Centric Learning via Direct Representation Auto-Encoders
Jul 13, 2026Alexandre Chapin, Emmanuel Dellandrea, Liming ChenObject-Centric Representations Identity-Conditioned Latent Diffusion Models
LIRIS, imagine
AI for Cultural Heritage Textiles: Fine-Tuned Latent Diffusion for Novel Ulos Motif Synthesis
Jul 6, 2026Humasak Tommy Argo Simanjuntak, Jesika Purba, Sitogab Girsang +4Cultural Heritage Sewing
Information Systems Study Program, Faculty of Informatics and Electrical Engineering, Institut Teknologi Del · Informatics Study Program, Faculty of Informatics and Electrical · Informatics Department, Institut Teknologi Sepuluh Nopember
Patch-PODiff-ViT: Structured Latent Diffusion with Patchwise POD for Super-Resolution and Uncertainty Quantification
Jun 30, 2026Onkar Jadhav, Tim French, Matthew Rayson +1Identity-Conditioned Latent Diffusion Models Uncertainty Quantification
School of Earth and Oceans, UWA Oceans Institute University of Western Australia Crawley, WA, Australia · School of Physics, Mathematics and Computing, Computer Science and Software Engineering University of Western Australia Crawley, WA, Australia
Proposal-Conditioned Latent Diffusion for Closed-Loop Traffic Scenario Generation
Jun 25, 2026Shubham Vaijanath Phoolari, Aleyna Kara, Christoph Lauer +1Scenario Generation Diffusion Planning
Authors are with CARIAD SE, Germany. · Author is with the Institute of Automotive Engineering (FZD), TU Darmstadt, Germany. · Author is with the Technical University of Munich, Germany.
Anatomy-Guided Residual Motion Diffusion for Controllable 4D Cardiac MRI Synthesis
Jun 25, 2026Yiheng Cao, Gustavo Andrade-Miranda, Jiatian Zhang +2Cardiac Magnetic Resonance Imaging Medical Image Generation
Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Science, Suzhou, China · Systemes Complexes et Intelligence Artificielle, IMT Mines Ales, Ales, France · School of Artificial Intelligence and Advanced Computing, Xi’an Jiaotong-Liverpool University, Suzhou, China
TensorLDM: A Component-Wise Latent Diffusion Model for Volumetric DTI Reconstruction from Sparse DWIs
Jun 24, 2026Junhyeok Lee, Kyu Sung ChoiIdentity-Conditioned Latent Diffusion Models
Interdisciplinary Program in Cancer Biology, Seoul National University College of Medicine · Department of Radiology, Seoul National University Hospital · Department of Radiology, Seoul National University College of Medicine +1
Latent Block-Diffusion Temporal Point Processes: A Semi-Autoregressive Framework for Asynchronous Event Sequence Generation
Jun 23, 2026Shuai Zhang, Yancheng Chen, Chuan Zhou +5Autoregressive Diffusion Autoregressive Generation
Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China · Institute of Information Engineering, Chinese Academy of Sciences, Beijing 100093, China · Department of Data Science, City University of Hong Kong, Hong Kong 999077, China +1
Structure-Semantic Co-optimized Latent Diffusion Model for Fast Visual Anagram Synthesis
Jun 15, 2026Xiang Gao, Yunpeng JiaIdentity-Conditioned Latent Diffusion Models Iterative Denoising Methods
School of Digital Media and Design Arts Beijing University of Posts and Telecommunications
HemExp: Clinically-Guided Latent Diffusion for Modeling Hematoma Expansion
Jun 13, 2026Orhun Utku Aydin, Satoru Tanioka, Tzu I Chuang +7Stroke Identity-Conditioned Latent Diffusion Models
CLAIM – Charité Lab for AI in Medicine, Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Charitéplatz 1, 10117 Berlin, Germany · Department of Neurosurgery, Mie Chuo Medical Center, 2158-5 Myojin-cho,2026 514-1101, Hisai,Tsu, Japan
Echo-DM: Ultrasound Marker Removal via Conditional Latent Diffusion and Region-Aware Fusion
Jun 8, 2026Zhiwei Wang, Tao Huang, Wentao Jiang +7Clinical Ultrasound Dataset Ultrasound
School of Computer Science, Wuhan University, China · The Central Hospital of Wuhan, China · School of Computer Science, Hubei University of Technology, China
TargetSEC: Plug-and-Play In-the-Wild Speech Emotion Conversion via Arousal-Conditioned Latent Style Diffusion
Jun 5, 2026Constantin Alexander AugaIdentity-Conditioned Latent Diffusion Models Emotion
Hasso Plattner Institute / University of Potsdam, Potsdam, Germany
Conditional Latent Diffusion Model with Fourier-based Motion Modelling for Virtual Population Synthesis
Jun 2, 2026Shaokun Lan, Haoran Dou, Jinghan Huang +5End-To-End 4D Heart Mesh Recovery Across Full-Stack Mesh Generation
Centre for Computational Imaging and Modelling in Medicine (CIMIM), University of Manchester, Manchester, UK
DeblurNVS: Geometric Latent Diffusion for Novel View Synthesis from Sparse Motion-Blurred Images
May 31, 2026Changyue Shi, Wangbo Yu, Chaoran Feng +1Novel View Synthesis Video Diffusion Models
School of AI for Science, Peking University Shenzhen Graduate School, Shenzhen, 518055 China · School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Shenzhen, 518055 China
Controllable Lung Nodule Synthesis via Histogram-Regularized Latent Diffusion Models
May 28, 2026Arunkumar Kannan, Yanbo Zhang, Han Liu +5Lung-Nodule Artificial Intelligence Medical Image Generation
aDigital Technology and Innovation, Siemens Healthineers, Princeton, NJ, USA · bJohns Hopkins University, Baltimore, MD, USA · cDigital Technology and Innovation, Siemens Healthineers, Erlangen, Germany +1
Loki: Representation over Architecture for Diffusion-Based Portrait Animation
May 22, 2026Pouyan Navard, Sernam LimIdentity-Conditioned Latent Diffusion Models Facial Expression Recognition
The Ohio State University · University of Central Florida
PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Models
May 21, 2026Jose Edgar Hernandez Cancino Estrada, Mauro Díaz Lupone, Žiga Emeršič +3Identity-Conditioned Latent Diffusion Models Exact Unlearning
University of Ljubljana, Faculty of Computer and Information Science, Ljubljana, Slovenia · University of Ljubljana, Faculty of Electrical Engineering, Ljubljana, Slovenia
AirCast-SR: A Foundation Model for Kilometer-Scale Atmospheric Super-Resolution via Latent Consistency Diffusion
May 20, 2026Somnath Luitel, Manmeet Singh, Joshua Durkee +11Forecast Hyperspectral Image Super-Resolution
Department of Earth, Environmental, and Atmospheric Sciences, Western Kentucky University, Bowling Green, KY, USA · NASA Goddard Space Flight Center, Greenbelt, MD, USA · The University of Texas at Austin, Austin, TX, USA +3
AirfoilGen: A valid-by-construction and performance-aware latent diffusion model for airfoil generation
May 19, 2026Zhijie Yang, Min Tang, Peng Du +1Aerodynamics Identity-Conditioned Latent Diffusion Models
State Key Laboratory of CAD&CG, Zhejiang University, Hangzhou, 310027, China
Stable Audio 3
May 18, 2026Zach Evans, Julian D. Parker, Matthew Rice +4Modern Generative Audio Models Audio Understanding
Stability AI
VAMP-Diff: VampPrior Latent Diffusion for Photoplethysmography Modeling
May 17, 2026Fatemeh Ghasemi Balouei, Nathan Willemsen, Mahesh Banavar +1Remote Photoplethysmography Identity-Conditioned Latent Diffusion Models
Department of Electrical and Computer Engineering, Clarkson University, Potsdam, USA · Data Science, Worcester Polytechnic Institute, Worcester, USA · Department of Computer Science, Data Science, and Artificial Intelligence, Worcester Polytechnic Institute, Worcester, USA
The Learnability Gap in Medical Latent Diffusion
May 16, 2026Mischa Dombrowski, Felix Nützel, Bernhard KainzIdentity-Conditioned Latent Diffusion Models Latent Diffusion Model
FAU Erlangen-Nürnberg, Erlangen, DE · Department of Computing, Imperial College London, London, UK
Face inpainting with Identity Preserving Latent Diffusion Models
May 15, 2026João Santos, Carlos Santiago, Manuel MarquesBlind Face Restoration Inpainting
Institute for Systems and Robotics, Instituto Superior Técnico, Lisboa, Portugal
Seconds-Aligned PCA-DAC Latent Diffusion for Symbolic-to-Audio Drum Rendering
May 13, 2026Konstantinos Soiledis, Maximos Kaliakatsos Papakostas, Dimos Makris +1Identity-Conditioned Latent Diffusion Models Acoustic Latent Space
1Dept. of Music Technology and Acoustics, Hellenic Mediterranean University, Rethymno & Athens, Greece · 2Athena RC, Athens, Greece
TextLDM: Language Modeling with Continuous Latent Diffusion
May 8, 2026Jiaxiu Jiang, Jingjing Ren, Wenbo Li +10Identity-Conditioned Latent Diffusion Models Multimodal Generation
Joy Future Academy · HIT · HKUST(GZ)
Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models
May 7, 2026Nilaksh, Saurav Jha, Artem Zholus +1Latent World Models World Models
Chandar Research Lab · Mila – Quebec AI Institute · Polytechnique Montréal +1
Fusion in Your Way: Aligning Image Fusion with Heterogeneous Demands via Direct Preference Optimization
May 7, 2026Weijian Su, Songqian Zhang, Yuqi Han +3Visible Image Fusion Infrared-Visible Image Fusion
School of Computer Science and Technology, Dalian University of Technology · Key Laboratory of Social Computing and Cognitive Intelligence (Dalian University of Technology), Ministry of Education · Institute of Image Processing and Understanding, North Minzu University
MuCALD-SplitFed: Causal-Latent Diffusion for Privacy-Preserving Multi-Task Split-Federated Medical Image Segmentation
May 4, 2026Chamani Shiranthika, Hadi Hadizadeh, Parvaneh SaeediSemi-Supervised Medical Image Segmentation Identity-Conditioned Latent Diffusion Models
School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
IdentiFace: Multi-Modal Iterative Diffusion Framework for Identifiable Suspect Face Generation in Crime Investigations
May 1, 2026Weichen Liu, Yixin Yang, Changsheng Chen +1Facial Images Identity-Conditioned Latent Diffusion Models
Southeast University · Nanjing, China · Shenzhen MSU-BIT University +1
CA-IDD: Cross-Attention Guided Identity-Conditional Diffusion for Identity-Consistent Face Swapping
Apr 27, 2026Md Shohel Rana, Tanoy DebnathBlind Face Restoration Diffusion-Based Image Editing
School of Computing
DCMorph: Face Morphing via Dual-Stream Cross-Attention Diffusion
Apr 23, 2026Tahar Chettaoui, Eduarda Caldeira, Guray Ozgur +3Face Recognition Model Identity-Conditioned Latent Diffusion Models
Fraunhofer Institute for Computer Graphics Research IGD, Germany · TU Darmstadt, Germany · Norwegian University of Science and Technology (NTNU), Norway
CLIMB: Controllable Longitudinal Brain Image Generation using Mamba-based Latent Diffusion Model and Gaussian-aligned Autoencoder
Apr 17, 2026Duy-Phuong Dao, Muhammad Taqiyuddin, Jahae Kim +4Identity-Conditioned Latent Diffusion Models Latent Diffusion Model
Department of Artificial Intelligence Convergence, Chonnam National University, South Korea · Department of Nuclear Medicine, Chonnam National University, South Korea · University of South Australia, Australia +2
Anatomically Guided Latent Diffusion for Brain MRI Progression Modeling
Jan 21, 2026Cheng Wan, Bahram Jafrasteh, Ehsan Adeli +2Identity-Conditioned Latent Diffusion Models Latent Diffusion Model
Cornell University · Weill Cornell Medicine · Stanford University +1
From Alignment to Synthesis: Contrastive Volumetric Grounding for Text-to-CT Generation
May 31, 2025Daniele Molino, Camillo Maria Caruso, Filippo Ruffini +2Cone-Beam Computed Tomography Volume
Unit of Artificial Intelligence and Computer Systems, Department of Engineering, Università Campus Bio-Medico di Roma, Rome, Italy · Department of Diagnostics and Intervention, Biomedical Engineering and Radiation Physics, Umeå University, Umeå, Sweden · UniCamillus – Saint Camillus International University of Health Sciences, Rome, Italy
4D-RaDiff: Latent Point Diffusion for 4D Radar Point Cloud Generation
Date pendingJimmie Kwok, Holger Caesar, Andras PalffyLight Detection And Ranging Point Clouds Radar
Delft University of Technology, Netherlands · Perciv AI, Netherlands

Sep 29, 2026, cs.CVJ/K move · Enter open · S save

LDM-is-AE: Latent Diffusion Model is an Auto-Encoder for End-to-End Image Generation

Zhengqiang Zhang, Lingchen Sun, Rongyuan Wu, Qiaosi Yi+3

The Hong Kong Polytechnic University · OPPO Research Institute

Latent Diffusion Model Identity-Conditioned Latent Diffusion Models Diffusion Models Autoencoder Architectures Video Latents

Open paper AskPDF arXiv

Latent Diffusion Models (LDMs) typically adopt a two-stage pipeline: an auto-encoder (AE) is first pre-trained to define a latent space, then a diffusion model is trained to perform denoising within it. Such a two-stage design introduces a representation mismatch, as the latent space is optimized for reconstruction rather than adapting the denoising dynamics. We reveal that the LDM itself is an AE, and consequently present LDM-is-AE, an end-to-end one-stage LDM training framework that eliminates the need for a separately trained tokenizer. Our key observation is that the LDM backbone actually performs a latent-to-feature-to-latent transformation at each denoising step, which can be interpreted as an internal decoding--encoding process. Leveraging this structure, we split the DiT backbone into two reciprocal components, DiT-E (i.e., DiT Encoding) and DiT-D (i.e., DiT Decoding), and impose image-space supervision on the intermediate features across all timesteps. Our model encourages the internal representation to align with the image domain throughout denoising, thereby establishing an explicit latent-to-image-to-latent path. At the zero-noise timestep, our model further performs an image-to-latent-to-image mapping, corresponding to an auto-encoding process. As a result, LDM-is-AE jointly learns latent representations and denoising dynamics in an end-to-end manner, yielding a diffusion-native latent space tailored to the generation process. Experiments demonstrate that LDM-is-AE exhibits highly competitive generation performance, achieving an FID of 1.80 and 1.90 on 256x256 and 512x512 class-conditional image generation, respectively.

Momentum

Related topics

Latest papers 51