Diffusion Models

Follow this topic Ask about this topic

Momentum

99 papers in the last four weeks, up 168% on the four weeks before. 1.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 934

All topics

ELBO-T2IAlign: A Generic ELBO-Based Method for Calibrating Pixel-level Text-Image Alignment in Diffusion Models
Jun 11, 2025Qin Zhou, Zhiyang Zhang, Jinglong Wang +5Image-Text Alignment Diffusion Alignment
School of Software, Beihang University, Beijing 100191, China · College of Computer and Cyber Security, Hebei Normal University, Hebei 050024, China · Department of Computer Science, The University of Hong Kong, Hong Kong
Diff-SPORT: Diffusion-based Sensor Placement Optimization and Reconstruction of Turbulent flows in urban environments
May 30, 2025Abhijeet Vishwasrao, Sai Bharath Chandra Gutha, Andres Cremades +8Optimal Sensor Placement Air Pollution
Department of Aerospace Engineering, University of Michigan, Ann Arbor, USA · FLOW, Engineering Mechanics, KTH Royal Institute of Technology, Stockholm, Sweden · Division of Robotics, Perception and Learning, School of EECS, KTH Royal Institute of Technology, Stockholm, Sweden +7
Physics-Informed Distillation of Diffusion Models for PDE-Constrained Generation
May 28, 2025Yi Zhang, Peng Wang, Difan ZouPartial Differential Equations Diffusion Models
Institute of Data Science · Department of Computer and Information Science · Institute of Data Science & School of Computing and Data Science
ISAC: Training-Free Instance-to-Semantic Attention Control for Multi-Instance Generation
May 27, 2025Sanghyun Jo, Wooyeol Lee, Ziseok Lee +3Text-To-Image Diffusion Models
OGQ, Seoul, Korea · Seoul National University, Seoul, Korea
Multi-Embodiment Robotic Retargeting via Guided Diffusion Model
May 27, 2025Zhefeng Cao, Ben Liu, Shunpeng Yang +3Cross-Embodiment Retargeting Cross-Embodiment Transfer
Southern University of Science and Technology, Shenzhen, China · The Hong Kong University of Science and Technology, HongKong, China · LimX Dynamics, Shenzhen, China. +1
Improved Immiscible Diffusion: Accelerate Diffusion Training by Reducing Its Miscibility
May 24, 2025Yiheng Li, Feng Liang, Dan Kondratyuk +3Diffusion Models Diffusion Dynamics
UC Berkeley, Berkeley CA 94720, USA · UT Austin, Austin TX 78712, USA · Rekursiv.ai, Mountain View CA, 94041
LaViDa: A Large Diffusion Language Model for Multimodal Understanding
May 22, 2025Shufan Li, Konstantinos Kallidromitis, Hritik Bansal +7Multimodal Understanding Diffusion Models
1UCLA · 2Panasonic AI Research · 4Salesforce Research +1
Conditioning Residuals for Diffusion Models via Representation Feedback
May 16, 2025Weilai Xiang, Hongyu Yang, Di Huang +1Diffusion Models Generative Models
State Key Laboratory of Virtual Reality Technology and Systems, School of Computer Science and Engineering, Beihang University, Beijing 100191, China · Institute of Artificial Intelligence, Beihang University, Beijing 100191, China · School of Computer Science and Engineering, Beihang University, Beijing 100191, China
Localized Diffusion Models
May 7, 2025Georg A. Gottwald, Shuigen Liu, Youssef Marzouk +2Score-Based Diffusion Model Diffusion Models
School of Mathematics and Statistics, The University of Sydney · Department of Mathematics, National University of Singapore · Laboratory for Information and Decision Systems, Massachusetts Institute of Technology +1
OmegAMP: Targeted AMP Discovery via Biologically Informed Generation
Apr 24, 2025Diogo Soares, Leon Hetzel, Paulina Szymczak +6Antimicrobial Peptide Discovery
Institute of AI for Health, Helmholtz Munich · School of Computation, Information and Technology, Technical University of Munich · Institute of Computational Biology, Helmholtz Munich +8
Bifidelity Parameter Estimation Using Conditional Diffusion Models
Apr 2, 2025Caroline Tatsuoka, Minglei Yang, Dongbin Xiu +1Multi-Fidelity Bayesian Inference
Department of Mathematics, The Ohio State University, Columbus, OH 43210, USA · Fusion Energy Science Division, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA · Computer Science and Mathematics Division, Oak Ridge National Laboratory, Oak Ridge, TN, 37831, USA
Semi-Supervised Biomedical Image Segmentation via Diffusion Models and Teacher-Student Co-Training
Apr 2, 2025Luca Ciampi, Gabriele Lagani, Giuseppe Amato +1Semi-Supervised Medical Image Segmentation Semi-Supervised Learning
ISTI-CNR, Pisa, Italy
TraceMark-LDM: Authenticatable Watermarking for Latent Diffusion Models via Binary-Guided Rearrangement
Mar 30, 2025Wenhao Luo, Zhangyi Shen, Ye Yao +3Watermarks Watermarking
Hangzhou Dianzi University, Hangzhou, ZJ 310018, China · Nanchang University, Nanchang, JX 330031, China · School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China +1
PersGuard: Preventing Malicious Personalization in Text-to-Image Diffusion Models via Model Backdoors
Feb 22, 2025Xinwei Liu, Xiaojun Jia, Yuan Xun +2Text-To-Image Diffusion Models Diffusion Models
Institute of Information Engineering, Chinese Academy of Sciences, Beijing 100093, China · School of Cyber Security, University of Chinese Academy of Sciences, Beijing 100049, China · BraneMatrix AI, Shanghai 201203, China +1
Comprehensive Assessment and Analysis for NSFW Content Erasure in Text-to-Image Diffusion Models
Feb 18, 2025Die Chen, Zhiwen Li, Cen Chen +5Text-To-Image Diffusion Models Concept Erasure
East China Normal University
From Uncertain to Safe: Conformal Adaptation of Diffusion Models for Safe PDE Control
Feb 4, 2025Peiyan Hu, Xiaowei Qian, Wenhao Deng +8Diffusion Models Uncertainty Quantification
Work done as an intern at Westlake University · Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing, China · School of Engineering, Westlake University, Hangzhou, China +2
Training-Free, Identity-Preserving Image Editing for Fashion Pose Alignment and Normalization
Jan 23, 2025Potito Aghilar, Vito Walter Anelli, Michelantonio Trizio +2Image Editing Garments
Polytechnic University of Bari, Via Edoardo Orabona, 4, Bari, 70125, Apulia, Italy · Wideverse, Via Edoardo Orabona, 4, Bari, 70125, Apulia, Italy
Low-dimensional adaptation of diffusion models: Convergence in total variation
Jan 22, 2025Jiadong Liang, Zhihan Huang, Yuxin ChenScore-Based Diffusion Model Diffusion Models
Department of Statistics and Data Science, the Wharton School, University of Pennsylvania
Filterless Snapshot Hyperspectral Imaging using Guided Patch Diffusion
Dec 3, 2024Dean Hazineh, Luca Sacchi, Davide Cassara +2Hyperspectral Image Signal Reconstruction
Harvard University
PSHuman: Photorealistic Single-image 3D Human Reconstruction using Cross-Scale Multiview Diffusion and Explicit Remeshing
Sep 16, 2024Peng Li, Wangguandong Zheng, Yuan Liu +9Avatar Reconstruction Humanml3D
HKUST · Southeast University · Tsinghua University +1
Breaking the Curse of Dimensionality: Diffusion Models Efficiently Learn Low-Dimensional Distributions
Sep 4, 2024Peng Wang, Huijie Zhang, Zekai Zhang +3Low-Dimensional Structure Diffusion Models
University of Macau · University of Michigan · University of California, Berkeley
Seed-to-Seed: Unpaired Image Translation in Diffusion Seed Space
Sep 1, 2024Or Greenberg, Eran Kishon, Dani LischinskiUnpaired Image-To-Image Translation Diffusion Models
General Motors R&D · The Hebrew University of Jerusalem
Replication in Visual Diffusion Models: A Survey and Outlook
Jul 7, 2024Wenhao Wang, Yifan Sun, Zongxin Yang +3Diffusion Models Survey
College of Computer Science and Technology, Zhejiang University, Hangzhou, Zhejiang, China
An Expectation-Maximization Algorithm for Training Clean Diffusion Models from Corrupted Observations
Jul 1, 2024Weimin Bai, Yifei Wang, Wenzheng Chen +1Diffusion Models Expectation-Maximization
Academy for Advanced Interdisciplinary Studies, Peking University · College of Future Technology, Peking University · National Biomedical Imaging Center, Peking University +3
Learn Once, Edit Anywhere: Visual Direction Transfer for Diffusion Models
Mar 28, 2024Yusuf Dalva, Hidir Yesiltepe, Pinar YanardagDiffusion-Based Image Editing Text-To-Image Diffusion Models
Virginia Tech
SimAC: A Simple Anti-Customization Method for Protecting Face Privacy against Text-to-Image Synthesis of Diffusion Models
Dec 13, 2023Feifei Wang, Zhentao Tan, Tianyi Wei +2Diffusion Models Anonymization
University of Science and Technology of China · Alibaba Cloud
Spectral Diffusion Processes
Sep 28, 2022Angus Phillips, Thomas Seror, Michael Hutchinson +3Stochastic Processes Diffusion Dynamics
Dept. of Statistics, University of Oxford, Oxford, UK. · Dept. of Computer Science ENS, CNRS, PSL University Paris, France. · Dept. of Engineering, University of Cambridge, Cambridge, UK.
TDDM-Melatt: A Decoupled Memory and Diffusion Framework for Generalizable Encrypted Traffic Classification
Date pendingZe Chen, Qiming Yu, Zijia Song +2Network Traffic Diffusion Models
National University of Defense Technology Hefei, Anhui, China
Diffusion learning reveals viable parameter manifolds and compensation geometry in biological dynamical systems
Date pendingRuilin Zhang, Louis Tao, Zhuo-Cheng XiaoDynamical Systems Manifold Perspective
Peking University–Tsinghua University–National Institute of Biological Sciences Joint Graduate Program, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing 100871, China · Center for Bioinformatics, School of Life Sciences, Peking University, Beijing 100871, China · Center for Quantitative Biology, Academy for Advanced Interdisciplinary Studies, Peking University, Beijing 100871, China +2
Tunable Latent Generative Priors for Compressed Sensing and Inverse Problems
Date pendingSean Gunn, Jorio Cocola, Oliver De Candido +2Bayesian Inverse Problems Diffusion Priors
Northeastern University · Harvard University · Technical University of Munich +1
Distilled Continuous Diffusion Language Models Can Write Code in Few Steps---or One
Date pendingFred Zhangzhi Peng, Kaiwen Zheng, Anru R. ZhangCode Generation Diffusion Language Models
Duke University · Tsinghua University
DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models
Date pendingQuanhao Li, Junqiu Yu, Kaixun Jiang +7Diffusion-Based Reinforcement Learning Methods Online-Policy Distillation
Fudan University, China · Alibaba Group, China
Generalization in VAE and Diffusion Models: A Unified Information-Theoretic Analysis
Date pendingQi Chen, Jierui Zhu, Florian ShkurtiConditional Variational Autoencoder Diffusion Models
Department of Computer Science, University of Toronto · Data Science Institute · Vector Institute +2
Denoising as Projection: Constrained Optimization with Gradient-Guided Diffusion
Date pendingRunyu Zhang, Jiawei Zhang, Gioele Zardini +2Wasserstein Gradient Flows Diffusion Models
MIT · University of Wisconsin–Madison

Jun 11, 2025, cs.CVJ/K move · Enter open · S save

ELBO-T2IAlign: A Generic ELBO-Based Method for Calibrating Pixel-level Text-Image Alignment in Diffusion Models

Qin Zhou, Zhiyang Zhang, Jinglong Wang, Xiaobin Li+4

School of Software, Beihang University, Beijing 100191, China · College of Computer and Cyber Security, Hebei Normal University, Hebei 050024, China · Department of Computer Science, The University of Hong Kong, Hong Kong

Image-Text Alignment Diffusion Alignment Text-To-Image Diffusion Models Diffusion Models Multi-Reference Image Generation Zero-Shot

Open paper AskPDF arXiv

Diffusion models excel at image generation. Recent studies have shown that these models not only generate high-quality images but also encode text-image alignment information through attention maps or loss functions. This information is valuable for various downstream tasks, including segmentation, text-guided image editing, and compositional image generation. However, current methods heavily rely on the assumption of perfect text-image alignment in diffusion models, which is not the case. In this paper, we propose using zero-shot referring image segmentation as a proxy task to evaluate the pixel-level image and class-level text alignment of popular diffusion models. We conduct an in-depth analysis of pixel-text misalignment in diffusion models from the perspective of training data bias. We find that misalignment occurs in images with small-sized, occluded, or rare object classes. Therefore, we propose ELBO-T2IAlign--a simple yet effective method to calibrate pixel-text alignment in diffusion models based on the evidence lower bound (ELBO) of likelihood. ELBO-T2IAlign is training-free and generic: it requires no additional annotations, model retraining, or architectural modifications, and it can be directly applied to different diffusion backbones. Extensive experiments on zero-shot referring image segmentation, text-guided image editing, and compositional image generation verify that the proposed calibration improves pixel-text alignment across complementary downstream tasks.

Momentum

Related topics

Latest papers 934