Diffusion Model Fine-Tuning

Follow this topic Ask about this topic

Momentum

19 papers in the last four weeks, against 2 the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 116

All topics

Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models
Jun 10, 2026Jia Deng, Junyi Li, Wayne Xin Zhao +3Masked Diffusion Models Diffusion Model Fine-Tuning
Gaoling School of Artificial Intelligence, Renmin University of China · Department of Data Science, City University of Hong Kong · Beijing Key Laboratory of Research on Large Models and Intelligent Governance +2
Entropy as a Structural Prior: How a Log-Barrier on DiT Belief Space Drives Musical Diversity and Development
Jun 5, 2026Zixi Li, Youzhen LiText-to-Music Generation Diffusion Transformer
Sun Yat-sen University · Datawhale
Reflection Separation from a Single Image via Joint Latent Diffusion
Jun 2, 2026Zheng-Hui Huang, Zhixiang Wang, Yu-Lun Liu +1Diffusion Models for Image Restoration Latent Diffusion Models
Shanda AI Research Tokyo · National Yang Ming Chiao Tung University · National Taiwan University
Equilibrated Diffusion: Frequency-aware Textual Embedding for Equilibrated Image Customization
Jun 1, 2026Liyuan Ma, Xueji Fang, Guo-Jun QiDiffusion Model Guidance Subject-Driven Image Generation
Westlake University · Hangzhou, China · Zhejiang University
Anchor-Conditioned Compositional Control for Landscape Image Generation
Jun 1, 2026Gadha Lekshmi P, Govind Arun, Rohith Syam +1Image Generation Compositional Image Generation
Rutgers University–New Brunswick, USA · University of Maryland–College Park, USA · University of Technology Sydney, Australia
Fine-Tuning Diffusion Models for Molecular Generation via Reinforcement Learning and Fast Sampling
May 31, 2026Guang Lin, Shikui Tu, Lei XuMolecular Optimization Diffusion Model Fine-Tuning
Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China · Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen, Guangdong, China
Revise, Don't Freeze: Sampler-Matched Training for Self-Correcting Masked Diffusion Language Models
May 31, 2026Longxuan Yu, Shaorong Zhang, Yu Fu +3Masked Diffusion Models Diffusion Model Fine-Tuning
University of California, Riverside · Microsoft
Alignment-Guided Score Matching for Text-to-Image Alignment in Diffusion Models
May 28, 2026Jaa-Yeon Lee, Yeobin Hong, Taesung Kwon +1Diffusion Model Alignment Text-Image Alignment
Graduate School of AI, KAIST, South Korea.
DLLM-JEPA: Joint Embedding Predictive Architectures for Masked Diffusion Language Models
May 24, 2026Sangdae NamMasked Diffusion Models Joint-Embedding Predictive Architecture
VESSL AI
SeqLoRA: Bilevel Orthogonal Adaptation for Continual Multi-Concept Generation
May 21, 2026Javad Parsa, Enis Simsar, Amir Joudaki +2Subject-Driven Image Generation Diffusion Model Fine-Tuning
ETH Zurich · Uppsala University, Sweden
Live Music Diffusion Models: Efficient Fine-Tuning and Post-Training of Interactive Diffusion Music Generators
May 21, 2026Zachary Novack, Stephen Brade, Haven Kim +8Diffusion Model Alignment Controllable Music Generation
UC San Diego · MIT · Adobe
Awakening the Hydra: Stabilizing Multi-Concept Backdoor Injection in Text-to-Image Diffusion Models
May 19, 2026Kai Wang, Jiale Zhang, Chengcheng Zhu +2Backdoor Attacks Diffusion Model Fine-Tuning
Yangzhou University · Nanjing University · Chongqing University +1
Drifting Objectives for Refining Discrete Diffusion Language Models
May 19, 2026Daisuke Oba, Hiroki Furuta, Naoaki OkazakiDiffusion Model Fine-Tuning Diffusion Language Models
Institute of Science Tokyo · AIST · NII LLMC
SafeDiffusion-R1: Online Reward Steering for Safe Diffusion Post-Training
May 18, 2026Komal Kumar, Ankan Deria, Abhishek Basu +3Diffusion Model Alignment Diffusion Model Fine-Tuning
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), UAE · Michigan State University (MSU), USA
Fine-tuning Pocket-Aware Diffusion Models via Denoising Policy Optimization
May 17, 2026Yuan Xue, Daniel Kudenko, Megha KhoslaMolecular Optimization Diffusion Model Fine-Tuning
L3S Research Center, Hanover, Germany · Delft University of Technology, Delft, Netherlands
Do Less, Achieve More: Do We Need Every-Step Optimization for RL Fine-tuning of Diffusion Models?
May 15, 2026Renye Yan, Jikang Cheng, Shikun Sun +7Diffusion Model Alignment Diffusion Sampling
1Peking University · 2Tsinghua University · 3Nanjing University +1
ACE-LoRA: Adaptive Orthogonal Decoupling for Continual Image Editing
May 14, 2026Yuehao Liu, Weijia Zhang, Xuanming Shang +4Continual Learning Diffusion Model Fine-Tuning
Shanghai Jiao Tong University · Nanjing University · VIVO
Mitigating Illumination-Induced Domain Shift in Night-Time Pedestrian Detection for Intelligent Vehicles using Annotation-Preserving Diffusion Augmentation
May 13, 2026Franky George, Muhammad Khalid, Adil Khan +1Synthetic Data Augmentation Domain Adaptation
School of Digital and Physical Sciences, University of Hull, UK
CRAFT: Clinical Reward-Aligned Finetuning for Medical Image Synthesis
May 12, 2026Yunsung Chung, Alex El Darzi, Carlo El Khoury +3Diffusion Model Alignment Healthcare
Department of Computer Science, Tulane University, New Orleans, LA 70118 · School of Medicine, Tulane University, New Orleans, LA 70112
Few-Shot Synthetic Data Generation with Diffusion Models for Downstream Vision Tasks
May 12, 2026Daniil Dushenev, Nazariy Karpov, Daniil Zinovjev +2Class-Imbalanced Learning Synthetic Data Augmentation
National University of Science and Technology MISIS, Moscow, Russia
Self-Distilled Trajectory-Aware Boltzmann Modeling: Bridging the Training-Inference Discrepancy in Diffusion Language Models
May 12, 2026Kecheng Chen, Ziru Liu, Xijia Tao +9Diffusion Model Distillation Diffusion Model Fine-Tuning
1City University of Hong Kong · 2Huawei Research · 3The University of Hong Kong
Efficient Adjoint Matching for Fine-tuning Diffusion Models
May 12, 2026Jeongwoo Shin, Dongsoo Shin, Yuchen Zhu +5Diffusion Model Alignment Stochastic Optimal Control
Seoul National University · Georgia Institute of Technology · Sungkyunkwan University
EditTransfer++: Toward Faithful and Efficient Visual-Prompt-Guided Image Editing
May 8, 2026Lan Chen, Qi Mao, Yiren Song +2Diffusion Transformer Diffusion Model Fine-Tuning
School of Information and Communication Engineering and the State Key Laboratory of Media Convergence and Communication, Communication University of China, Beijing 100024, China · ShowLab, National University of Singapore, 119077, Singapore · State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University, Beijing 100871, China
D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Models
May 6, 2026Dengyang Jiang, Xin Jin, Dongyang Liu +9Supervised Fine-Tuning Diffusion Model Distillation
1The Hong Kong University of Science and Technology · 2Z-Image Team, Alibaba Group · 4The Chinese University of Hong Kong +1
Ortho-Hydra: Orthogonalized Experts for DiT LoRA
May 5, 2026Seunghyun JiFine-Tuning Diffusion Transformer
SteeringDiffusion: A Bottlenecked Activation Control Interface for Diffusion Models
May 3, 2026Fangzheng Wu, Brian SummaDiffusion Model Fine-Tuning Activation Steering
Department of Computer Science Tulane University
A unified perspective on fine-tuning and sampling with diffusion and flow models
Apr 30, 2026Carles Domingo-Enrich, Yuanqi Du, Michael S. AlbergoStochastic Optimal Control Diffusion Sampling
Microsoft Research New England · Harvard University, Kempner Institute
SEAL: Semantic-aware Single-image Sticker Personalization with a Large-scale Sticker-tag Dataset
Apr 29, 2026Changhyun Roh, Yonghyun Jeong, Jonghyun Lee +2T2I Generation Identity-Preserving Image Generation
Chung-Ang University · NAVER Cloud · Lunit Inc.
ACPO: Anchor-Constrained Perceptual Optimization for Diffusion Models with No-Reference Quality Guidance
Apr 29, 2026Yang Yang, Feifan Meng, Han Fang +1Diffusion Model Guidance Diffusion Model Fine-Tuning
School of Electronic and Information Engineering, Anhui University · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center · School of Cyber Science and Technology, University of Science and Technology of China
Simple Self-Conditioning Adaptation for Masked Diffusion Models
Apr 28, 2026Michael Cardei, Huu Binh Ta, Ferdinando FiorettoMasked Diffusion Models Diffusion Model Fine-Tuning
University of Virginia

Jun 10, 2026, cs.CLJ/K move · Enter open · S save

Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models

Jia Deng, Junyi Li, Wayne Xin Zhao, Jinpeng Wang+2

Gaoling School of Artificial Intelligence, Renmin University of China · Department of Data Science, City University of Hong Kong · Beijing Key Laboratory of Research on Large Models and Intelligent Governance+2

Masked Diffusion Models Diffusion Model Fine-Tuning Diffusion Language Model Decoding Diffusion Language Models

Open paper AskPDF arXiv

Diffusion large language models (dLLMs) offer an efficient alternative to autoregressive models through parallel decoding, yet existing post-training methods largely rely on random masking strategies that overlook intrinsic token dependencies. In this work, we present an empirical analysis of attention in dLLMs and show that tokens attending more strongly to unmasked context exhibit greater generation stability and play a critical role in reasoning. Motivated by these findings, we propose AGDO, an attention-guided denoising and optimization framework that aligns both training and optimization with attention-derived dependencies. AGDO determines the denoising order based on attention structure and emphasizes attention-critical tokens during supervised fine-tuning and reinforcement learning. Experiments on mathematical and coding benchmarks demonstrate that AGDO consistently improves reasoning performance, outperforming state-of-the-art post-training methods for dLLMs.

Momentum

Related topics

Latest papers 116