Diffusion Model Fine-Tuning

Overview

Diffusion model fine-tuning studies how to adapt pretrained image, video, audio, molecular, and language generators without rebuilding them from scratch. Parameter-efficient methods such as LoRA, prompt tuning, and adapters support personalization and domain adaptation, while supervised training and self-generated trajectories target tasks such as image editing, restoration, and masked-language-model refinement. For preference alignment and constrained generation, reinforcement learning methods such as GRPO, reward matching, and distillation optimize outputs using reward signals, often on benchmarks for text-image alignment, generation quality, or downstream utility. A central tension is improving the requested behavior while preserving the model’s general capabilities and diversity, with training cost, limited data, and reward hacking complicating that balance.

Latest papers

CardsList

192 papers12 papers in the last four weeks, down 68% on the four weeks before. 0.1% of all new papers.

  1. SemMask: Semantic-Prioritized Progressive Masking for Diffusion Language Models

    Nov 14, 2026Qi Chen, Zifeng Cheng, Zhiwei Jiang +1Diffusion Language ModelsText Generation

  2. Overcoming Spurious Correlations in Conditional Diffusion Models via Doubly Robust Target Correction

    Nov 12, 2026Eiichi Sakurai, Kenji YamanishiDiffusion Model Fine-TuningConditional Diffusion Models

  3. Geometric Relevance Is Not Sufficient: Evaluating Focused Post-Training Supervision in Diffusion Docking

    Nov 5, 2026Michael Brown, Maryam Rahimimovassagh, Mehdi Yazdani-Jahromi +2Molecular DockingSupervised Fine-Tuning

  4. FewStepRL: Fine-tuning Few-step Diffusion Models with Reinforcement Learning

    Nov 5, 2026Haitao Lin, Minsi Ren, Yang Li +4Diffusion Model Fine-TuningRL for Diffusion Models

  5. Improving Long-Tail Detection via Layout-Instruction Conditioned Diffusion Synthesis

    Nov 5, 2026Xinyu Zhang, Xiaodi Wang, Yanpeng Sun +3Synthetic Data GenerationObject Detection

  6. TailSteer: Trajectory-Tail Steering for Drift-Resistant Multi-turn Image Editing

    Nov 4, 2026Ruikang Li, Zixuan Chen, Jiarui Wu +6Multi-Turn Image EditingDiffusion-Based Image Editing

  7. Multi-Objective Generative Optimization via Expected Hypervolume Fine-Tuning

    Nov 3, 2026Juan Guevara, Riccardo De Santi, Andreas Krause +1Generative ModelingMulti-Objective Optimization

  8. Restrained Diffusion Bridges: Targeted Denoiser Training and Refinement

    Nov 1, 2026Xuanxi Zhang, Kevin S. Cheng, Weizhou Wang +2Diffusion ModelsDiffusion Model Fine-Tuning

  9. A First-Step Bias Restores Lost Diversity in Diffusion Model Distillation

    Oct 27, 2026Wenwu Tang, Dong Wang, Yun Cheng +1Diffusion Model DistillationDiffusion Models

  10. Concept Acupuncturist: An Efficient and Precise Concept Erasure Method for Diffusion Models via Sparse Autoencoders

    Oct 23, 2026Yiran Xiahou, Siliang Qin, Kai Chen +2Diffusion Model UnlearningConcept Erasure

  11. DualHeads: Reward-tilted few-step diffusion made simple

    Oct 20, 2026Yuanzhi Zhu, Eleftherios Tsonis, Simo Alami Chehboune +3Diffusion-Based Image GenerationDiffusion Model Fine-Tuning

  12. LED: Improving Masked Diffusion Language Models by Lookahead Editing

    Oct 16, 2026Yuyan Zhou, Zeyuan Yang, Yuxuan Song +5Diffusion Language Model DecodingMasked Diffusion Models

  13. DiffusionRVGE: Reinforcement Learning via Regression-Based Value Gradient Estimation

    Oct 16, 2026Jiayuan Wang, Tongyao PangRL for Image GenerationRL for Diffusion Models

  14. FlashControl: One-Step Controllable Generator via Distillation-Friendly Single-Stream Teachers

    Oct 15, 2026Ngan Nguyen, Dung Nguyen, Quan Dao +4Spatially Grounded Image GenerationControllable Image Generation

  15. Match the Canvas, Not Just the Answer: Predictability-Aware SFT for Diffusion Language Models

    Oct 13, 2026Miao Li, Hanyang Jiang, Hengyu Fu +8Diffusion Language ModelsDiffusion Model Fine-Tuning

  16. GuidanceNFT: NFT-Based Reward Fine-Tuning of Guided Diffusion Models

    Oct 11, 2026Jiayin Liu, Zeyu Michael Li, Bingshuo Qian +1Diffusion Model Fine-TuningT2I Diffusion Models

  17. DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models

    Oct 8, 2026Zhenglin Wan, Jiayu Chen, Zhengfeiyang Zhang +6Diffusion Model Fine-TuningRL for Diffusion Models

  18. Ambient Discrete Diffusion: Using the Wrong Data at the Right Time for Data Efficient Learning

    Oct 8, 2026Julian Kleutgens, Mauricio Tec, Claudio Battiloro +2Diffusion ModelsMasked Diffusion Models

  19. Are Parameter-Efficient Fine-tuning Methods Really Different?

    Oct 6, 2026Yikuan Li, Pinyan Lu, Fanghui LiuParameter-Efficient Fine-TuningLow-Rank Adaptation

  20. MaRK: Markov-adapted Recurrent Kernels for Dynamic Operator Conditioning in State Space Models

    Oct 6, 2026Syed Ibrahim Omer, Ginny Y. Wong, Xiangyu ZhaoState Space ModelsDiffusion Model Fine-Tuning

  21. LiDAR Resolution Recovery via Foundation-Model-Guided Diffusion

    Oct 6, 2026Samed Doğan, Nico Leuze, Alfred SchöttlDiffusion Model GuidanceDepth Completion

  22. Adapting a Latent Audio Diffusion Model to Historical Guqin Recordings: A Listening-Driven Case Study

    Oct 5, 2026Huanchen CaiText-to-Music GenerationMusic Generation Evaluation

  23. Internalizing Agent Experience into Diffusion Model Weights via On-Policy Context Distillation

    Oct 5, 2026Wenxuan Wang, Zekai Liu, Weinan Zhang +2T2I Diffusion ModelsContext Distillation

  24. Protecting Sensitive Data in Image Synthesis via PAC-Private Adaptation for Diffusion Models

    Oct 2, 2026Boming Miao, Tao Zhang, Netanel Raviv +3Privacy-Preserving MLDiffusion-Based Image Generation

  25. IDRF: Inverse-Distilled Reward Fine-tuning of Masked Discrete Diffusion Models

    Oct 2, 2026Vladislav Gromadskii, David Li, Samson Gourevitch +4Diffusion Model Fine-TuningMasked Diffusion Models

  26. CLASP: Continual Low-rank Adapters for Spatially Placed Concepts from One Hypernetwork

    Oct 1, 2026Wojciech Gromski, Patryk Krukowski, Jan Miksa +2Subject-Driven Image GenerationT2I Generation