Overview

Diffusion model alignment studies how to make generated images, videos, audio, 3D assets, and other outputs better match prompts, human preferences, safety requirements, or task-specific constraints. Common approaches include refining text embeddings and cross-attention, aligning internal representations with vision or domain-specific features, and post-training with preference data, reward models, or reinforcement learning. Researchers also use inference-time guidance and noise or trajectory search to steer frozen models, alongside distillation methods that transfer alignment into faster generators. A central challenge is improving alignment without reward hacking, loss of diversity or fidelity, or excessive training and sampling cost; reliable evaluation across different prompts and user preferences remains difficult.

Latest papers

CardsList

196 papers7 papers in the last four weeks, down 79% on the four weeks before. 0.1% of all new papers.

  1. When Anchors Shift the Target: Advantage-Gated Adaptation for Diffusion Reinforcement Learning

    Nov 17, 2026Pu Cao, Min Zhou, Ying Shu +3Diffusion Model AdaptationRL for Diffusion Models

  2. RiDEx: Reward-Informed Directional Exploration for Diffusion Reinforcement Learning

    Nov 17, 2026Song Yan, Chenfeng Wang, Wei Zhai +6RL for Diffusion ModelsDiffusion Model Alignment

  3. Direct Trajectory Optimization for Inference-Time Alignment of Text-to-Image Diffusion Models

    Nov 9, 2026Huixuan Zhang, Li Lin, Junzhe Zhang +1Diffusion Model AlignmentT2I Diffusion Models

  4. MG-REPA: Multi-Granularity Representation Alignment for Generative Target Speaker Extraction

    Oct 23, 2026Dohwan Kim, Jung-Woo ChoiTarget Speaker ExtractionDiffusion Model Alignment

  5. CausalAlign: Causal Alignment of Video Generation Models for Consistent Ego-Motion

    Oct 21, 2026Kai Zhu, Yintianrun Zhang, Shuwei Jiang +7Video Diffusion ModelsTemporal Consistency in Video Generation

  6. AdvFidelity: Unifying Preference Alignment and Few-Step Image Generation within Reinforcement Learning

    Oct 21, 2026Sicong Kang, Fangao Zeng, Yuhan Li +6RL for Image GenerationDiffusion-Based Image Generation

  7. Distribution-Based Regularization for Reward Fine-Tuning Diffusion and Flow Models

    Oct 17, 2026Romeo Passaro, Jeongjae Lee, Jong Chul Ye +4Generative ModelingDiffusion Model Alignment

  8. Reinforcement Learning-driven Diffusion Models: Language, Vision, and Beyond

    Oct 15, 2026Zhiyuan Ma, Jiabao Wei, Tianyu Wang +21RL for Diffusion ModelsRL for Generative Models

  9. MIDI-REPA: Improving Text-to-Music Generation with Symbolic Representation Alignment

    Oct 14, 2026Song-Ze Yu, Fang-Duo Tsai, Yi-Hsuan YangText-to-Music GenerationDiffusion Model Alignment

  10. Purify Before You Align: Improving Representation Alignment for Diffusion Models

    Oct 14, 2026Yingheng Wang, Yaoqiang Li, Yaqin Wu +4Diffusion Model AlignmentDiffusion-Based Image Generation

  11. SaTPO: Text-to-Image Safety Alignment via Transition Preference Optimization

    Oct 14, 2026Ziyi Fang, Jingzhi Li, Xiaojun Jia +3Preference Optimization for Diffusion ModelsSafe T2I Generation

  12. Risk-Averse Inference-Time Diffusion Model Alignment with Finite-Sample Guarantees

    Oct 13, 2026Yuchen Liang, Xian YuDiffusion Model AlignmentStochastic Optimization

  13. FlashVSR+: Efficient Video Super-Resolution via Hybrid Attention and Reward-Yield Distribution Matching

    Oct 13, 2026Ruchang Yao, Shi Guo, Junhao Zhuang +7Video Super-ResolutionVideo Diffusion Models

  14. MiMaAlign: Hierarchical Micro-Macro Alignment for Physically Plausible Video Generation

    Oct 12, 2026Yansong Liu, Litong Gong, Weijie Li +2Physical Consistency in Video GenerationVideo Diffusion Models

  15. GuidanceNFT: NFT-Based Reward Fine-Tuning of Guided Diffusion Models

    Oct 11, 2026Jiayin Liu, Zeyu Michael Li, Bingshuo Qian +1Diffusion Model Fine-TuningT2I Diffusion Models

  16. GeoFix: Geometry Fixing for 4D Consistent Generation

    Oct 9, 2026Yeobin Hong, Hyojun Go, Dohun Lee +7Geometric Consistency in Video Generation4D Scene Generation

  17. InstantFusion: A Shared Latent Interface for Heterogeneous Image Generators

    Oct 9, 2026Xuanlang Dai, Jiazi Bu, Yujie Zhou +5Diffusion Model AlignmentDiffusion Models

  18. Emo-BPO: Emotion Bidirectional Preference Optimization for Diffusion-based Emotional TTS

    Oct 9, 2026Jiacheng Shi, Hongfei Du, Xinyuan Song +3Preference Optimization for Diffusion ModelsEmotional Speech Synthesis

  19. Spend Where It Matters: Particle Search with MH Refinement for Budget-Constrained Audio-Visual Alignment

    Oct 8, 2026Shivanshu Shekhar, Raghavendra Addanki, Tong Zhang +1Independent Metropolis-HastingsDiffusion Model Alignment

  20. DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models

    Oct 8, 2026Zhenglin Wan, Jiayu Chen, Zhengfeiyang Zhang +6Diffusion Model Fine-TuningRL for Diffusion Models

  21. Personalize at Test Time: Learning User Preferences for Image Generation

    Oct 6, 2026Jiamu Bai, Jiaming Hu, Yanhong Wu +1User Preference ModelingDiffusion Model Alignment

  22. Learning to Read the Contextual Tokens in Diffusion Transformers

    Oct 5, 2026Omer Dahary, Etai Sella, Hadar Averbuch-Elor +2Diffusion Model AlignmentDiffusion Transformer

  23. Representation-Space MMD for Diffusion Language Models

    Oct 5, 2026Ilya Drobyshevskiy, Ilia Sudakov, Maksim Semenov +7Diffusion Model AlignmentMaximum Mean Discrepancy

  24. MGPO: Manifold-Guided Diffusion Alignment for Task-Aware Dataset Distillation

    Oct 4, 2026Yunyi Chen, Chenru Wang, Xinyi Ye +2Diffusion Model AlignmentDataset Distillation

  25. Geometry-Aware Preference Optimization for Text-to-Image Diffusion Models

    Oct 4, 2026Lei Wang, Zhen Wang, Yuexiang Xie +1Preference Optimization for Diffusion ModelsDiffusion Model Alignment