Diffusion Model Alignment

Follow this topic Ask about this topic

Momentum

14 papers in the last four weeks, up 250% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 131

All topics

Personalize at Test Time: Learning User Preferences for Image Generation
Oct 6, 2026Jiamu Bai, Jiaming Hu, Yanhong Wu +1User Preference Modeling Diffusion Model Alignment
Penn State University · Meta · Boston University +1
Learning to Read the Contextual Tokens in Diffusion Transformers
Oct 5, 2026Omer Dahary, Etai Sella, Hadar Averbuch-Elor +2Diffusion Model Alignment Diffusion Transformer
Tel Aviv University · Cornell University
Representation-Space MMD for Diffusion Language Models
Oct 5, 2026Ilya Drobyshevskiy, Ilia Sudakov, Maksim Semenov +7Diffusion Model Alignment Maximum Mean Discrepancy
Yandex Research · HSE University · T-Tech +3
MGPO: Manifold-Guided Diffusion Alignment for Task-Aware Dataset Distillation
Oct 4, 2026Yunyi Chen, Chenru Wang, Xinyi Ye +2Diffusion Model Alignment Dataset Distillation
AGI Lab, Westlake University · Eindhoven University of Technology · Guangdong University of Finance and Economics
Best-of- $N$ Guidance for Test-time Diffusion Alignment
Oct 4, 2026Richard Lee Kim, Yeongmin Kim, Gyuwon Sim +3Diffusion Model Alignment Diffusion Model Guidance
KAIST
iADD: Improving Alignment and Diversity in Diffusion Policy Optimization
Oct 1, 2026Ashok Prasad Neupane, Saugat Adhikari, Pramish Paudel +2Diffusion Model Alignment Generative Modeling
Pulchowk Campus, IOE, Tribhuvan University, Lalitpur, Nepal · INSAIT, Sofia University “St. Kliment Ohridski”, Bulgaria · NAAMII, Kathmandu, Nepal
Rethinking Memorization Mitigation in Diffusion Models: Reinforcing Text Conditioning
Oct 1, 2026Hyungjun Joo, Sehwan Kim, Hyeonggeun Han +2Diffusion Model Alignment Attention Control in Diffusion Models
Seoul National University · Konkuk University
Just Align $\bm{x}$ : Aligning Predictions, Not Representations
Sep 30, 2026Yuyao Zhang, Yuwei Hu, Ziyang Mai +1Diffusion Model Alignment Diffusion Transformer
Dartmouth College
PixelDense: Dense Prediction as Representation Alignment for Pixel Diffusion
Sep 30, 2026Lehan Yang, Daiqing Qi, Wenhao Zhang +9Diffusion Model Alignment Diffusion Transformer
University of Virginia · Michigan State University · Adobe +1
Fenchel Tilting: Weighted Correction for Efficient Finetuning of Generative Models
Sep 30, 2026Maksim Bobrin, Maksim Zhdanov, Dmitry DylovDiffusion Model Alignment Constrained Generative Modeling
AXXX · Applied AI Institute · MBZUAI
WEIRDO: WEak resIdual Regularized DOob's h-transform diffusion alignment
Sep 30, 2026Denis SuchkovDiffusion Model Alignment Doob H-Transform
HSE University, Russian Federation
Manifold-Constrained Initial Noise Optimization for Efficient Generative Model Alignment
Sep 30, 2026Jinho Chang, Jong Chul YeDiffusion Model Alignment Zeroth-Order Optimization
Kim Jaechul Graduate School of AI KAIST Seoul, South Korea
Steepest Guidance: A Practical and Principled Approach to Inference-Time Alignment of Flow and Diffusion-based Models
Sep 30, 2026Shokichi Takakura, Akifumi Wachi, Rei Higuchi +2Diffusion Model Alignment Inference-Time Optimization
LY Corporation · The University of Tokyo · RIKEN AIP
CoRe: Co-Evolving Reward Models for Mitigating Latent Reward Hacking in Video Diffusion Models
Sep 28, 2026Zhaolong Su, Yujin Han, Feng Wang +3Diffusion Model Alignment Reward Modeling
Cornell University · The University of Hong Kong · Johns Hopkins University
What Visual Generators Need from Teachers: Rethinking Representation Alignment
Sep 28, 2026Yongcong Wang, Hingchin Chen, Mingyu Fan +6Diffusion Model Alignment Diffusion Transformer
Central South University · The Hong Kong University of Science and Technology · Tsinghua University +7
DOHF: Online Diffusion Fine-tuning with Doob's $h$ -transform Guidance
Sep 25, 2026Zhengyi Guo, Jiayuan Sheng, Wenpin Tang +1Diffusion Model Alignment Diffusion Model Guidance
Revisiting Spectral Representations in Generative Diffusion Models
Sep 8, 2026Yuehao Wang, Peihao Wang, Hanwen Jiang +3Diffusion Model Alignment Self-Supervised Learning
University of Texas at Austin, USA · 2Adobe Research, USA
ToPO: Token-Conditioned Preference Routing for Attention-Based Latent Diffusion Models
Sep 3, 2026Juntao Xu, Shihong Li, Hoi Fan Au +1Diffusion Model Alignment Latent Diffusion Models
Tsinghua University · University of Electronic Science and Technology of China · Stanford University
VGAS: Variance-Reduced Guidance and Adaptive Selection for Training-Free Reward Alignment in Discrete Diffusion
Aug 27, 2026Kwanyoung KimDiffusion Model Alignment Diffusion Model Guidance
Department of AI, GIST
Designing Reinforcement Learning for Diffusion Models: A Unified Path-Space View
Aug 14, 2026Yixian Xu, Yuanrui Zhang, Shengjie Luo +2Diffusion Model Alignment Policy Gradient Methods
State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University · ByteDance Seed
AdvFD: Boosting Visual Generation via Adversarial Fr'echet Distance Loss
Aug 11, 2026Mingju Gao, Jingkai Zhou, Kun Gai +2Diffusion Model Alignment Diffusion Model Fine-Tuning
Peking University · KlingAI Research
RenderMatte: Exact-Alpha Rendering and Group-Relative Alignment for Image Matting
Aug 9, 2026Zecheng Ren, Yafei Hu, Jianing Zhao +3Diffusion Model Alignment Image Segmentation
Waseda University · Shanghai Jiao Tong University · National University of Singapore
Explore or Converge? Stage-Guided Per-Step Optimization for Diffusion Models
Aug 7, 2026Renye Yan, Jikang Cheng, You Wu +4Diffusion Model Alignment Temporal Credit Assignment
Peking University Beijing, China · Stanford University Stanford, California, USA
Sample-Adaptive Latent Rewards for Uncertainty-Guided Diffusion Post-Training
Aug 6, 2026Rui Li, Yuanzhi Liang, Ke Hao +4Diffusion Model Alignment Video Diffusion Models
University of Science and Technology of China, Hefei, China · Institute of Artificial Intelligence, China Telecom (TeleAI), Shanghai, China · Shanghai Jiao Tong University, Shanghai, China
Latent Reward Registers for Diffusion Preference Alignment
Aug 4, 2026Yuanshen Guan, Zipeng Feng, Chengru Song +2Diffusion Model Alignment Diffusion Model Guidance
1Kling Team · University of Science and Technology of China
SPARE: Structural Parameter-Free Affinity Regularization for Flow Matching
Aug 3, 2026Zong-Wei Hong, Jinglun Li, Shen Zhang +3Diffusion Model Alignment Flow Matching
JIIOV Technology
ROAD: Reciprocal-Objective Alignment of Discriminative Semantics for 3D Shape Generation
Jul 30, 2026Xiao Luo, Mingyang Du, Xin Zhou +5Diffusion Model Alignment 3D Shape Generation
Huazhong University of Science and Technology, China · 2Megvii, China · 3Zhejiang University, China +1
Temporal Concentration from Rollout Errors: Implicit Preference Optimization for Text-to-Video Diffusion
Jul 30, 2026Henglin Liu, Fangyuan Kong, Jing Wang +7Diffusion Model Alignment Video Diffusion Models
Tsinghua University · Kling Team, Kuaishou Technology · Sun Yat-sen University
DiFA: Inference-Time Forward-Process Alignment for Diffusion Models
Jul 20, 2026Shigui Li, Delu ZengDiffusion Model Alignment Diffusion Sampling
School of Mathematics, South China University of Technology, Guangzhou, China · School of Electronic and Information Engineering, South China University of Technology, Guangzhou, China
Selective Timestep Weighting and Advantage-Based Replay for Sample-Efficient Diffusion RLHF
Jul 8, 2026Eric Zhu, Abhinav Shrivastava, Soumik MukhopadhyayDiffusion Model Alignment RL for Diffusion Models
Carnegie Mellon University · University of Maryland, College Park
Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation
Jul 7, 2026Sakuya Ota, Qing Yu, Kent Fujiwara +2Diffusion Model Alignment Text-to-Motion Generation
Institute of Science Tokyo, Tokyo, Japan · LY Corporation, Tokyo, Japan · National Institute of Informatics (NII), Tokyo, Japan
D2PO: Optimizing Diffusion Samplers via Dynamic Preference
Jul 7, 2026Jinkyu Kim, Jinyoung Choi, Bohyung HanDiffusion Model Alignment Direct Preference Optimization
1ECE & 2IPAI, Seoul National University, Korea · 3AIGS, Ulsan National Institute of Science and Technology, Korea
Reward Lightning: Fast Video Generation via Homologous Preference Distillation
Jul 4, 2026Jiaxiang Cheng, Bing Ma, Xuhua Ren +4Diffusion Model Alignment Reward Modeling
Tencent Hunyuan, China
Self-Improving Diffusion Classifiers with Minority Preference Optimization
Jul 4, 2026Hyunsoo Kim, Jungmyung Wi, Soobin Um +2Diffusion Model Alignment Long-Tailed Classification
1Korea University · 2Kook Min University · 3Kyung Hee University
FairFlow: Demystifying and Mitigating Stereotype Bias in Text-to-Image Diffusion Transformers
Jul 3, 2026Chen Chen, Yuanmin Huang, Zhenfei Zhang +5Diffusion Model Alignment Diffusion Transformer
Fudan University Shanghai, China · East China University of Science and Technology Shanghai, China
From SRA to Self-Flow: Data Augmentation or Self-Supervision?
Jul 2, 2026Dengyang Jiang, Mengmeng Wang, Harry Yang +1Diffusion Model Alignment Data Augmentation
1The Hong Kong University of Science and Technology · 2Zhejiang University of Technology · 3Baidu Inc.
PAPA: Online Personalized Active Preference Alignment
Jul 1, 2026Anindya Sarkar, Nasik Muhammad Nafi, Isaac Lyngaas +2Diffusion Model Alignment Diffusion Model Fine-Tuning
Washington University in St. Louis · Oak Ridge National Laboratory
The Illusion of High Utility in Safety Alignment of Text-to-Image Diffusion Models
Jul 1, 2026Adeel Yousaf, Soumik Ghosh, James Beetham +2Diffusion Model Alignment Representation Learning
Institute of Artificial Intelligence University of Central Florida, Orlando, United States
FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representation
Jun 23, 2026Haorui Ji, Weizhe Liu, Hongdong Li +1Diffusion Model Alignment 3D Gaussian Splatting
The Australian National University · ByteDance
SPAR: Semantic-Pixel Self-Alignment and Adaptive Routing for Unified Multimodal Models
Jun 22, 2026Hongxiang Li, Hongxu Chen, Chenyang Zhu +5Diffusion Model Alignment Unified Multimodal Models
The Hong Kong University of Science and Technology · Xiaohongshu Inc.
PG-MAP: Joint MAP Optimization for Inference-Time Alignment of Diffusion and Flow-Matching Models
Jun 22, 2026Ruolan Sun, Pawel PolakDiffusion Model Alignment Inference-Time Language Model Alignment
Stony Brook University
FlowBender: Feedback-Aware Training for Self-Correcting Conditional Flows
Jun 18, 2026Daniel Gilo, Sven Elflein, Ido Sobol +1Diffusion Model Alignment Diffusion Models for Image Restoration
1Technion · 2NVIDIA · University of Toronto +1
NoiseTilt: Noise-Tilted Reverse Kernels for Diffusion Reward Alignment
Jun 16, 2026Jisung Hwang, Yunhong Min, Jaihoon Kim +2Diffusion Model Alignment Diffusion Model Guidance
1KAIST · †This work was done in part while the author was a visiting researcher at The University of Tokyo. · 2The University of Tokyo
STAR: SpatioTemporal Adaptive Reward Allocation for Text-to-Image RL Post-Training
Jun 16, 2026Jinjie Shen, Wei Deng, Xian Hu +2Diffusion Model Alignment Compositional T2I Generation
Pulling The REINS: Training-Free Safety Alignment of Video Diffusion Models via Representation Steering
Jun 15, 2026Rohit Kundu, Arindam Dutta, Sarosij Bose +2Diffusion Model Alignment Video Diffusion Models
University of California, Riverside · YouTube (Google)
GraphBEV++: Multi-Modal Feature Alignment for Autonomous Driving
Jun 15, 2026Ziying Song, Caiyan Jia, Lin Liu +3Diffusion Model Alignment End-to-End Autonomous Driving
Beijing Key Laboratory of Traffic Data Mining and Embodied Intelligence, School of Computer Science and Technology, Beijing Jiaotong University · School of Artificial Intelligence (School of Software), Yanshan University · University of Macau +2
HPSv3++: Scaling Reward Models Across the Full Spectrum of Diffusion Model Capabilities
Jun 12, 2026Yijun Liu, Jie Huang, Zeyue Xue +5Diffusion Model Alignment Multimodal Reward Modeling
Tsinghua University · JD Explore Academy · Peking University +1
PepALD: Macrocyclic Peptide Generation via Autoregressive Latent Diffusion
Jun 12, 2026Junming Zhang, Siyu Yi, Wei Ju +1Diffusion Model Alignment Autoregressive Diffusion
College of Computer Science, Sichuan University, Chengdu, 610065, China · School of Mathematics, Sichuan University, Chengdu, 610065, China · School of Artificial Intelligence, Sichuan University, Chengdu, 610065, China +1
MaskAlign: Token-Subset Representation Alignment for Efficient Diffusion Training
Jun 7, 2026Lianyu Pang, Tianlin Pan, Cheng Da +5Diffusion Model Alignment Diffusion Transformer
The Hong Kong University of Science and Technology · Kuaishou Technology · University of Chinese Academy of Sciences
Where, What, Why, and Importance: Structured Defect Grounding for Text-to-Image Feedback
Jun 4, 2026Huaisong Zhang, Hao Yu, Yuxuan Zhang +7Diffusion Model Alignment T2I Generation Evaluation
Tsinghua University · University of British Columbia · Vector Institute +2
CDPM-Align: Multi-Scale Guidance-Aligned Diffusion Pretraining for Robust Few-Shot Anatomical Landmark Detection
Jun 3, 2026Roberto Di Via, Irina Voiculescu, Francesca Odone +1Diffusion Model Alignment Diffusion Model Guidance
MaLGa, DIBRIS, University of Genoa, Italy · Department of Computer Science, University of Oxford, UK
Drifting Preference Optimization for One-Step Generative Models
Jun 1, 2026Zhou Jiang, Yandong Wen, Zhen LiuDiffusion Model Alignment One-Step Generative Modeling
Westlake University · The Chinese University of Hong Kong, Shenzhen
FairGen: Preference-Aligned Diffusion for Demographically Equitable Medical Image Synthesis
Jun 1, 2026Zhimin Li, Ruichen Zhang, Zhen Tan +3Diffusion Model Alignment Synthetic Data Augmentation
University of Pittsburgh, Swanson School of Engineering, Pittsburgh, 15261, USA · 2The University of North Carolina at Chapel Hill, Department of Computer Science, Chapel Hill, 27599, USA · 3Arizona State University, School of Computing and Augmented Intelligence, Tempe, 85281, USA +1
Pave-GRPO: Beyond Instantaneous Guidance through Principled Average Velocity Decomposition
Jun 1, 2026Pengyang Ling, Jiazi Bu, Yujie Zhou +6Diffusion Model Alignment Group Relative Policy Optimization
University of Science and Technology of China, China · Shanghai Jiao Tong University, China · Fudan University, China +3
Decoupled Residual Denoising Diffusion Models for Unified and Data Efficient Image-to-Image Translation
May 31, 2026Ziyue Lin, Jiahe Hou, Hongyu Xia +6Diffusion Model Alignment Image-to-Image Translation
1The University of Hong Kong · 2Shenyang Institute of Automation, Chinese Academy of Sciences · 3The Chinese University of Hong Kong +1
Improving Visual Representation Alignment Generation with GRPO
May 30, 2026Shentong Mo, Sukmin YunDiffusion Model Alignment Diffusion Transformer
Carnegie Mellon University · Hanyang University
Parallel Tempering Initial Sampling in Inference-Time Reward Alignment
May 29, 2026Myeongjun Oh, Gwangho Kim, Sungyoon LeeDiffusion Model Alignment Markov Chain Monte Carlo
Department of Artificial Intelligence 2Department of Computer Science Hanyang University, Seoul, Korea
DiffCrossGait: Trajectory-Level Alignment for 2D-3D Cross-Modal Gait Recognition via Latent Diffusion
May 29, 2026Zhiyang Lu, Ming ChengDiffusion Model Alignment Latent Diffusion Models
1Fujian Key Laboratory of Urban Intelligent Sensing and Com · 2Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Min
Alignment-Guided Score Matching for Text-to-Image Alignment in Diffusion Models
May 28, 2026Jaa-Yeon Lee, Yeobin Hong, Taesung Kwon +1Diffusion Model Alignment Text-Image Alignment
Graduate School of AI, KAIST, South Korea.
GAP3D: Generative Alignment of VLM Latents to Patch-Level Embeddings for 3D Generation
May 27, 2026Polytimi Anna Gkotsi, Andrii Zadaianchuk, Mohammad Mahdi DerakhshaniDiffusion Model Alignment 3D Asset Generation
University of Amsterdam, The Netherlands

Oct 6, 2026, cs.CVJ/K move · Enter open · S save

Personalize at Test Time: Learning User Preferences for Image Generation

Jiamu Bai, Jiaming Hu, Yanhong Wu, Zellux Wang

Penn State University · Meta · Boston University+1

User Preference Modeling Diffusion Model Alignment Image Generation Reward Modeling Diffusion Model Guidance

Open paper AskPDF arXiv

Diffusion models can generate high-quality images, yet aligning their outputs with individual user preferences remains challenging. A key bottleneck is accurately modeling diverse user preferences from limited feedback. Existing approaches often rely on labor-intensive manual preference annotations or vision-language models (VLM) to extract preference information from user interaction histories, introducing substantial annotation or computational costs that limit scalability. We propose an approach that learns personalized reward models directly from users' historical image preference pairs. First, we use an autoencoder to compress hundreds of visual attributes into 50 attribute-anchored preference dimensions and train an evaluator to score images along these dimensions. We then represent each user's preferences as a linear combination of the shared dimension scores, estimating the user-specific weights by maximizing the likelihood of their observed pairwise preferences under the Bradley-Terry model. This formulation reduces per-user adaptation to optimizing a low-dimensional weight vector, simplifying optimization and enabling data-efficient personalization from sparse feedback. The learned personalized rewards guide image generation at inference time while keeping the diffusion model frozen. Experiments on real-user preference data show that our approach achieves approximately 77% held-out pairwise preference prediction accuracy and improves the alignment of generated images with individual user preferences.

Momentum

Related topics

Latest papers 131