Diffusion Model Distillation

Follow this topic Ask about this topic

Momentum

24 papers in the last four weeks, up 300% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 131

All topics

HorizonDrive: Self-Corrective Autoregressive World Model for Long-horizon Driving Simulation
May 12, 2026Conglang Zhang, Yifan Zhan, Qingjie Wang +10World Model Learning Long-Horizon Video Generation
Wuhan University · The University of Tokyo · Horizon Robotics +3
Infinite Mask Diffusion for Few-Step Distillation
May 11, 2026Jaehoon Yoo, Wonjung Kim, Chanhyuk Lee +1Masked Diffusion Models Diffusion Model Distillation
Korea Advanced Institute of Science and Technology (KAIST)
TAD: Temporal-Aware Trajectory Self-Distillation for Fast and Accurate Diffusion LLM
May 10, 2026Haoyang Zhou, Li Kong, Shijie Ren +4Diffusion Model Distillation Diffusion Language Model Inference
Gaoling School of Artificial Intelligence, Renmin University of China · Ant Group
Noise-Started One-Step Real-World Super-Resolution via LR-Conditioned SplitMeanFlow and GAN Refinement
May 10, 2026Wei Zhu, Kai Zhang, Yu Zheng +3Flow Matching Diffusion Model Distillation
Nanjing University of Science and Technology · Nanjing University · Huawei
Probability-Flow Distillation: Exact Wasserstein Gradient Flow for High-Fidelity 3D Generation
May 9, 2026Rohith Ramanan, A. N. RajagopalanDiffusion Model Distillation Wasserstein Gradient Flows
Department of Physics Indian Institute of Technology Madras · Department of Electrical Engineering Indian Institute of Technology Madras
FlashClear: Ultra-Fast Image Content Removal via Efficient Step Distillation and Feature Caching
May 9, 2026Yixin Tang, Jiawei Guo, Junxian Li +6Diffusion Model Distillation Few-Step Diffusion Sampling
Shanghai Jiao Tong University · Nanyang Technological University · Honor Device Co., Ltd
Normalizing Trajectory Models
May 8, 2026Jiatao Gu, Tianrong Chen, Ying Shen +3Normalizing Flows Diffusion Model Distillation
Apple · UIUC
Stochastic Transition-Map Distillation for Fast Probabilistic Inference
May 8, 2026George Rapakoulias, Peter Garud, Lingjiong Zhu +1Diffusion Model Distillation MeanFlow
Department of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA · Department of Computer Science, Georgia Institute of Technology, Atlanta, GA · Department of Mathematics, Florida State University, Tallahassee, FL
Teacher-Feature Drifting: One-Step Diffusion Distillation with Pretrained Diffusion Representations
May 8, 2026Yuan Zhang, Chenyi Li, Guoqing Ma +7Diffusion Model Distillation Diffusion Sampling
JD Explore Academy, China · The Hong Kong University of Science and Technology · Tsinghua University +1
LENS: Low-Frequency Eigen Noise Shaping for Efficient Diffusion Sampling
May 8, 2026Haewon Jeon, Si-Hyeon LeeDiffusion Model Distillation Few-Step Diffusion Sampling
School of Electrical Engineering Korea Advanced Institute of Science and Technology (KAIST) Daejeon, South Korea
D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Models
May 6, 2026Dengyang Jiang, Xin Jin, Dongyang Liu +9Supervised Fine-Tuning Diffusion Model Distillation
1The Hong Kong University of Science and Technology · 2Z-Image Team, Alibaba Group · 4The Chinese University of Hong Kong +1
Stream-R1: Reliability-Perplexity Aware Reward Distillation for Streaming Video Generation
May 5, 2026Bin Wu, Mengqi Huang, Shaojin Wu +4Video Diffusion Models Diffusion Model Distillation
University of Science and Technology of China · Independent Researcher
Mamoda2.5: Enhancing Unified Multimodal Model with DiT-MoE
May 4, 2026Yangming Shi, Shixiang Zhu, Tao Shen +14Diffusion Transformer Unified Multimodal Models
Mamoda Team, ByteDance
SlimDiffSR: Toward Lightweight and Efficient Remote Sensing Image Super-Resolution via Diffusion Model Distillation
May 4, 2026Ce Wang, Zhenyu Hu, Wanjie SunDiffusion Model Distillation Remote Sensing Image Super-Resolution
School of Remote Sensing and Information Engineering, Wuhan University; Wuhan 430079, China
Exploring Data-Free LoRA Transferability for Video Diffusion Models
May 3, 2026Yuchen Wang, Wenliang Zhong, Lichen Bai +6Video Diffusion Models Diffusion Model Distillation
Thrust of Data Science and Analytics, The Hong Kong University of Science and Technology (Guangzhou) · Thrust of Microelectronics, The Hong Kong University of Science and Technology (Guangzhou) · School of Intelligence Science and Technology, Nanjing University +1
Turning the TIDE: Cross-Architecture Distillation for Diffusion Large Language Models
Apr 29, 2026Gongbo Zhang, Wen Wang, Ye Tian +1Cross-Tokenizer Knowledge Distillation Diffusion Model Distillation
Peking University · Zhejiang University
AdvDMD: Adversarial Reward Meets DMD For High-Quality Few-Step Generation
Apr 29, 2026Xu Wang, Zexian Li, Litong Gong +2Diffusion Model Distillation Few-Step Diffusion Sampling
Shanghai Jiao Tong University · Alimama Tech
Alice v1: Distillation-Enhanced Video Generation Surpassing Closed-Source Models
Apr 27, 2026Wang Xiaoyu, Phong Nguyen, Chen ZhaoVideo Diffusion Models Diffusion Model Distillation
Mirage Team Open Source Research
ZID-Net: Zero-Inference Diffusion Prior Decoupling Network for Single Image Dehazing
Apr 26, 2026Xinheng Li, Minghao Chen, Mengqing Wu +2Diffusion Models for Image Restoration Diffusion Model Distillation
College of Information Science and Engineering, Hohai University, Changzhou, 213200, Jiangsu, China
Hallo-Live: Real-Time Streaming Joint Audio-Video Avatar Generation with Asynchronous Dual-Stream and Human-Centric Preference Distillation
Apr 26, 2026Chunyu Li, Jiaye Li, Ruiqiao Mei +4Audio-Video Generation Video Diffusion Models
Shanghai Innovation Institute · Fudan University · University of Science and Technology of China +2
Efficient Diffusion Distillation via Embedding Loss
Apr 24, 2026Jincheng Ying, Yitao Chen, Li Wenlin +2Diffusion Model Distillation One-Step Generative Modeling
School of Big Data and Artificial Intelligence Guangdong University of Finance and Economics Guangzhou, China · School of Computer Science Shandong University Qingdao, China
Allo{SR} $^2$ : Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flows
Apr 21, 2026Zihan Wang, Xudong Huang, Junbo Qiao +4Flow Matching Diffusion Model Distillation
East China Normal University · Huawei Foundation Model Dept. · Key Laboratory of Advanced Theory and Application in Statistics and Data Science
Guiding Distribution Matching Distillation with Gradient-Based Reinforcement Learning
Apr 21, 2026Linwei Dong, Ruoyu Guo, Ge Bai +3Diffusion Model Distillation Few-Step Diffusion Sampling
1Zhejiang University · 2Bytedance Inc. · 3Zhejiang Lab
Efficient Video Diffusion Models: Advancements and Challenges
Apr 17, 2026Shitong Shao, Lichen Bai, Pengfei Wan +2Model Compression Video Diffusion Models
The Hong Kong University of Science and Technology (Guangzhou), China · Kling Team, Kuaishou Technology, China · The Hong Kong University of Science and Technology, Hong Kong
Reward-Aware Trajectory Shaping for Few-step Visual Generation
Apr 16, 2026Rui Li, Bingyu Li, Yuanzhi Liang +3Diffusion Model Alignment Diffusion Model Distillation
University of Science and Technology of China HeFei, China · TeleAI ShangHai, China
TurboTalk: Progressive Distillation for One-Step Audio-Driven Talking Avatar Generation
Apr 16, 2026Xiangyu Liu, Feng Gao, Xiaomei Zhang +4Audio-Video Generation Video Diffusion Models
1MAIS, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · 3Meituan +2
BARD: Bridging AutoRegressive and Diffusion Vision-Language Models Via Highly Efficient Progressive Block Merging and Stage-Wise Distillation
Apr 15, 2026Baoyou Chen, Hanchen Xia, Peng Tu +5Vision-Language Models VLM Adaptation
Shanghai Academy of AI for Science · Fudan University · Shanghai Innovation Institute +1
Salt: Self-Consistent Distribution Matching with Cache-Aware Training for Fast Video Generation
Apr 3, 2026Xingtong Ge, Yi Zhang, Yushi Huang +6Diffusion Model Distillation Video Generation
Hong Kong University of Science and Technology · Vivix Group Limited
Spectral and Trajectory Regularization for Diffusion Transformer Super-Resolution
Mar 6, 2026Jingkai Wang, Yixin Tang, Jue Gong +6Diffusion Transformer Diffusion Model Distillation
Shanghai Jiao Tong University, China · Shenzhen Transsion Holdings Co., Ltd., China
Cross-Resolution Distribution Matching for Diffusion Distillation
Mar 6, 2026Feiyang Chen, Hongpeng Pan, Haonan Xu +3Video Diffusion Models Diffusion Model Distillation
Huawei, Shanghai & Hangzhou, China · Nanjing University of Science and Technology, Nanjing, China

May 12, 2026, cs.CVJ/K move · Enter open · S save

HorizonDrive: Self-Corrective Autoregressive World Model for Long-horizon Driving Simulation

Conglang Zhang, Yifan Zhan, Qingjie Wang, Zhanpeng Ouyang+9

Wuhan University · The University of Tokyo · Horizon Robotics+3

World Model Learning Long-Horizon Video Generation Diffusion Model Distillation World Models for Autonomous Driving Autoregressive Video Generation Autonomous Driving Simulation

Open paper AskPDF arXiv

Closed-loop driving simulation requires real-time interaction beyond short offline clips, pushing current driving world models toward autoregressive (AR) rollout. Existing AR distillation approaches typically rely on frame sinks or student-side degradation training. The former transfers poorly to driving due to fast ego-motion and rapid scene changes, while the latter remains bounded by the teacher's single-pass output length and thus provides only a limited supervision horizon. A natural question is: can the teacher itself be extended via AR rollout to provide unbounded-horizon supervision at bounded memory cost? The key difficulty is that a standard teacher drifts under its own predictions, contaminating the supervision it provides. Our key insight is to make the teacher rollout-capable, ensuring reliable supervision from its own AR rollouts. This is instantiated as HorizonDrive, an anti-drifting training-and-distillation framework for AR driving simulation. First, scheduled rollout recovery (SRR) trains the base model to reconstruct ground-truth future clips from prediction-corrupted histories, yielding a teacher that remains stable across long AR rollouts. Second, the rollout-capable teacher is extended via AR rollout, providing long-horizon distribution-matching supervision under bounded memory, while a short-window student aligns to it with teacher rollout DMD (TRD) for efficient real-time deployment. HorizonDrive natively supports minute-scale AR rollout under bounded memory; on nuScenes, HorizonDrive reduces FID by 52% and FVD by 37%, and lowers ARE and DTW by 21% and 9% relative to the strongest long-horizon streaming baselines, while remaining competitive with single-pass driving video generators.

Momentum

Related topics

Latest papers 131