Overview

Diffusion language models generate text by starting from corrupted or masked sequences and repeatedly refining them, using context from both earlier and later positions. Main approaches include discrete masked diffusion, continuous latent or flow-based models, and block or hybrid designs that combine parallel refinement with autoregressive structure. Work explores adaptive token ordering, remasking, distillation, and caching to improve reasoning, code generation, multimodal tasks, and inference speed. A central tension is balancing faster, more parallel decoding against token dependencies and output quality, while reliable evaluation and the cost of training from scratch remain open challenges.

Latest papers

CardsList

494 papers69 papers in the last four weeks, down 10% on the four weeks before. 0.5% of all new papers.

  1. DreamingGoose: Staged Distillation from Autoregressive Transformers to Bidirectional Recurrent Diffusion Language Models

    Sep 28, 2026Julian Boesch, Andrew Wee, Alexander StranzlIn-Context RetrievalRecurrent Transformers

  2. Faster Block-Diffusion Serving with Distribution-Free Risk Guarantees

    Sep 27, 2026Jungseob Lee, Dongyub Jude Lee, Chanjun Park +2Diffusion Language Model InferenceLLM Inference Acceleration

  3. One Latent, Many Tokens: Jointly Learning Compressed Embeddings for Efficient Language Diffusion

    Sep 27, 2026Yulin Yuan, Ying Zhang, Xiangming MengDiffusion Language Model InferenceDiffusion Model Compression

  4. Hesitation-Aware On-Policy Distillation for Diffusion Language Models

    Sep 27, 2026Jianguo Huang, Lipeng Wan, Yanchen Deng +1Diffusion Language Model DecodingUncertainty-Aware Knowledge Distillation

  5. ForkLeft: Entropy-First Rollouts for Prefix-Aligned Autoregressive-to-Diffusion Distillation

    Sep 26, 2026Junming Liu, Jicheng Wang, Yifeng He +2Diffusion Language Model DistillationDiffusion Language Models

  6. Does Uniform Discrete Diffusion Need Time?

    Sep 25, 2026Chunsan Hong, Chieh-Hsin Lai, Satoshi Hayakawa +3Diffusion Language ModelsDiffusion Models

  7. Why Jailbreaks Succeed in Diffusion Language Models: An Energy Landscape Analysis

    Sep 25, 2026Thong Bach, Dung Nguyen, Thao Minh Le +1Jailbreak DetectionLLM Safety

  8. ELF-REG: Scaling Continuous Diffusion Language Models to Reasoning Tasks

    Sep 24, 2026Zeyu Michael Li, William Xingxu Chen, Bingshuo Qian +2Code GenerationDiffusion Language Models

  9. Informed Masking: Structure-Aware Perturbation for Reinforcement Learning in Diffusion Large Language Models

    Sep 22, 2026Xiaoyi Yu, Enver Sangineto, Pei Fu +6RL for Diffusion ModelsDiffusion Language Models

  10. Circuit Hypernetworks for Quantum-Augmented Diffusion Language Models

    Sep 21, 2026Xiaoqiang Wang, Mengyang Xiong, Jun Dai +1LLM Fine-TuningQuantum Machine Learning

  11. Less Uniform Discrete Diffusion is More Powerful and Scalable

    Sep 21, 2026Kaibo Wang, Ding Ding, Fangyu Ding +5Diffusion Language ModelsDiffusion Language Model Decoding

  12. Optimizers for Diffusion Models: A Controlled Benchmark

    Sep 19, 2026Arman Bolatov, Egor Shulgin, David Li +6Preference Optimization for Diffusion ModelsDiffusion Models

  13. CaLR: Causal Latent Revision for Robust Diffusion Reasoning

    Sep 17, 2026Wei Cai, Jian Zhao, Yuchen Yuan +1Reasoning Consistency in Language ModelsDiffusion Language Models

  14. dQwen3.5: Hybrid-Attention Diffusion Language Models

    Sep 17, 2026Anton Xue, Litu Rout, Aditya Akella +3Diffusion Language Model DecodingDiffusion Language Models

  15. Parallelism, critical windows, and separations among diffusion language models

    Sep 17, 2026Sitan Chen, Liye WangMasked Diffusion ModelsDiffusion Sampling

  16. How to Guide Your Language Flow

    Sep 16, 2026Rohit Dilip, Tianrong Chen, Yuyang Wang +3Flow MatchingDiffusion Model Guidance

  17. The Temporal Tug-of-War: Visualizing and Detecting RAG Conflicts in Diffusion Models via Trajectory Variance

    Sep 16, 2026Sravan Karthick T, Pranav Darshan, Pranav A +2Knowledge Conflicts in Language ModelsRetrieval-Augmented Generation

  18. Register Tokens for Bounded-State Reasoning in Diffusion Language Models

    Sep 14, 2026Albert Ge, Chandan Singh, Yufan Zhuang +3Memory-Augmented Language ModelsDiffusion Language Models

  19. Discrete Beckmann Transport Models for One-Step Language Modeling and Reasoning

    Sep 14, 2026Sophia Tang, Shiyi WangOne-Step Generative ModelingFlow-Based Generative Modeling

  20. Temporal Self-Distillation: Faster Inference in Discrete Diffusion Language Models

    Sep 14, 2026Shijian Xu, Andrea Miele, Metod Jazbec +3Diffusion Model DistillationDiffusion Language Model Inference

  21. DA-DLM: Explicitly Modeling Token Dependencies in Diffusion Language Models

    Sep 14, 2026Pengyu Ji, Zichen Zhang, Xiang Hu +1Non-Autoregressive Text GenerationDiffusion Language Model Decoding

  22. DenMark: Robust Semantic Watermarking for Diffusion Language Models

    Sep 13, 2026Tianhao Ma, Weihao Xuan, Dong-Dong Wu +5Diffusion Model WatermarkingRobust Watermarking