Overview

Diffusion language models generate text by starting from corrupted or masked sequences and repeatedly refining them, using context from both earlier and later positions. Main approaches include discrete masked diffusion, continuous latent or flow-based models, and block or hybrid designs that combine parallel refinement with autoregressive structure. Work explores adaptive token ordering, remasking, distillation, and caching to improve reasoning, code generation, multimodal tasks, and inference speed. A central tension is balancing faster, more parallel decoding against token dependencies and output quality, while reliable evaluation and the cost of training from scratch remain open challenges.

Latest papers

CardsList

494 papers69 papers in the last four weeks, down 10% on the four weeks before. 0.5% of all new papers.

  1. Multi-Stream Residual Computation in Diffusion Language Models

    Oct 13, 2026Ekaterina Alimaskina, Suren Kazarian, Gleb Molodtsov +1Diffusion Language ModelsMasked Diffusion Models

  2. Match the Canvas, Not Just the Answer: Predictability-Aware SFT for Diffusion Language Models

    Oct 13, 2026Miao Li, Hanyang Jiang, Hengyu Fu +8Diffusion Language ModelsDiffusion Model Fine-Tuning

  3. The Tokens Strike Back: Safety-Aware Denoising with Directional Embedding-based Revision

    Oct 13, 2026Amman Yusuf, Jiwoo Shin, Ruizhi Deng +3Diffusion Model GuidanceLLM Safety

  4. JustOPD: On-Policy Distillation from Autoregressive to Diffusion Language Models

    Oct 12, 2026Zikun Zhang, Jiayuan Sheng, David D. Yao +1Diffusion Language Model DistillationOn-Policy Distillation

  5. Label Collapse in Diffusion Language Model In-Context Learning

    Oct 12, 2026Ziye Guo, Ye YuanIn-Context LearningLLM Evaluation

  6. Rate-Resolved Text Evaluation with Masked Diffusion Language Models

    Oct 11, 2026Yiqi Liu, Kun Zhao, Chenghua Lin +1Language Model Generation EvaluationDiffusion Language Models

  7. Only What You've Signed up For: Secure Workflows with Constrained Diffusion Agents

    Oct 10, 2026Michael Cardei, Anjun Hu, Chenrui Ma +4AI Agent SecurityPrompt Injection Defense

  8. Anchors Enhance Controllability and Reasoning of Diffusion Language Models

    Oct 10, 2026Feiyu Qu, Zheng Huang, Andrea ZanetteDiffusion Language ModelsLLM Reasoning

  9. Next-Concept Modeling: Fast, Parallel Coarse-to-Fine Text Generation

    Oct 9, 2026Hermann Kumbong, Ishan S. Khare, Iddah Mlauzi +6Text GenerationNon-Autoregressive Text Generation

  10. Masked Diffusion Language Agents for Tool-Integrated Chemical Reasoning

    Oct 9, 2026Mengdi Liu, Chenghao Jia, Hong Chang +1Chemical Reasoning in LLMsLLM Tool Use

  11. Plan-and-Patch: Diffusion Language Models for Agentic Planning

    Oct 7, 2026Syamantak Kumar, Jiang Guo, Hassan Hamad +6LLM PlanningDiffusion-Based Planning

  12. Denoising Blocks, Not Tokens: Efficient Compressed Continuous Diffusion with Branching Token Realization

    Oct 7, 2026Xinsong Feng, Peng Du, Zhizhuo Yang +3Diffusion Language ModelsDiffusion Language Model Inference

  13. Denoising Hierarchical Representations: Joint Continuous Diffusion for Language Modeling

    Oct 6, 2026Mathias Ollu, Nikos KomodakisLanguage ModelingDiffusion Language Models

  14. Representation-Space MMD for Diffusion Language Models

    Oct 5, 2026Ilya Drobyshevskiy, Ilia Sudakov, Maksim Semenov +7Diffusion Model AlignmentMaximum Mean Discrepancy

  15. SOL: Measuring Gaps between Text Distributions by Double Sliced Wasserstein Metrics

    Oct 5, 2026Gregor Kornhardt, Moritz Piening, Jannis Chemseddine +1Non-Autoregressive Text GenerationLanguage Model Generation Evaluation

  16. D-Loop: Looped Diffusion Drafting for Speculative Decoding

    Oct 5, 2026Kecheng Chen, Yuyang He, Cheng Gong +8Speculative Decoding for Diffusion Language ModelsDiffusion Language Model Decoding

  17. Noise Out, Bias In: Targeted Bias Injection in Diffusion Language Models via Closed-Loop Activation Steering

    Oct 5, 2026Sarim Hashmi, Mukul Ranjan, Abdelrahman Elsayed +3Adversarial Attacks on Diffusion ModelsDiffusion Language Models

  18. Towards Unbiased On-Policy Distillation for Block Diffusion Language Models

    Oct 4, 2026Zaiquan Yang, Fei Wei, Yong Wang +6Blockwise Diffusion Language ModelsOn-Policy Distillation

  19. ALoDLM: Adaptively Looped Diffusion Language Models

    Oct 3, 2026Liancheng Fang, Zhuowei Li, Youngeun Kim +10Adaptive Computation for Diffusion ModelsDiffusion Language Models

  20. Preserving Mathematical Reasoning in Compressed Diffusion Language Models via Trajectory-Aware Low-Rank Approximation

    Oct 2, 2026Tian Liang, Zishan Shao, Yiran ChenDiffusion Model CompressionLow-Rank Compression