Overview

Diffusion language models generate text by starting from corrupted or masked sequences and repeatedly refining them, using context from both earlier and later positions. Main approaches include discrete masked diffusion, continuous latent or flow-based models, and block or hybrid designs that combine parallel refinement with autoregressive structure. Work explores adaptive token ordering, remasking, distillation, and caching to improve reasoning, code generation, multimodal tasks, and inference speed. A central tension is balancing faster, more parallel decoding against token dependencies and output quality, while reliable evaluation and the cost of training from scratch remain open challenges.

Latest papers

CardsList

494 papers69 papers in the last four weeks, down 10% on the four weeks before. 0.5% of all new papers.

  1. Different Tasks, Different Timesteps: Temporal Task-Aware Quantization for Diffusion Language Models

    Oct 22, 2026Ofek Avivi, Eliron Rahimi, Avi Mendelson +1Neural Network QuantizationMixed-Precision Quantization

  2. SetCommit: Coordinated Token Commitments for Few-Step Diffusion Language Model Decoding

    Oct 22, 2026Yuannuo Feng, Yubing Ye, Wenshuai Yao +4Diffusion Language Model InferenceDiffusion Language Models

  3. DConstrain: Compiling Context-Parameterized Transitions for Diffusion Language Model Constrained Decoding

    Oct 22, 2026Shidong Cao, Jing Ma, Wenhao Chai +3Constrained DecodingGrammar-Constrained Decoding

  4. Random Remasking Scales Masked Diffusion Inference

    Oct 22, 2026Zhaoyi Zhou, Frank Wu, Andrea ZanetteMasked Diffusion ModelsDiffusion Language Model Inference

  5. Loopholing All the Way: Language Modeling with pure Self-Conditioning

    Oct 21, 2026Adrien Deschenaux, Nadezhda Ilieva, Justin Deschenaux +6Diffusion Language ModelsContinuous Diffusion Language Models

  6. Looped Uniform Diffusion Language Models

    Oct 21, 2026Saiteja Utpala, Chieh-Hsin Lai, Yuki Mitsufuji +1Diffusion Language ModelsDiffusion Language Model Training

  7. A Diagnostic Study of Faithfulness in Diffusion Language Models for Table-to-Text Generation

    Oct 21, 2026Zaynab Merimi, Noussayba El Marrakchi, Arthur SatoufText GenerationGrounded Text Generation

  8. Hierarchical Masked Diffusion Language Models

    Oct 21, 2026Parul Gupta, Satwik, Avni Aggarwal +5Masked Diffusion ModelsDiffusion Language Model Decoding

  9. DiffResearch: Accelerating Deep Research with Diffusion Language Models

    Oct 20, 2026Alan-Barsag Gazzaev, Alexey Gavrilov, Mikhail Mozikov +1Diffusion Language ModelsDiffusion Language Model Decoding

  10. Hidden Messages Between Diffusion Language Model Agents: Causal Evidence for Latent Communication

    Oct 20, 2026Alan-Barsag Gazzaev, Alexey Gavrilov, Sergey Muravyov +1Multi-Agent LLMsDiffusion Language Models

  11. Beyond the Sequentiality Bottleneck: A Hybrid Diffusion-Autoregressive Framework for Efficient Multimodal Reasoning

    Oct 20, 2026Wei Cai, Jian Zhao, Yuchen Yuan +1Hybrid Language ModelsParallel Reasoning in Language Models

  12. Self-Decomposing Diffusion for Code Generation

    Oct 20, 2026Lize Shao, Zichen Xie, Zhizhen Chen +2Code GenerationLLM Code Generation

  13. Beyond Model Weights: Sampling-Dependent Fairness in Diffusion Language Models

    Oct 20, 2026Koshiro Saito, Daisuke Oba, Danushka Bollegala +1Social Bias in Language ModelsDiffusion Language Models

  14. Factual Access States in Diffusion Language Models: From Mechanism to Knowledge Editing and Retrieval

    Oct 20, 2026Yuchen Guo, Zhuoyuan Mao, Yiwen GuoFactual Knowledge in Language ModelsDiffusion Language Models

  15. Guided Diffusion for Trustworthy Synthetic Text Generation

    Oct 19, 2026Qi Pang, Hanshen Xiao, Andre Manoel +4Synthetic Data Generation for Language ModelsDifferentially Private Synthetic Data Generation

  16. Breaking Diffusion: Parallel Reasoning with Draft Refinement

    Oct 19, 2026Jaesang Yu, Seoyeon Byun, Yun Wang +2Diffusion Language ModelsParallel Reasoning in Language Models

  17. Diffusion Language Models Change Speed Across Tasks and Languages

    Oct 19, 2026Mohsen Fayyaz, Ali Modarressi, Daniel Israel +2Diffusion Language ModelsDiffusion Language Model Inference

  18. Learning to Couple: Context-Adaptive Joint Denoising for Diffusion Language Models

    Oct 19, 2026Zilei Shao, Ian Li, Heng Zhao +4Diffusion Language Model InferenceDiffusion Language Models

  19. Enhanced Masked Diffusion Unlearning

    Oct 18, 2026Tomer Garber, Tom TirerMachine UnlearningDiffusion Model Unlearning

  20. Who Gets Unmasked? Sampler-Induced Bias in Diffusion Language Models

    Oct 17, 2026Xujun Che, Farsheed Haque, Depeng Xu +2Diffusion Language ModelsLanguage Model Bias Evaluation

  21. DiffuPlan: Editable Planning State for Diffusion Language Model Agents

    Oct 17, 2026Qisheng Zhou, Zhen Xiong, Qiaoyu TanLLM AgentsLLM Agent Planning

  22. CoTA++: Understanding the Repeat Curse in dMLLMs from an Information Flow Perspective

    Oct 16, 2026Qiyan Zhao, Xiaofeng Zhang, Xu-Yao Zhang +4Diffusion Language Model DecodingDiffusion Language Models

  23. On the SPOT: Enhancing Speculative Decoding for Diffusion Language Models via Commit-Order Prediction

    Oct 15, 2026Eliezer Shlomi, Eliron Rahimi, Avi Mendelson +1Speculative Decoding for Diffusion Language ModelsDiffusion Language Models

  24. Designing Transformers for Continuous Diffusion Language Models

    Oct 15, 2026Weijian Luo, Yujian Chen, Hao Jiang +2Diffusion Language ModelsContinuous Diffusion Language Models

  25. Multi-Target Few-Shot Prompting with Diffusion Language Models

    Oct 15, 2026Anton Xue, Alan Li, Rahul SahaFew-Shot PromptingDiffusion Language Models

  26. Diffusion Language Models as Open Quantum Systems

    Oct 15, 2026Akinori Tanaka, Yukinao Akamatsu, Takuki Tomita +1Diffusion Language ModelsQuantum Generative Modeling

  27. On-Policy Residual Learning for Diffusion Language Models

    Oct 14, 2026Yifan Yu, Yuqing Jian, Jisen Li +9Diffusion Language ModelsDiffusion Language Model Inference

  28. ForkGRPO: Efficient Exploration and Fine-Grained Credit Assignment for Diffusion Language Models

    Oct 14, 2026Zhaoyan Jia, Chengwei Zhou, Gourav Datta +1RL for Language Model ReasoningRL for Diffusion Models