Overview

Diffusion language models generate text by starting from corrupted or masked sequences and repeatedly refining them, using context from both earlier and later positions. Main approaches include discrete masked diffusion, continuous latent or flow-based models, and block or hybrid designs that combine parallel refinement with autoregressive structure. Work explores adaptive token ordering, remasking, distillation, and caching to improve reasoning, code generation, multimodal tasks, and inference speed. A central tension is balancing faster, more parallel decoding against token dependencies and output quality, while reliable evaluation and the cost of training from scratch remain open challenges.

Latest papers

CardsList

494 papers69 papers in the last four weeks, down 10% on the four weeks before. 0.5% of all new papers.

  1. Hierarchical Continuous Diffusion Language Models

    Oct 1, 2026Hui Ren, Zihan Li, Chang Liu +2Structured Reasoning in Language ModelsDiffusion Language Model Decoding

  2. ITC-MoE: Importance-guided Token-aware Compression for MoE Diffusion Language Models

    Oct 1, 2026Lianjun Liu, Shipeng Li, You Huang +5Tucker DecompositionMixture-of-Experts Language Models

  3. Know When to Hold 'em: Correct-Token Retention in Uniform-State Diffusion Language Models

    Oct 1, 2026Mojtaba Nafez, James HendersonDiffusion Language Model DecodingDiffusion Language Models

  4. Temporally-Resolved Token Attribution Reveals the Generation Dynamics of Diffusion Language Models

    Oct 1, 2026Darpan Aswal, Céline HudelotIntegrated GradientsLLM Interpretability

  5. Scaling and Distilling Text Embeddings for Better Diffusibility

    Oct 1, 2026Zekai Zhang, Yunjie Tian, Yanjin He +4Word EmbeddingsLanguage Model Distillation

  6. Two Clocks in Diffusion MLLMs: When Answers Stabilize Before Rationales Unfold

    Oct 1, 2026Keuntae Kim, Yong Suk ChoiVLM EvaluationVisual Question Answering

  7. Exploring More, Reasoning Better: Stepwise Risk-Sensitive GRPO for Diffusion Language Models

    Sep 30, 2026Yue Yu, Bowen Zuo, David Crandall +2RL for Language Model ReasoningGroup Relative Policy Optimization

  8. Distribution Matching Distillation for Continuous Diffusion Language Models

    Sep 30, 2026Paul Le Van Kiem, Dario Shariatian, Umut Simsekli +1Continuous Diffusion Language ModelsDiffusion Language Model Distillation

  9. PassGPT+: Leveraging Linguistic Priors for Password Modeling

    Sep 30, 2026Rajneesh Anand, Neeraj Lakshmanan, Masoud YariAutoregressive Language ModelingDiffusion Language Models

  10. GroundAnything: Reconciling Parallel Decoding with Precise Visual Grounding at Flash Speed

    Sep 30, 2026Qize Yu, Lianrui Fan, Bowen Ping +19Efficient VLM InferenceVision-Language Grounding

  11. Does This Action Still Explain the Task? Reverse Scoring for Diffusion Language Model Agents

    Sep 29, 2026Jiacheng Qiu, Christopher E. Mower, Jan Peters +2Diffusion Language Model DecodingLLM Agents

  12. DEdit: Iterative Draft Editing for Speculative Decoding

    Sep 29, 2026Longxuan Yu, Bingsen Chen, Peng Shi +9Efficient Language Model InferenceSpeculative Decoding for Diffusion Language Models

  13. Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting

    Sep 29, 2026Loay Mualem, Lluís Pastor-Pérez, Vinh Tong +4Masked Diffusion ModelsDiffusion Model Fine-Tuning

  14. Acceleration of Diffusion Language Model through Discrete Average Generator

    Sep 29, 2026Yidong Ouyang, Zhengyan Wan, Themis Haris +8Few-Step Diffusion SamplingDiffusion Language Model Inference

  15. Alpha Diffusion Language Models: Factorization Alone Is Not the Problem

    Sep 29, 2026Nikita Gushchin, Dmitry Baranchuk, Alexander KorotinDiffusion Language ModelsDiffusion Language Model Training

  16. On Trajectory-Aware Training for Masked Diffusion Language Models

    Sep 29, 2026Manuel Madeira, Amitis Shidani, Alice Bizeul +6Masked Diffusion ModelsDiffusion Language Model Inference

  17. E-MoE: Enhanced Mixture-of-Experts for Non-Factorized Diffusion Language Models

    Sep 29, 2026Arseny Ivanov, Alexander Kolesov, Alexander Korotin +2Masked Diffusion ModelsFew-Step Diffusion Sampling

  18. Rethinking Soft Tokens for Parallel Decoding in Diffusion Language Models

    Sep 29, 2026Kodai Kawamura, Kenji Kawaguchi, Anji LiuLanguage Model DecodingDiffusion Language Model Decoding

  19. Reasoning with Continuous Latent Diffusion

    Sep 28, 2026Xiang ChengNumerical Reasoning in Language ModelsCode Generation

  20. FluxLite: Inference-Time Proposal Control for Discrete Diffusion Models

    Sep 28, 2026Yinuo Ren, Haoxuan Chen, Grant M. Rotskoff +2Diffusion SamplingDiffusion Models

  21. Simplex Diffusion Models

    Sep 28, 2026Justin Deschenaux, Alexandre Galashov, Andrew Campbell +4Diffusion SamplingDiffusion Language Models

  22. Learning to Re-Draft: A Variational Stackelberg Game for Discrete Diffusion

    Sep 28, 2026Dmitrii Moor, Federico Tomasi, Paul N. Bennett +2Bilevel OptimizationMolecular Generation

  23. BV Loss: Block Verification-Aware Loss for Block Diffusion Speculative Decoding

    Sep 28, 2026Suyoung Kim, Jahyun Koo, Hyeonjin Kim +5Speculative DecodingDiffusion Language Model Decoding