Overview

Masked diffusion models learn to generate discrete sequences by corrupting tokens—often replacing them with masks—and iteratively predicting missing content using context on both sides. Work spans language, images, speech, molecules, DNA, and structured data, with methods including learned reveal-order policies, confidence- or attention-guided samplers, blockwise and speculative decoding, self-correction, and reinforcement-learning or distillation post-training. Evaluations on reasoning and coding benchmarks such as GSM8K, MATH-500, and HumanEval test whether parallel generation can match autoregressive quality, while multimodal and scientific-design tasks test the framework beyond text. The central tension is that committing more tokens per model pass improves speed but can ignore dependencies and reduce accuracy or diversity; sampler choices, likelihood evaluation, and real serving costs also complicate comparisons.

Latest papers

CardsList

204 papers21 papers in the last four weeks, down 43% on the four weeks before. 0.2% of all new papers.

  1. ReMaRL: Learning to Unmask and Remask in Frozen Diffusion Language Models

    Nov 17, 2026Egor Shibaev, Danila Biktimirov, Ivan Klimov +3Diffusion Language Model InferenceDiffusion Language Model Decoding

  2. The Price of Not Planning: Parallel Sampling Depth Peaks at the Reconstruction Threshold

    Nov 16, 2026Chuling Wen, Weijie Liang, Jian LuParallel Decoding for Diffusion Language ModelsMasked Diffusion Models

  3. Empowering Masked Diffusion Models to Self-Correct with Leave-One-Out Transformers

    Nov 14, 2026Sofian Zalouk, Vincent Counathe, Paul Jünger +4Masked Diffusion ModelsDiffusion Language Models

  4. See Every Block Once: Variance-Reduced Post-Training for Masked Diffusion Language Models

    Nov 13, 2026Yunzhen He, Hiroaki Yamagiwa, Hidetoshi ShimodairaDiffusion Language Model TrainingMasked Diffusion Models

  5. Token Commitment as a Control Surface for Steering Masked Diffusion Generation

    Nov 11, 2026Ambroise Aigueperse, Hugo Buurmeijer, Carmen Amo ALonso +1Diffusion ModelsMasked Diffusion Models

  6. Schedule-Calibrated Commitment Order in Blockwise Masked Diffusion Language Models

    Nov 11, 2026Gaurav Sarkar, Umang Pandey, Pratik Prabhanjan Brahma +2Diffusion Language ModelsMasked Diffusion Models

  7. When Should Diffusion Language Models Reconsider Their Commitments?

    Nov 8, 2026Haoyang Zheng, Yidong Ouyang, Blake Jianhang Chen +5Diffusion Language Model DecodingParallel Decoding for Diffusion Language Models

  8. Discrete Diffusion Playground: A 2D Benchmark for Discrete Generative Models

    Nov 8, 2026Justin Shao, Sihyun Park, David Ryan Koes +1discrete generative modelingGenerative Modeling

  9. FEROM: Frontier Endogenous Reveal-Order Marginal Policy Optimization for Masked Diffusion LMs

    Nov 7, 2026Zian Su, Ziyang Huang, Kaiyuan Zhang +1Masked Diffusion ModelsDiffusion Language Model Training

  10. Masked diffusion as random sequential adsorption: an exactly solvable model for parallel decoding

    Nov 5, 2026Adrian BauleMasked Diffusion ModelsDiffusion Language Models

  11. CMDiff: Left Atrial Scar Segmentation from 3D LGE MRI Using Conditional Mask Diffusion Model: A Feasibility Study

    Nov 5, 2026Jing Zhang, Bastien Bergere, Jonas Leite +4Medical Image Segmentation3D Medical Image Segmentation

  12. Online Class Posteriors for Interpretable and Controllable Discrete Diffusion

    Nov 2, 2026Felix Koulischer, Gianni Van De Velde, François Remy +2Discrete Diffusion SamplingDiffusion Model Guidance

  13. Cord: Confidence-Anchored Order Residual Decoding for Masked Diffusion Language Models

    Oct 29, 2026Chengwei Zhou, Zhaoyan Jia, Massoud Pedram +1Diffusion Language Model DecodingMasked Diffusion Models

  14. HiLo-RD: Cross-Budget Self-Distillation for Masked Diffusion Language Models

    Oct 27, 2026Xiang Li, Chengting Yu, Jungang Li +5Diffusion Language Model DecodingDiffusion Language Models

  15. What Makes a Good Unmasking Policy? A Controlled Study of Learned Unmasking in Diffusion Language Models

    Oct 22, 2026Jinya Sakurai, Xun Xu, Jaehong YoonDiffusion Language Model DecodingDiffusion Language Models

  16. Random Remasking Scales Masked Diffusion Inference

    Oct 22, 2026Zhaoyi Zhou, Frank Wu, Andrea ZanetteMasked Diffusion ModelsDiffusion Language Model Inference

  17. Hierarchical Masked Diffusion Language Models

    Oct 21, 2026Parul Gupta, Satwik, Avni Aggarwal +5Masked Diffusion ModelsDiffusion Language Model Decoding

  18. Binary Discrete Diffusion: Candidate-Set Diffusion for Logic and Planning Tasks

    Oct 20, 2026Rodrigo Casado Noguerales, Dimitri von Rütte, Bernhard Schölkopf +2Diffusion ModelsDiffusion-Based Planning

  19. Enhanced Masked Diffusion Unlearning

    Oct 18, 2026Tomer Garber, Tom TirerMachine UnlearningDiffusion Model Unlearning

  20. LED: Improving Masked Diffusion Language Models by Lookahead Editing

    Oct 16, 2026Yuyan Zhou, Zeyuan Yang, Yuxuan Song +5Diffusion Language Model DecodingMasked Diffusion Models

  21. Query-Efficient Rejection Sampling for Parallel Masked Diffusion

    Oct 15, 2026Shiyuan Zhang, Xuheng Li, Qiwei Di +1Parallel Decoding for Diffusion Language ModelsDiffusion Sampling

  22. TIPS: A Tiny Inference-time Policy for Scaling in Diffusion Language Models

    Oct 15, 2026Ya-Shi Zhang, Jian Tang, Pierre-André Noël +1Diffusion Language Model DecodingInference-Time Adaptation of Language Models

  23. Diffusion Language Models as Open Quantum Systems

    Oct 15, 2026Akinori Tanaka, Yukinao Akamatsu, Takuki Tomita +1Diffusion Language ModelsQuantum Generative Modeling

  24. Revise-TTS: A Non-Masking Refinement Framework for Masked Diffusion Models in Text-to-Speech

    Oct 14, 2026Wanli Sun, Dan Su, Anton RagniTTS SynthesisZero-Shot TTS

  25. Multi-Stream Residual Computation in Diffusion Language Models

    Oct 13, 2026Ekaterina Alimaskina, Suren Kazarian, Gleb Molodtsov +1Diffusion Language ModelsMasked Diffusion Models