Masked Diffusion Language Models

Follow this topic Ask about this topic

Recent momentum

-50%

4 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Masked Diffusion Language Models.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Masked Diffusion Language Models.

70 papers

Latest in Masked Diffusion Language Models

Browse all topics →

Register Tokens for Bounded-State Reasoning in Diffusion Language Models
Sep 14, 2026Albert Ge, Chandan Singh, Yufan Zhuang +3Diffusion Language Models Masked Diffusion Language Models
Representation-based Masked Diffusion Model
Sep 14, 2026Yangrong Hu, Ding Huang, Xueyu Zhou +1Masked Diffusion Language Models Diffusion Language Models
Learning Task-Specific Antibody Representations via Function-Aware Masking
Sep 1, 2026Ayan Goel, Thomas A. Walton, Amirali AghazadehMasked Diffusion Language Models Inductive Bias
DiffPDE: Masked Diffusion Language Models as PDE Solver
Aug 31, 2026Wenxuan Guo, Yuyang Hong, Lubin Fan +4Partial Differential Equation Benchmarks Partial Differential Equations
Commitment Before Realization: When Classifier-Free Guidance Becomes Unnecessary in Masked Diffusion Language Models
Aug 8, 2026Fan Zhou, Weitian Wang, Tim Van de CruysMasked Diffusion Language Models Diffusion Language Models
Lost in Interpolation: Why Predictive Feedback Fails in Diffusion Language Models
Aug 6, 2026Lavanya Nigam, Ishaan Bansal, Aryan Sood +2Masked Diffusion Language Models Diffusion Language Models
Answer First, Reason Later: Commitment Order in Diffusion LLMs
Aug 6, 2026Jewon Yeom, Jaewon Sok, Seonghyeon Park +3Diffusion Language Models Masked Diffusion Language Models
Masked diffusion enables coherent beat tracking
Aug 5, 2026Francesco Foscarin, Filip Korzeniowski, Richard VoglDiscrete Diffusion Model Masked Diffusion Language Models
MDLMPE: Distribution Aware Positional Encoding for Masked Diffusion Language Models
Aug 4, 2026Tong Ling, Hang Lei, Feng Xiao +5Masked Diffusion Language Models Diffusion Language Models
OSAGEN: Object-Aware Mask Priors and Multistage Decoupled Diffusion for Industrial Anomaly Generation
Jul 31, 2026Jinyi Xu, Peng Chen, Yunkang Cao +3Zero-Shot Anomaly Detection Masked Diffusion Language Models
Latent-Kernel Discrete Flow Maps for Few-Step Generation
Jul 29, 2026Mansoor Ahmed, Yue-Tsz Fan, Hemanth Venkateswara +1Few-Step Generation Generative Flow Networks
From Interface to Inference: Eliciting Any-Order Inference from Any-Order Models
Jul 29, 2026Seunggeun Kim, Jaeyeon Kim, Taekyun Lee +4Masked Diffusion Language Models Autoregressive Language Models
Neuromorphic Diffusion Language Models: Addressing Compute and Memory Bottlenecks via Sparsity and Block Denoising
Jul 24, 2026Dengyu Wu, Clement Ruah, Jiechen Chen +2Diffusion Language Models LLM Inference Efficiency
Multi-Mask Diffusion Language Models for Few-Step Generation
Jul 22, 2026Sijin Chen, Yinuo Ren, Heyang Zhao +3Masked Diffusion Language Models Diffusion Language Models
Trace-Based On-Policy Distillation for Masked Diffusion Language Models
Jul 18, 2026Haolin Ren, Ziyang Huang, Chenhao Yuan +2Diffusion Language Models Masked Diffusion Language Models
Induction in Both Directions: A Mechanistic Analysis of In-Context Learning in Masked Diffusion Language Models
Jul 17, 2026Andy Catruna, Emilian RadoiDiffusion Language Models Masked Diffusion Language Models
Adaptive Multi-Step Lookahead Decoding for Diffusion Language Models
Jul 17, 2026Yingqian Cui, Wei Deng, Lantao Mei +4Diffusion Language Models Masked Diffusion Language Models
Mask-Aware Policy Gradients for Diffusion Language Models
Jul 16, 2026Haran Raajesh, Kulin Shah, Adam Klivans +1Masked Diffusion Language Models Policy Gradient
Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes
Jul 14, 2026Minh-Quan Le, Armand Comas, Alexandros Lattas +7Multimodal Generation Large-Scale Image Generation
Accelerating Masked Diffusion Large Language Models: A Survey of Efficient Inference Techniques
Jul 14, 2026Daehoon Gwak, Minhyung Lee, Junwoo Park +1Masked Diffusion Language Models Inference-Time
Masked Diffusion Decoding as $x$ -Prediction Flow
Jun 27, 2026Weitian Wang, Lianlei Shan, Shubham Rai +2Masked Diffusion Language Models Large Language Model Decoder
VGB for Masked Diffusion Model: Efficient Test-time Scaling for Reward Satisfaction and Sample Editing
Jun 26, 2026Kijung Jeon, Thuy-Duong Vuong, Molei TaoMasked Diffusion Language Models Inference-Time
Masked Language Flow Models
Jun 26, 2026Iskander Azangulov, Kianoosh Ashouritaklimi, Leo Zhang +2Masked Diffusion Language Models Generative Flow Networks
Posterior Refinement: Fast Language Generation via Any-Order Flow Maps
Jun 23, 2026Manan Agarwal, Sheel Shah, Chanhyuk Lee +6Diffusion Language Models Masked Diffusion Language Models
When Top-1 Fails: Calibrating LoRA Monitors for Masked Diffusion LMs
Jun 23, 2026Lucky Verma, Pratik YadavDiffusion Language Models Masked Diffusion Language Models
Scheduling Thoughts: Learning the Order of Thought in Diffusion Language Models
Jun 22, 2026Jiawei Xu, Minghui Liu, Aakriti Agrawal +2Diffusion Language Models Masked Diffusion Language Models
Understanding Parallel Samplers in Masked Diffusion via Random Walks on Graphs
Jun 22, 2026Vansh Bansal, Cho Cholyeon, Syamantak Kumar +2Masked Diffusion Language Models Diffusion Sampling
Recursive Scaling in Masked Diffusion Models
Jun 16, 2026Alba Carballo-Castro, Julianna Piskorz, Paulius Rauba +2Masked Diffusion Language Models Discrete Diffusion Model
VoidPadding: Let [VOID] Handle Padding in Masked Diffusion Language Models so that [EOS] Can Focus on Semantic Termination
Jun 16, 2026Chunyu Liu, Zhengyang Fan, Kaisen Yang +1Masked Diffusion Language Models Instruction Tuning
Multi-Turn Reflective Masking Elicits Reasoning in Mask Diffusion Models
Jun 15, 2026Yanming Zhang, Yihan Bian, Jingyuan Qi +3Masked Diffusion Language Models Sequential
Who Should Lead Decoding Now? Tracking Reliable Trajectories for Ensembling Masked Diffusion Language Models
Jun 15, 2026Heecheol Yun, Joonhyung Park, Joowon Kim +1Masked Diffusion Language Models Trajectory Prediction
TimeROME-DLM: Temporal Causal Tracing and Low-Rank Inference-Time Knowledge Editing for Masked Diffusion Language Models
Jun 11, 2026Zhengtao Yao, Liuyang Song, Hongbo Zhang +4Masked Diffusion Language Models Multimodal Knowledge Editing
Detect, Remask, Repair: Diffusion Editing for Faithful Summarization of Evolving Contexts
Jun 11, 2026Hao Zou, Zachary Horvitz, Chandhru Karthick +2Summarization Preservation
Re-evaluating Confidence Remasking in Masked Diffusion Language Models
Jun 10, 2026Stipe Frkovic, Metod Jazbec, Dan Zhang +3Masked Diffusion Language Models Diffusion Language Models
Attention-Discounted Adaptive Sampler for Masked Diffusion Language Models
Jun 9, 2026Yusuf Sahin, Ahmed Rockey Saikia, Volkan Cevher +1Masked Diffusion Language Models Diffusion Language Models
NAVIRA: Decoupled Stochastic Remasking for Masked Diffusion Language Models
Jun 4, 2026Andrey Fomenko, Maksim Kryzhanovskiy, Svetlana Glazyrina +1Masked Diffusion Language Models Diffusion Language Models
Knowledge Editing for Masked Diffusion Language Models
Jun 2, 2026Haewon Park, Yohan JoMultimodal Knowledge Editing Masked Diffusion Language Models
Deep Learning for Remote Sensing to Improve Flood Inundation Mapping
Jun 1, 2026Yogesh Bhattarai, Vijay Chaudhary, Wai Lim Kim +1Flood Detection Sen1Floods11
Revise, Don't Freeze: Sampler-Matched Training for Self-Correcting Masked Diffusion Language Models
May 31, 2026Longxuan Yu, Shaorong Zhang, Yu Fu +3Masked Diffusion Language Models Diffusion Language Models
DSL-LLaDA: Scaling Continuous Denoising to 8B Masked Diffusion LMs
May 31, 2026Longxuan Yu, Yunshu Wu, Yu Fu +5Masked Diffusion Language Models Summarization
Adaptive Order Policies for Masked Diffusion
May 29, 2026Jama Hussein Mohamud, Mohsin Hasan, Mirco Ravanelli +1Masked Diffusion Language Models Order Matters
What Gets Unmasked First? Trajectory Analysis of Diffusion Models for Graph-to-Text Generation
May 29, 2026Qing Wang, Jacob Devasier, Chengkai LiMasked Diffusion Language Models Diffusion Language Models
Fixed-Point Masked Generative Modeling
May 29, 2026Andrea Miele, Yiming Qin, Alba Carballo-Castro +2Masked Diffusion Language Models Generative Models
Masked Diffusion Modeling for Anomaly Detection
May 28, 2026Lixing Zhang, Yuchen Liang, Liyan XieReconstruction-Based Anomaly Detection Anomaly Detection
Masked Diffusion Vision-Language Models for Temporal Action Localization
May 28, 2026Fengshun Wang, Zhengbo Zhang, Zhigang TuTemporal Action Localization Masked Diffusion Language Models
Cluster-Level Attention-Guided Parallel Decoding for Masked Diffusion Language Models
May 28, 2026Heqiang Qi, Wei Huang, Mingyuan Bai +1Masked Diffusion Language Models Diffusion Language Models
The Confidence Shortcut: A Reasoning Failure Mode of Masked Diffusion Models
May 27, 2026Dueun Kim, Albert NoMasked Diffusion Language Models Training-Inference Mismatch
Entropy-aware Masking for Masked Language Modeling
May 27, 2026Gokul Srinivasagan, Kai Hartung, Munir GeorgesMasked Diffusion Language Models Knowledge Distillation
Looped Diffusion Language Models
May 25, 2026Sanghyun Lee, Chunsan Hong, Seungryong Kim +3Masked Diffusion Language Models Diffusion Language Models
DLLM-JEPA: Joint Embedding Predictive Architectures for Masked Diffusion Language Models
May 24, 2026Sangdae NamMasked Diffusion Language Models Sphere-Jepa
Learned Relay Representations for Forward-Thinking Discrete Diffusion Models
May 21, 2026Benjamin Rozonoyer, Jacopo Minniti, Dhruvesh Patel +4Masked Diffusion Language Models Diffusion Language Models
Uniform Diffusion Models Revisited: Leave-One-Out Denoiser and Absorbing State Reformulation
May 21, 2026Samson Gourevitch, Yazid Janati, Dario Shariatian +4Masked Diffusion Language Models Discrete Diffusion Model
Backdooring Masked Diffusion Language Models
May 19, 2026Daniel Yiming Cao, Chengzhong Wang, Sheng-Yen Chou +3Masked Diffusion Language Models Backdoor Attacks
Machine Unlearning for Masked Diffusion Language Models
May 18, 2026Georu Lee, Seungwon Jeong, Hoki Kim +2Masked Diffusion Language Models Diffusion Language Models
AnchorDiff: Topology-Aware Masked Diffusion with Confidence-based Rewriting for Radiology Report Generation
May 16, 2026Shiying Yu, Jielei Wang, Guoming LuRadiology Report Generation Masked Diffusion Language Models
Structure-Aware Masking for Protein Representation Learning
May 15, 2026Thomas Walton, Ayan Goel, Amirali AghazadehProtein Data Bank Sequence Modeling
Membership Inference Attacks on Discrete Diffusion Language Models
May 15, 2026Shailesh KasivelrajanMasked Diffusion Language Models Membership Inference Attacks
Understanding and Accelerating the Training of Masked Diffusion Language Models
May 13, 2026Chunsan Hong, Sanghyun Lee, Chieh-Hsin Lai +5Masked Diffusion Language Models Bridging Geographic Bias
Infinite Mask Diffusion for Few-Step Distillation
May 11, 2026Jaehoon Yoo, Wonjung Kim, Chanhyuk Lee +1Masked Diffusion Language Models Diffusion Language Models
Edit-Based Refinement for Parallel Masked Diffusion Language Models
May 10, 2026Houxing Ren, Mingjie Zhan, Zimu Lu +5Masked Diffusion Language Models Diffusion Language Models

Sep 14, 2026 · cs.CLJ/K move · Enter open · S save

Register Tokens for Bounded-State Reasoning in Diffusion Language Models

Albert Ge, Chandan Singh, Yufan Zhuang, Xiaodong Liu+2

Masked diffusion language models (dLLMs) generate text by iteratively denoising masked tokens with bidirectional attention. Extending reasoning across generation chunks normally requires keeping earlier generated text in context. We ask whether a dLLM can instead continue reasoning after that text is cleared, using only a fixed-size carried state. We implement this state as a small number of register tokens: dedicated fixed-position tokens whose continuous hidden states are trained to carry reasoning progress across generation chunks. We post-train dLLMs to decode a chunk of text, clear it while preserving the register values, and continue decoding from the prompt and carried state. In our main comparisons on LLaDA and Dream, registers outperform discrete-text carry on every benchmark, with gains of up to 8.5 points on math and 19.5 points on code. Registers are especially effective for bounded code generation, where correct programs usually span several chunks. Finally, registers can be further refined with reinforcement learning on long-horizon reasoning tasks.

Diffusion Language Models Masked Diffusion Language Models Discrete Tokens Hidden States

Open paper Ask about it PDF

Recent momentum

Neighbouring directions

Recent digests

2 new papers

2 new papers

Latest in Masked Diffusion Language Models