Overview

Diffusion language models generate text by starting from corrupted or masked sequences and repeatedly refining them, using context from both earlier and later positions. Main approaches include discrete masked diffusion, continuous latent or flow-based models, and block or hybrid designs that combine parallel refinement with autoregressive structure. Work explores adaptive token ordering, remasking, distillation, and caching to improve reasoning, code generation, multimodal tasks, and inference speed. A central tension is balancing faster, more parallel decoding against token dependencies and output quality, while reliable evaluation and the cost of training from scratch remain open challenges.

Latest papers

CardsList

494 papers69 papers in the last four weeks, down 10% on the four weeks before. 0.5% of all new papers.

  1. Learning When Diffusion Language Models Should Regenerate

    Nov 12, 2026Minhae Oh, Jeonghye Kim, Jinwoo Koo +4Diffusion Language ModelsDiffusion Language Model Decoding

  2. Schedule-Calibrated Commitment Order in Blockwise Masked Diffusion Language Models

    Nov 11, 2026Gaurav Sarkar, Umang Pandey, Pratik Prabhanjan Brahma +2Diffusion Language ModelsMasked Diffusion Models

  3. Mask-Pattern Position Augmentation: Training-Free Long-Context Extrapolation for Diffusion LLMs

    Nov 11, 2026Gaurav Sarkar, Syed Affan DaimiLong-Context Language ModelingDiffusion Language Models

  4. Test-Time Scaling for Diffusion Language Models with Frequency-Aware Remasking

    Nov 7, 2026Bowen Zuo, Yue Yu, Dongruo Zhou +1Diffusion Language ModelsDiffusion Language Model Decoding

  5. Masked diffusion as random sequential adsorption: an exactly solvable model for parallel decoding

    Nov 5, 2026Adrian BauleMasked Diffusion ModelsDiffusion Language Models

  6. Training-Free Character-Length Control in Summarization with Diffusion Language Models

    Nov 4, 2026Steffen Castle, Nils Feldhus, Christopher Ebert +2Text SummarizationDiffusion Language Model Decoding

  7. VIGOR: Visual Gain Ordering for Hallucination Mitigation in Multimodal Discrete Diffusion Language Models

    Nov 3, 2026Junzhe Chen, Tian Qin, Eugenie Shi +3VLM Hallucination MitigationDiffusion Language Models

  8. Bidirectional Centered Score Matching for Discrete Diffusion Distillation

    Nov 3, 2026Peng Tu, Baoyou Chen, Haoyuan Xia +3Diffusion DistillationDiffusion Language Model Distillation

  9. Step-dLLM: Adaptive Step-aware Sparse Attention for Efficient Diffusion LLM Inference

    Oct 31, 2026Zhichen Zeng, Xichong Zhang, Junpan Wu +7Diffusion Language Model InferenceDiffusion Language Models

  10. BYOD: Build Your Own DLM - Efficient Autoregressive-to-Diffusion Language Model Conversion

    Oct 30, 2026Ruurd J. A. Kuiper, Robert A. BagheriDiffusion Language ModelsDiffusion Language Model Training

  11. Sparse Text Diffusion under Dual Budgets: Context Connectivity and Expert Activation

    Oct 30, 2026Alexandros Christoforos, Chadbourne Davis, Paul RajDiffusion Language ModelsLong-Context Modeling

  12. Homebrewed SLMs: Autoregressive and Masked Diffusion Language Models Built at Home for Portuguese

    Oct 29, 2026Pedro Carvalho BromLanguage ModelingSmall Language Models

  13. DWISE: Denoising Workload-Informed Scheduling Engine

    Oct 29, 2026Lie Li, Wen Li, Junxiao Shen +2Diffusion Model ServingDiffusion Language Model Inference

  14. TDLM: Adaptive Temporal Integration for Diffusion Language Models

    Oct 27, 2026Bohang Sun, Max Zhu, Francesco Caso +3Diffusion Language ModelsDiffusion Language Model Inference

  15. HiLo-RD: Cross-Budget Self-Distillation for Masked Diffusion Language Models

    Oct 27, 2026Xiang Li, Chengting Yu, Jungang Li +5Diffusion Language Model DecodingDiffusion Language Models

  16. Birth, Death and Diff: Insertion-Based Sequence Generation with Corrections

    Oct 25, 2026Durga Prasad Maram, Dhruvesh Patel, Tahira Naseem +4Diffusion Language ModelsText Generation

  17. How To Build A Modern Diffusion Language Model

    Oct 24, 2026Volodymyr Kuleshov, Marianne Arriola, Yair Schiff +2Diffusion Language ModelsDiffusion Language Model Inference

  18. LLaCO: Continuous Diffusion for Large Language Models with Competition-Aware Semantic Scheduling

    Oct 23, 2026Zijian Jia, Peixuan Zhang, Genying Li +5Diffusion Language ModelsContinuous Diffusion Language Models

  19. Watermarking Diffusion Language Models with Learned Foresight and Balanced Bands

    Oct 23, 2026Hyojun Kim, Hyeseon An, Yo-Sub HanLLM WatermarkingDiffusion Language Models

  20. DELA: Learning Controllable Edits for Diffusion Language Models

    Oct 23, 2026Xinsong Feng, Chenan Wang, Leshu Tang +4Diffusion Language ModelsDiffusion Language Model Decoding

  21. What Makes a Good Unmasking Policy? A Controlled Study of Learned Unmasking in Diffusion Language Models

    Oct 22, 2026Jinya Sakurai, Xun Xu, Jaehong YoonDiffusion Language Model DecodingDiffusion Language Models

  22. Harmful Responses Are Jailbreak Templates: Transferring Autoregressive Jailbreaks to Diffusion Language Models

    Oct 22, 2026Jinwei Gan, Zifeng Cheng, Zhiwei Jiang +3LLM Jailbreak AttacksAdversarial Attacks on Diffusion Models