Overview

Diffusion language models generate text by starting from corrupted or masked sequences and repeatedly refining them, using context from both earlier and later positions. Main approaches include discrete masked diffusion, continuous latent or flow-based models, and block or hybrid designs that combine parallel refinement with autoregressive structure. Work explores adaptive token ordering, remasking, distillation, and caching to improve reasoning, code generation, multimodal tasks, and inference speed. A central tension is balancing faster, more parallel decoding against token dependencies and output quality, while reliable evaluation and the cost of training from scratch remain open challenges.

Latest papers

CardsList

494 papers69 papers in the last four weeks, down 10% on the four weeks before. 0.5% of all new papers.

  1. Corrective Diffusion Language Models

    Dec 17, 2025Shuibai Zhang, Fred Zhangzhi Peng, Yiheng Zhang +2Diffusion Language Model TrainingDiffusion Language Models

  2. A Comprehensive Study on Visual Token Redundancy for Discrete Diffusion-based Multimodal Large Language Models

    Nov 19, 2025Duo Li, Zuhao Yang, Xiaoqin Zhang +2Multimodal Large Language ModelsDiffusion Language Model Inference

  3. Demasking Fine-Tuning for Knowledge Injection in Autoregressive and Diffusion LLMs

    Oct 10, 2025Xu Pan, Ely Hahami, Jingxuan Fan +2Fine-Tuning Language ModelsKnowledge Augmentation for Language Models

  4. Guided Star-Shaped Masked Diffusion

    Oct 9, 2025Viacheslav Meshchaninov, Egor Shibaev, Artem Makoian +5Diffusion SamplingDiffusion Language Models

  5. ParallelBench: Understanding the Trade-offs of Parallel Decoding in Diffusion LLMs

    Oct 6, 2025Wonjun Kang, Kevin Galim, Seunghyuk Oh +8Diffusion Language Model InferenceParallel Decoding

  6. Demystifying MaskGIT Sampler and Beyond: Adaptive Order Selection in Masked Diffusion

    Oct 6, 2025Satoshi Hayakawa, Yuhta Takida, Masaaki Imaizumi +2Diffusion Model SamplingDiffusion Sampling

  7. Watermarking Diffusion Language Models

    Sep 29, 2025Thibaud Gloaguen, Robin Staab, Nikola Jovanović +1Diffusion Model WatermarkingLLM Watermarking

  8. Cross-Modality Controlled Molecule Generation with Diffusion Language Model

    Aug 20, 2025Yunzhe Zhang, Yifei Wang, Khanh Vinh Nguyen +1Diffusion Model GuidanceMultimodal Generation

  9. Any-Order GPT as Masked Diffusion Model: Decoupling Formulation and Architecture

    Jun 24, 2025Shuchen Xue, Tianyu Xie, Tianyang Hu +5Masked Diffusion ModelsDecoder-Only Language Models

  10. DLM-One: Diffusion Language Models for One-Step Sequence Generation

    May 30, 2025Tianqi Chen, Shujian Zhang, Mingyuan ZhouDiffusion Language ModelsDiffusion Model Distillation

  11. LaViDa: A Large Diffusion Language Model for Multimodal Understanding

    May 22, 2025Shufan Li, Konstantinos Kallidromitis, Hritik Bansal +7Multimodal UnderstandingVision-Language Models