Autoregressive Model

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

25 new papers

A weekly snapshot of new work published in Autoregressive Model.

Period ending 2026-09-14

11 new papers

A weekly snapshot of new work published in Autoregressive Model.

Inside this field

Focused directions

Focused topic

Diffusion Language Models

Within Autoregressive Model

266 papersExplore

Focused topic

Autoregressive Model

Within Autoregressive Model

222 papersExplore

Focused topic

Autoregressive Language Models

Within Autoregressive Model

82 papersExplore

Focused topic

Next-Token Prediction

Within Autoregressive Model

80 papersExplore

Focused topic

Masked Diffusion Language Models

Within Autoregressive Model

70 papersExplore

Focused topic

Autoregressive Generation

Within Autoregressive Model

68 papersExplore

679 papers

Latest in Autoregressive Model

Browse all topics →

Flash-dLLM: IO-Aware KV Caching and Parallel Decoding for Fast, Memory-Efficient Diffusion LLMs
Sep 22, 2026Quan Nguyen-Tri, Mukul Ranjan, Zhiqiang ShenLLM Inference Efficiency Diffusion Language Models
Learning Prognostic Variables for AI Convective Parameterizations via Symbolic Distillation
Sep 21, 2026Jurij Schönfeld, Tom Beucler, Julien Savre +2Global Climate Models Autoregressive Model
Circuit Hypernetworks for Quantum-Augmented Diffusion Language Models
Sep 21, 2026Xiaoqiang Wang, Mengyang Xiong, Jun Dai +1Large Language Model Quantization Diffusion Language Models
One Patch, Three Roles: What Is Actually Coupled in Autoregressive Time-Series Forecasting?
Sep 20, 2026Ziang Li, Yue Huang, Guoxu Zhou +4Autoregressive Model
dQwen3.5: Hybrid-Attention Diffusion Language Models
Sep 17, 2026Anton Xue, Litu Rout, Aditya Akella +3Diffusion Language Models Autoregressive Model
Parallelism, critical windows, and separations among diffusion language models
Sep 17, 2026Sitan Chen, Liye WangDiffusion Language Models Parallel
Zarya: A Hybrid Autoregressive--Masked Diffusion Language Model with Flexible Training and Dual-Mode Inference
Sep 17, 2026Leonid Sinev, Ilya Koziev, Vladislav LeshchukAutoregressive Language Models Diffusion Language Models
Next-token functional estimation
Sep 17, 2026Milind Nakul, Vidya Muthukumar, Ashwin PananjadyEstimators Markov
How to Guide Your Language Flow
Sep 16, 2026Rohit Dilip, Tianrong Chen, Yuyang Wang +3Diffusion Language Models
Block Parallelism For Efficient Distributed Long-Context Diffusion Language Model Training
Sep 16, 2026Tarun Suresh, Pranshu Chaturvedi, Hangoo Kang +4Diffusion Language Models Parallel
Variational Quantum Transformer Architecture for Synthetic Language Generation
Sep 16, 2026Julian Hager, Michael Kölle, Gerhard Stenzel +3Transformer Architectures Autoregressive Language Models
M2Tok: Multi-head Multi-codebook Discrete Action Tokenization for Vision-Language-Action Models
Sep 16, 2026Chunpu Xu, Zhixuan Liang, Yuhao Zhang +6Vision-Language-Action Models Visual Tokens
CPR: Combining global composing, local performing and full-sequence refining in piano rendering with continuous autoregressive modelling
Sep 16, 2026Chong Jing, Junan Zhang, Zhizheng WuPiano Acoustic Representation
Causal-History Test-Time Scaling for Failure Recovery in Autoregressive World-Action Models
Sep 16, 2026Lin Li, Long Chen, Kwunhang +10Efficient World-Action Model Autoregressive Model
Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control
Sep 15, 2026Mingyang Chen, Shengdong Chen, Xiaoxiao Fu +13Agentic Control Few-Step Generation
PhysStream: Streaming Physics-Grounded Video Generation with Structured Scene Memory and Fine-Grained Motion Control
Sep 15, 2026Chuhao Chen, Peter Wonka, Chaoyang Wang +4Controllable Video Generation Long Video Generation
When Confidence Signals Disagree: Local and Global Confidence in Autoregressive Language Models
Sep 15, 2026Julio C. Amador Diaz LopezConfidence Calibration Autoregressive Language Models
Divergence Timing and Cumulative Disagreement under KV-Cache Eviction
Sep 15, 2026Xinyue Luo, Fei YuDivergence Disagreement
Early-Bird Decoding: Accelerating Diffusion LLMs with Learnable Block Sizes and Parallel Sampling
Sep 15, 2026Lixuan Wei, Wei Zhou, Jianwen Wu +3Diffusion Language Models LLM Inference Efficiency
Register Tokens for Bounded-State Reasoning in Diffusion Language Models
Sep 14, 2026Albert Ge, Chandan Singh, Yufan Zhuang +3Diffusion Language Models Masked Diffusion Language Models
Discrete Beckmann Transport Models for One-Step Language Modeling and Reasoning
Sep 14, 2026Sophia Tang, Shiyi WangDiffusion Language Models Autoregressive Language Models
Principal-timestep Restricted Init via Sparse Matrix-decomposition in Flow-matching
Sep 14, 2026Jiayang Gu, Zheng Fang, Lichaun Xiang +3Timestep Autoregressive Language Models
Reducing the Output-Mode Gap in Speech Language Models via Joint-Output On-Policy Distillation
Sep 14, 2026Daxin Tan, Dehua Tao, Chengxi Deng +2Autoregressive Generation On-Policy Distillation
Temporal Self-Distillation: Faster Inference in Discrete Diffusion Language Models
Sep 14, 2026Shijian Xu, Andrea Miele, Metod Jazbec +3Diffusion Language Models Real-Time Inference
DA-DLM: Explicitly Modeling Token Dependencies in Diffusion Language Models
Sep 14, 2026Pengyu Ji, Zichen Zhang, Xiang Hu +1Diffusion Language Models Autoregressive Transformers
Representation-based Masked Diffusion Model
Sep 14, 2026Yangrong Hu, Ding Huang, Xueyu Zhou +1Masked Diffusion Language Models Diffusion Language Models
Large Distant Gradients Need Not Be Reliable: reliability-weighted credit assignment for long-horizon autoregressive forecasting
Sep 14, 2026Junhao Zhao, David Michael Simberg, Jacob Kang +2Long-Horizon Forecasting Autoregressive Model
CanvasAnneal: Curriculum Reinforcement Learning for Diffusion Language Models
Sep 14, 2026Blake Olson, Yuhang Song, Emmett McQuinn +1Diffusion Language Models Curriculum Reinforcement Learning
Fixed State, Long Reach: What a Constant-Size Cache Buys Block Diffusion at Scale
Sep 14, 2026Vaibhav Singh, Pierre-André Noël, Torsten Scholak +2Diffusion Language Models Cache
Routing by Reasoning Need: Trajectory-Aware Decoding Control for Diffusion Vision-Language Models
Sep 12, 2026Yixiang Liu, Zhongxing Xu, Zhonghua Wang +1Diffusion Language Models Inference-Time Control
CARTS: Contextual Autoregressive Rank Transcoding Steganography for Full-Capacity Keyed Text Encoding
Sep 12, 2026Wissam Ghantous, Alexander V. MantzarisSteganography Encoders
Uncertainty DMD: Restoring Diversity in Few-Step Autoregressive Video Distillation
Sep 11, 2026Zixuan Duan, Xunzhi Xiang, Yabo Chen +6Autoregressive Video Diffusion Autoregressive Video Generation
Particle GFlowNets: Rethinking Generative Marginalization Models
Sep 11, 2026Tiago da Silva, Diego Mesquita, Salem LahlouGenerative Flow Networks Gibbs Measures
Why Does Post-Training Quantization Work?
Sep 10, 2026Yuxiang Chen, Michael Beyer, Jun Zhu +1Weight-Only Quantization Quantization
Osprey: Target-agnostic Pre-training Makes Stronger Drafters in Speculative Decoding
Sep 8, 2026Fengxiang Bie, Yuqing Jian, Yifan Yu +7Speculative Decoding Drafter
Decomposition-Guided Diffusion Language Models for Inertial Confinement Fusion Prediction
Sep 7, 2026Xiang Zhang, Varchas Gopalaswamy, Rahman Ejaz +2Inertial Confinement Fusion Latent Bridge Matching
Separating Stream Stability from Long-Term Recall in Language Models
Sep 7, 2026Peipei Cao, Xin Zhang, Jie Tang +3Autoregressive Language Models Efficient Long-Context Inference
In-Place Instruction Following in Diffusion Language Models
Sep 7, 2026Zheng Nie, Zherui Li, Jiaming Zhang +3Diffusion Language Models Instruction-Tuned Models
Line-Coupled Language Model
Sep 7, 2026Shiyuan Li, Shaorong Zhang, Zhaorui Yang +3Autoregressive Language Models Graph Language Models
Diffusion Language Models for Mobile Edge Agentic AI: Foundations, Applications, and Challenges
Sep 7, 2026Chenqi Li, Minghui Min, Dusit Niyato +1Diffusion Language Models Trade-Off
Unlocking Lossless Speedups in LLMs via Discrete Diffusion
Sep 3, 2026Subham Sekhar Sahoo, Lingjie Chen, Khiem Pham +14Diffusion Language Models Speculative Decoding
RATL: Learning from Retrieved Residuals for Robust Multivariate Time-Series Forecasting
Sep 3, 2026Yuchen He, Yueyang Cang, Zhiyuan Ning +2Time Series Autoregressive Model
Sparse auto-regressive modeling for scene generation from multi-view images
Sep 3, 2026Thomas Lucas, Maxime Pietrantoni, Philippe Weinzaepfel +43D Generative Models Multi-View
EPIC: Explicit Posterior Item Conditioning for Semantic ID Diffusion Recommendation
Sep 3, 2026Tuan-Binh Tran, Thanh Tam Nguyen, Quoc Viet Hung Nguyen +3Large-Scale Recommendation Systems Recommendation
ALRA: Adaptive Local Relational Alignment for Logit-Based Pre-training Distillation of Autoregressive Language Models
Sep 3, 2026Quang Hoang Trung, Quang Huu Hieu, Nguyen Van Hoang Phuc +1Knowledge Distillation Autoregressive Language Models
Reliability Challenges in Diffusion Vision-Language Models
Sep 1, 2026Md. Atabuzzaman, Chris ThomasDiffusion Language Models Large Language Model Hallucination
Replicating TRACE: A Practitioner's Guide to Its Threshold and Particle Budget
Sep 1, 2026Alex Chadyuk, Alicia Zhang, Roy KucukatesCausal Graph Decision Thresholds
Membership Inference in Fine-tuned Diffusion Language Models via Token-level Memorization Asymmetry
Sep 1, 2026Shengfang Zhai, Leo Marchyok, Yuling Shi +4Membership Inference Diffusion Language Models
Probabilistic Model Checking of Autoregressive Neural Sequence Models
Sep 1, 2026Helge Spieker, Dennis Gross, Arnaud GotliebProbabilistic Model Checking Autoregressive Model
Solaris: Towards Interfaces That Are Generated, Not Coded
Sep 1, 2026Yuval Alaluf, Omri Avrahami, Guy Bukchin Leshem +18User Interface Toward Interaction Dynamics
Learning Task-Specific Antibody Representations via Function-Aware Masking
Sep 1, 2026Ayan Goel, Thomas A. Walton, Amirali AghazadehMasked Diffusion Language Models Inductive Bias
Beyond Token Positions: Safety Alignment Across Denoising Steps in Diffusion Language Models
Aug 31, 2026Guoli Wang, Haonan Shi, Tu Ouyang +1Diffusion Language Models Large Language Model Safety
A convolutional framework for detecting event-driven dynamics in energy price series
Aug 31, 2026Caixia Xu, Piotr FryzlewiczStochastic Volatility Convolutional
Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domains
Aug 31, 2026Zi Wang, Minghui Xu, Tapan MukerjiGeometry-Aware Foundation Model Partial Differential Equations
CARVE: Verified Expansion for Variable-Length Generation in Diffusion Language Models
Aug 31, 2026Wail Bouhedja, Amr Mohamed, Guokan ShangDiffusion Language Models Data Generation
REER-PT: Reverse-Engineered Reasoning for Perplexity-Guided Pre-training Data Augmentation
Aug 31, 2026Haoran Que, Jiajun Shi, Ting Huang +7Search-Augmented Reasoning Next-Token Prediction
KItCAT: Knowledge Injection via Input Corruption for Auto-regressive Training
Aug 31, 2026Meghanadh Pulivarthi, Kushagra Bhushan, Vineet Kumar +5Next-Token Prediction Corrupted Observations
DiffPDE: Masked Diffusion Language Models as PDE Solver
Aug 31, 2026Wenxuan Guo, Yuyang Hong, Lubin Fan +4Partial Differential Equation Benchmarks Partial Differential Equations
Ceiling-Clipped Acceptance Histograms Indicate Stranded Speed-up in Block-Diffusion Speculative Decoding
Aug 31, 2026Ephrem WuDrafter Speculative Decoding
Multivariate Scientific Data Compression with Learned Cross-Variable Latent Decorrelation and Autoregressive Entropy Modeling
Aug 31, 2026Liangji Zhu, Anand Rangarajan, Sanjay RankaContext Compression Autocorrelations

Sep 22, 2026 · cs.CLJ/K move · Enter open · S save

Flash-dLLM: IO-Aware KV Caching and Parallel Decoding for Fast, Memory-Efficient Diffusion LLMs

Quan Nguyen-Tri, Mukul Ranjan, Zhiqiang Shen

Diffusion Large Language Models (dLLMs) have recently emerged as a promising alternative to autoregressive LLMs by enabling non-autoregressive text generation. However, their practical deployment remains limited by inefficient inference, largely due to the absence of effective Key-Value (KV) caching and scalable parallel decoding mechanisms. Existing acceleration methods typically study KV caching and parallel decoding in isolation, overlooking the I/O bottlenecks that arise when cache reuse and parallel token verification are jointly applied. In this work, we introduce

\textbf{Flash-dLLM}

, a training-free inference acceleration framework for fast and memory-efficient dLLMs. Flash-dLLM first identifies GPU memory I/O as a dominant bottleneck in KV-cache-enabled dLLM inference and addresses it with an I/O-aware fused KV-cache kernel that reduces redundant memory movement. Building on this optimized cache mechanism, Flash-dLLM further proposes an efficient KV-cache-driven draft-and-verify decoding strategy, where the dLLM itself serves as both drafter and verifier without requiring an auxiliary model. This unified design enables faster decoding while preserving generation quality and improving scalability to longer sequences and larger batch size. Extensive experiments on mathematical reasoning and code-generation benchmarks demonstrate that Flash-dLLM consistently outperforms existing state-of-the-art dLLM acceleration methods in both inference speed and memory efficiency. In particular, it achieves

5.1\times

and

11.0\times

speedups over prior strongest baseline Elastic-Cache on GSM8K and HumanEval, respectively.

LLM Inference Efficiency Diffusion Language Models

Open paper Ask about it PDF