Autoregressive Model

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

25 new papers

A weekly snapshot of new work published in Autoregressive Model.

Period ending 2026-09-14

11 new papers

A weekly snapshot of new work published in Autoregressive Model.

Inside this field

Focused directions

Focused topic

Diffusion Language Models

Within Autoregressive Model

268 papersExplore

Focused topic

Autoregressive Model

Within Autoregressive Model

222 papersExplore

Focused topic

Autoregressive Language Models

Within Autoregressive Model

82 papersExplore

Focused topic

Next-Token Prediction

Within Autoregressive Model

80 papersExplore

Focused topic

Masked Diffusion Language Models

Within Autoregressive Model

70 papersExplore

Focused topic

Autoregressive Generation

Within Autoregressive Model

68 papersExplore

681 papers

Latest in Autoregressive Model

Browse all topics →

Joint Training of Multi-Token Prediction in Reinforcement Learning via Optimal Coefficient Calibration
May 27, 2026Zili Wang, Jiajun Chai, Lin Chen +3Reinforcement Learning With Verifiable Reward Next-Token Prediction
When Confidence Misleads: Suffix Anchoring and Anchor-Proximity Confidence Modulation for Diffusion Language Models
May 27, 2026Jungwon Park, Jimyeong Kim, Jungmin Ko +2Diffusion Language Models Residual Anchoring
Dynamic-dLLM: Dynamic Cache-Budget and Adaptive Parallel Decoding for Training-Free Acceleration of Diffusion LLM
May 27, 2026Tianyi Wu, Xiaoxi Sun, Yanhua Jiao +5Diffusion Language Models LLM Inference Efficiency
Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs
May 26, 2026Wenhui Tan, Minghao Li, Xiaoqian Ma +5Next-Token Prediction LLM Inference Efficiency
Enabling KV Caching of Shared Prefix for Diffusion Language Models
May 26, 2026Younghun Go, Jaehoon Han, Changyong Shin +2Cache Diffusion Language Models
Function-Valued Causal Influence in Nonlinear Time Series
May 26, 2026Valentina V. Kuskova, Dmitry Zaytsev, Michael CoppedgeCausal Reasoning Influence
Looped Diffusion Language Models
May 25, 2026Sanghyun Lee, Chunsan Hong, Seungryong Kim +3Masked Diffusion Language Models Diffusion Language Models
On-Policy Adversarial Flow Distillation for Autoregressive Video Generation
May 25, 2026Yang Luo, Shengju Qian, Xiaohang Tang +4Autoregressive Video Generation Autoregressive Model
Channel-wise Vector Quantization
May 25, 2026Wei Song, Tianhang Wang, Yitong Chen +5Autoregressive Image Generation Visual Tokens
SplitAvatar: One-shot Head Avatar with Autoregressive Gaussian Splitting
May 25, 2026Hongzhe Liao, Chuhua Xian, Hongmin Cai +2Animatable 3D Human Avatars Avatars
Reinforcement Learning from Denoising Feedback
May 25, 2026Qi He, Huan Chen, Ya Guo +3Diffusion Language Models Reinforcement Learning From Human Feedback
BrickAnything: Geometry-Conditioned Buildable Brick Generation with Structure-Aware Tokenization
May 25, 2026Zhengyang Ni, Feng Yan, Yu Guo +1Building Blocks Geometric Reconstruction
Mimir: Large-scale Multilingual Concept Modeling
May 24, 2026Elio Musacchio, Lucia Siciliani, Pierpaolo BasileMulti-Modal Large Language Models Next-Token Prediction
Samudra 2: Scaling Ocean Emulators across Resolutions
May 24, 2026Yuan Yuan, Jesse Rusak, Alexander Merose +5Global Climate Models Emulators
DLLM-JEPA: Joint Embedding Predictive Architectures for Masked Diffusion Language Models
May 24, 2026Sangdae NamMasked Diffusion Language Models Sphere-Jepa
Polynomial Context-Truncation Sensitivity in Autoregressive Language Models: Sequential Wyner-Ziv Bounds for KV Cache Compression
May 24, 2026Munsik KimKey-Value Cache Compression Autoregressive Language Models
NITP: Next Implicit Token Prediction for LLM Pre-training
May 24, 2026Xiangdong Zhang, Debing Zhang, Shaofeng Zhang +3Next-Token Prediction Large Language Model Pretraining
The Path Matters: Learning a Token-Commitment Policy for Diffusion Language Models
May 23, 2026Bohang Sun, Max Zhu, Francesco Caso +5Diffusion Language Models Frozen Encoder
TUBE: Tangent Upper Bound on Evidence for Discrete Diffusion Language Models
May 22, 2026Arseny Ivanov, Sergei Kholkin, Vladislav Gromadskii +3Diffusion Language Models Likelihood
Extracting Training Data from Diffusion Language Models via Infilling
May 22, 2026Yihan Wang, N. AsokanDiffusion Language Models Memorization
DiLaDiff: Distilled Latent-Augmented Diffusion for Language Modeling
May 22, 2026Jean-Marie Lemercier, Tomas Geffner, Karsten Kreis +3Diffusion Language Models
When Is Next-Token Prediction Useful? Marginalization, Ergodicity, Mixture Identifiability, Local Sufficiency, RAG, Tools, and Programming
May 22, 2026Francesco CorielliNext-Token Prediction High-Fidelity Conditional Generation
Learned Relay Representations for Forward-Thinking Discrete Diffusion Models
May 21, 2026Benjamin Rozonoyer, Jacopo Minniti, Dhruvesh Patel +4Masked Diffusion Language Models Diffusion Language Models
Learnability-Informed Fine-Tuning of Diffusion Language Models
May 21, 2026Shubham Parashar, Atharv Chagi, Jacob Helwig +5Diffusion Language Models Discrete Tokens
Uniform Diffusion Models Revisited: Leave-One-Out Denoiser and Absorbing State Reformulation
May 21, 2026Samson Gourevitch, Yazid Janati, Dario Shariatian +4Masked Diffusion Language Models Discrete Diffusion Model
A Tutorial on Diffusion Theory: From Differential Equations to Diffusion Models
May 21, 2026Jiayi Fu, Yuxia WangDiffusion Processes Stochastic Differential Equations
FastTab: A Fast Table Recognizer with a Tiny Recursive Module and 1D Transformers
May 21, 2026Laziz Hamdi, Amine Tamasna, Pascal Boisson +1Transformer Encoder Structure-Aware
CrossVLA: Cross-Paradigm Post-Training and Inference Optimization for Vision-Language-Action Models
May 21, 2026Zhi LiuPretrained Vision-Language-Action Vision-Language-Action Models
Reviving Error Correction in Modern Deep Time-Series Forecasting
May 20, 2026Minh Hoang Nguyen, Dai Do, Huu Hiep Nguyen +3Multivariate Forecasting Time Series
PulseCol: Periodically Refreshed Column-Sparse Attention for Accelerating Diffusion Language Models
May 20, 2026Yanyi Lyu, Letian Chen, Futing Sun +3Dynamic Sparse Attention Diffusion Language Models
Efficient Long-Context Modeling in Diffusion Language Models via Block Approximate Sparse Attention
May 19, 2026Wenhu Zhang, Yiming Wu, Huanyu Wang +6Dynamic Sparse Attention Diffusion Language Models
Drifting Objectives for Refining Discrete Diffusion Language Models
May 19, 2026Daisuke Oba, Hiroki Furuta, Naoaki OkazakiDiffusion Language Models
Generative Recursive Reasoning
May 19, 2026Junyeob Baek, Mingyu Jo, Minsu Kim +3Recursion Latent Trajectories
Next-Acceleration-Scale Prediction for Autoregressive MRI Reconstruction
May 19, 2026Yilmaz Korkmaz, Vishal M. PatelMagnetic Resonance Imaging Reconstruction Autoregressive Model
Do Better Volatility Forecasts Lead to Better Portfolios? Evidence from Graph Neural Networks
May 19, 2026Rylan WadeStochastic Volatility Portfolio Optimization
Backdooring Masked Diffusion Language Models
May 19, 2026Daniel Yiming Cao, Chengzhong Wang, Sheng-Yen Chou +3Masked Diffusion Language Models Backdoor Attacks
Token by Token, Compromised: Backdoor Vulnerabilities in Unified Autoregressive Models
May 19, 2026Tobias Braun, Jonas Henry Grebe, Hossein Shakibania +2Adversarial Examples Backdoor Attacks
Continuous Diffusion Scales Competitively with Discrete Diffusion for Language
May 18, 2026Zhihan Yang, Wei Guo, Shuibai Zhang +5Diffusion Language Models Reparameterization
Machine Unlearning for Masked Diffusion Language Models
May 18, 2026Georu Lee, Seungwon Jeong, Hoki Kim +2Masked Diffusion Language Models Diffusion Language Models
Enhancing Train-Free Infinite-Frame Generation for Consistent Long Videos
May 18, 2026X. Feng, J. Zhu, M. Wu +6Video Editing Videos
Elastic-dLLM: Position Preserving Context Compression and Augmentation of Diffusion LLMs
May 18, 2026Junyi Wu, Tianchen Zhao, Shaoqiu Zhang +3Diffusion Language Models Context Compression
Improving Spatio-Temporal Residual Error Propagation by Mitigating Over-Squashing
May 18, 2026Seyed Mohamad Moghadas, Esther Rodrigo Bonet, Bruno Cornelis +1Autoregressive Model Recurrent Model
Prompt Compression in Diffusion Large Language Models: Evaluating LLMLingua-2 on LLaDA
May 18, 2026Sterling Huang, Abigayle Brown, Jiyoo Noh +4Large Language Model Compression Diffusion Language Models
SNLP: Layer-Parallel Inference via Structured Newton Corrections
May 18, 2026Ligong Han, Kai Xu, Hao Wang +1Transformer Layers Transformer Residual Streams
MiniGPT: Rebuilding GPT from First Principles
May 17, 2026Jibin JosephAutoregressive Language Models Generative Pretrained Transformers
AnchorDiff: Topology-Aware Masked Diffusion with Confidence-based Rewriting for Radiology Report Generation
May 16, 2026Shiying Yu, Jielei Wang, Guoming LuRadiology Report Generation Masked Diffusion Language Models
Roll Out and Roll Back: Diffusion LLMs are Their Own Efficiency Teachers
May 16, 2026Fanqin Zeng, Feng Hong, Geng Yu +6Diffusion Language Models Image Denoising
PRISMat: Policy-Driven, Permutation-Invariant Autoregressive Material Generation
May 15, 2026Claire Schlesinger, Circe Hsu, Peter Schindler +1Prism Automated Synthesis Techniques
Structure-Aware Masking for Protein Representation Learning
May 15, 2026Thomas Walton, Ayan Goel, Amirali AghazadehProtein Data Bank Sequence Modeling
Second-Order Multi-Level Variance Correction for Modality Competition in Multimodal Models
May 15, 2026Yishun Lu, Wes ArmourMultimodal Alignment Modality Gap
GenShield: Unified Detection and Artifact Correction for AI-Generated Images
May 15, 2026Zhipei Xu, Xuanyu Zhang, Youmin Xu +5Ai-Generated Image Detection Digital Forensics
Segmentation, Detection and Explanation: A Unified Framework for CT Appearance Reasoning
May 15, 2026Yuyuan Liu, Can Peng, Yingyu Yang +3Computed Tomography Dataset Medical Vision-Language Models
WorldVLN: Autoregressive World Action Model for Aerial Vision-Language Navigation
May 15, 2026Baining Zhao, Jiacheng Xu, Weicheng Feng +13Aerial Vision-Language Navigation Navigation
Modeling Music as a Time-Frequency Image: A 2D Tokenizer for Music Generation
May 15, 2026Yuqing Cheng, Xingyu Ma, Guochen Yu +1Audio Tokens Music Generation
Dynamic Chunking for Diffusion Language Models
May 15, 2026Yichen Zhu, Xiaoming Shi, Peng Zhao +3Diffusion Language Models Chunk
Ligand-Conditioned Discrete Diffusion for Protein Sequence-Structure Co-Design
May 15, 2026Chen Wei, Fanding Xu, Minghao Sun +5Protein Design Protein
PSD: Pushing the Pareto Frontier of Diffusion LLMs via Parallel Speculative Decoding
May 15, 2026Shengyin Sun, Yiming Li, Renxi Liu +7Diffusion Language Models Speculative Decoding
When Latent Geometry Is Not Enough: Draft-Conditioned Latent Refinement for Non-Autoregressive Text Generation
May 15, 2026De Shuai ZhangHigh-Fidelity Conditional Generation Video Latents
Membership Inference Attacks on Discrete Diffusion Language Models
May 15, 2026Shailesh KasivelrajanMasked Diffusion Language Models Membership Inference Attacks
Representation Without Reward: A JEPA Audit for LLM Fine-Tuning
May 14, 2026Biswa SenguptaLarge Language Model Fine-Tuning Joint-Embedding Predictive Architectures

May 27, 2026 · cs.LGJ/K move · Enter open · S save

Joint Training of Multi-Token Prediction in Reinforcement Learning via Optimal Coefficient Calibration

Zili Wang, Jiajun Chai, Lin Chen, Xiaohan Wang+2

School of Artificial Intelligence, University of Chinese Academy of Sciences, China · MAIS, Institute of Automation, Chinese Academy of Sciences, China · Meituan

Reinforcement Learning from Verifiable Rewards (RLVR) has emerged as the standard paradigm for improving reasoning capability of large language models, while Multi-Token Prediction (MTP) has been a widely adopted module in pretraining. Combining them is a natural approach, yet current RL practices detach MTP gradients because joint training degrades the performance. We revisit this failure from an optimization perspective. We show that the per-step effect of MTP on the RL objective can be decomposed into two terms: a first-order correlation and a second-order perturbation penalty. This decomposition unifies three MTP training regimes: Detach, Cross-Entropy loss, and Policy loss, and explains why each succeeds or fails. Further analysis of policy loss reveals that, although it aligns with intuition, performance still degrades: the correlation term decays while the quadratic penalty persists. Guided by the analysis, we propose Optimal Coefficient Calibration (OCC), an adaptive scheme that tracks the optimal coefficient online via a log-probability proxy at negligible cost. Across six competition-level mathematical reasoning benchmarks, OCC consistently matches or exceeds the detach baseline, delivering improved joint MTP-RL training performance.

Reinforcement Learning With Verifiable Reward Next-Token Prediction

Open paper Ask about it PDF