Autoregressive Model

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

25 new papers

A weekly snapshot of new work published in Autoregressive Model.

Period ending 2026-09-14

11 new papers

A weekly snapshot of new work published in Autoregressive Model.

Inside this field

Focused directions

Focused topic

Diffusion Language Models

Within Autoregressive Model

268 papersExplore

Focused topic

Autoregressive Model

Within Autoregressive Model

222 papersExplore

Focused topic

Autoregressive Language Models

Within Autoregressive Model

82 papersExplore

Focused topic

Next-Token Prediction

Within Autoregressive Model

80 papersExplore

Focused topic

Masked Diffusion Language Models

Within Autoregressive Model

70 papersExplore

Focused topic

Autoregressive Generation

Within Autoregressive Model

68 papersExplore

681 papers

Latest in Autoregressive Model

Browse all topics →

Simplifying the Modeling of Arbitrary Conditionals in Natural Language
Jun 12, 2026Yinhan Lu, Eric Elmoznino, Léo Gagnon +3High-Fidelity Conditional Generation Next-Token Prediction
Neither Parallel Nor Sequential: How DiffusionGemma Actually Commits Tokens
Jun 12, 2026Ali Asaria, Tony Salomone, Deep GandhiDiffusion Language Models Parallel
BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM
Jun 12, 2026Qingkai Fang, Shoutao Guo, Yang FengFull-Duplex Speech Models Full-Duplex Dialogue
DiPOD: Diffusion Policy Optimization without Drifting Apart
Jun 11, 2026Haozhe Jiang, Haiwen Feng, Pieter Abbeel +3Diffusion Policies Diffusion Language Models
Generative Modeling of Bach-Style Symbolic Music: A Comparative Study of Autoregressive, Latent-Variable, and Adversarial Approaches
Jun 11, 2026Dezhi Yu, Kyuil Lee, Yongkang HuangGenerative Models Autoregressive Model
Accelerating Speculative Diffusions via Block Verification
Jun 11, 2026Alexander Soen, Hisham Husain, Valentin De Bortoli +1Diffusion Language Models Speculative Decoding
TimeROME-DLM: Temporal Causal Tracing and Low-Rank Inference-Time Knowledge Editing for Masked Diffusion Language Models
Jun 11, 2026Zhengtao Yao, Liuyang Song, Hongbo Zhang +4Masked Diffusion Language Models Multimodal Knowledge Editing
Detect, Remask, Repair: Diffusion Editing for Faithful Summarization of Evolving Contexts
Jun 11, 2026Hao Zou, Zachary Horvitz, Chandhru Karthick +2Summarization Preservation
Two-Layer Linear Auto-Regressive Models Estimate Latent States
Jun 10, 2026Yahya Sattar, Sunmook Choi, Leo Maynard-Zhang +3Autoregressive Model Extended Kalman Filter
Breaking Entropy Bounds: Accelerating RL Training via MTP with Rejection Sampling
Jun 10, 2026Yucheng Li, Huiqiang Jiang, Yang Xu +14Reinforcement Learning Post-Training Deep Reinforcement Learning
Beyond Fully Random Masking: Attention-Guided Denoising and Optimization for Diffusion Language Models
Jun 10, 2026Jia Deng, Junyi Li, Wayne Xin Zhao +3Diffusion Language Models Image Denoising
Re-evaluating Confidence Remasking in Masked Diffusion Language Models
Jun 10, 2026Stipe Frkovic, Metod Jazbec, Dan Zhang +3Masked Diffusion Language Models Diffusion Language Models
Can News Predict the Market? Limits of Zero-Shot Financial NLP and the Role of Explainable AI
Jun 10, 2026Ali M Karaoglu, Shreyank N GowdaFinancial Sentiment Analysis Zero-Shot Forecasting
AnchorEdit: Maintaining Temporal Consistency in Multi-turn Image Editing via Causal Memory
Jun 10, 2026Hang Xu, Xiaoxiao Ma, Guohui Zhang +7Diffusion Editing Image Editing
Teaching Diffusion to Speculate Left-to-Right
Jun 10, 2026Lexington Whalen, Yuki Ito, Ryo SakamotoSpeculative Decoding Diffusion Language Models
SPADE: Split-and-Delay Embeddings for Autoregressive High-Granularity Calorimeter Simulation
Jun 9, 2026Joschka Birk, Frank Gaede, Anna Hallin +3Autoregressive Transformers Autoregressive Model
ARM: An AutoRegressive Large Multimodal Model with Unified Discrete Representations
Jun 9, 2026Junke Wang, Xiao Wang, Jiacheng Pan +16Autoregressive Image Generation Text-To-Image
CLP: Collocation-Length Prediction for Zero-Loss Adaptive Multi-Token Inference
Jun 9, 2026Xuezhen Xie, Zhiqiang ZhouNext-Token Prediction LLM Inference Efficiency
When Do Autoregressive Sequence Models Forecast Physical Wavefields? A Controlled Study on Synthetic Seismograms
Jun 9, 2026Waleed Esmail, Stuart Russell, Jana Klinge +2Long-Horizon Forecasting Autoregressive Model
Attention-Discounted Adaptive Sampler for Masked Diffusion Language Models
Jun 9, 2026Yusuf Sahin, Ahmed Rockey Saikia, Volkan Cevher +1Masked Diffusion Language Models Diffusion Language Models
K-Forcing: Joint Next-K-Token Decoding via Push-Forward Language Modeling
Jun 9, 2026Zhiwei Tang, Yuanyu He, Yizheng Han +4Autoregressive Language Models Autoregressive Generation
Prefilling-dLLM: Predictive Prefilling for Long-Context Inference in Diffusion Language Models
Jun 9, 2026Jing Xiong, Qi Han, Shansan Gong +5Diffusion Language Models Prefill
ANCHOR: Autoregressive Non-intrusive Chunk-Ordered Refinement for Joint Multi-Resolution Speech Quality Modeling
Jun 8, 2026Zhuoyan Tao, Jiatong Shi, Hye-jin Shim +1Speaker Recognition Autoregressive Model
A Continuous-Time Markov Chain Framework for Insertion Language Models
Jun 8, 2026Dhruvesh Patel, Benjamin Rozonoyer, Soumitra Das +3Diffusion Language Models Graph Language Models
BiWM: Advancing Open-Source Interactive Video World Models with Bidirectional Autoregression
Jun 8, 2026Shaohao Rui, Xiaofeng Mao, Zhanyu Zhang +5Video World Models Pre-Trained Video Diffusion Models
Structured Adaptive Tensor Prediction for Streaming Data
Jun 8, 2026Zhen Qin, Yang ChenTime Series Time-Varying Systems
Tight Sample Complexity of Transformers
Jun 8, 2026Chenxiao Yang, Nathan Srebro, Zhiyuan LiTransformer Architectures Sample Complexity
Next-Token Prediction Learns Generalisable Representations of Sleep Physiology
Jun 8, 2026Jonathan F. Carter, Lionel TarassenkoMultimodal Physiological Signals Electronic Health Record Foundation Models
Optimality of FSQ Tokens for Continuous Diffusion for Categorical Data with Application to Text-to-Speech
Jun 8, 2026Vadim Popov, Wenju Gu, Tasnima Sadekova +2Diffusion Language Models Audio Tokens
Does Normalization Choice Matter for Causal Large Time-Series Models?
Jun 8, 2026Samy-Melwan Vilhes, Gilles Gasso, Mokhtar Z AlayaNormalization Time Series
Unified Energy for Invariant and Independent Decoding in Diffusion Language Models
Jun 8, 2026Yuchen Yan, Minkai Xu, Zaiquan Yang +1Diffusion Language Models Invariance
OmniGen-AR: AutoRegressive Any-to-Image Generation
Jun 8, 2026Junke Wang, Xun Wang, Qiushan Guo +4Autoregressive Image Generation Visual Generation
FlashTTS: Fast Streaming TTS with MTP Acceleration and X-pred Mean Flow Distillation
Jun 8, 2026Hanke Xie, Xiaming Ren, Dake Guo +10Zero-Shot Text-To-Speech Flash
Addressing Market Regime Changes and Heavy-Tailed Returns in Portfolio Optimization via Bayesian VAR and Elliptical Black-Litterman
Jun 8, 2026Daniil Mikriukov, Ruoyu Sun, Angelos Stefanidis +2Portfolio Optimization Long-Tailed Distribution
TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speech
Jun 8, 2026Yejin Lee, Junwon Moon, Hyoeun Kim +3Audio Tokens Zero-Shot Text-To-Speech
An Effective Router for Vision-Language Model Selection
Jun 8, 2026Can Wang, Shengwei Wang, Bolin Zhang +2Vision-Language Multimodal Dataset
CSFlow: Aligning Flow Matching with Human Contrast Sensitivity
Jun 7, 2026Malgorzata Galinska, Bart Pogodzinski, Jan Eric LenssenHierarchical Flow Matching Conditional Flow Matching
Continuous Language Diffusion as a Decoder-Interface Problem
Jun 7, 2026Zhicheng Du, Lan MaDiffusion Language Models Large Language Model Decoder
Back on Track: Aligning Rewards and States for Reasoning in Diffusion Large Language Models
Jun 7, 2026Yawen Shao, Jie Xiao, Kai Zhu +6Diffusion Language Models
Hacking Generative Perplexity: Why Unconditional Text Evaluation Needs Distributional Metrics
Jun 7, 2026Antonio Franca, Alexander TongLanguage Model Perplexity Diffusion Language Models
AsyncLane: Decoupling Refinement from Advancement in Diffusion Language Model Decoding
Jun 7, 2026Yingxuan Ren, Yuxuan Lou, Yong Liu +4Diffusion Language Models Autoregressive Decoding
TimpaTeks: Automatic In-place Text Sequence Modification via Diffusion Language Model Steering
Jun 7, 2026Ryandito Diandaru, Ikhlasul Akmal Hanif, Fadli Aulawi Al Ghiffari +2Diffusion Language Models Text Generation
Forward-Free Diffusion Language Models
Jun 6, 2026Haotian Sun, Rushi Qiang, Yuqian Zheng +1Diffusion Language Models Autoregressive Generation
De novo molecular generation with optical property preconditioning at the token level
Jun 6, 2026Haozhe Huang, Manuel Gonzalez Lastre, Hyun Suk Park +3Molecular Generation Vast Chemical Space
Diffusion Language Model Parallel Decoding via Product-of-Experts Bridge
Jun 6, 2026Juntong Shi, Brian L. Trippe, Jure Leskovec +2Diffusion Language Models Parallel
Data-Efficient Autoregressive-to-Diffusion Language Models via On-Policy Distillation
Jun 4, 2026Xingyu Su, Jacob Helwig, Shubham Parashar +6Diffusion Language Models On-Policy Distillation
Self-Augmenting Retrieval for Diffusion Language Models
Jun 4, 2026Paul Jünger, Justin Lovelace, Linxi Zhao +2Diffusion Language Models Retrieval-Augmented Generation Systems
Latent Reasoning with Normalizing Flows
Jun 4, 2026Guancheng Tu, Xiangjun Fu, Suhao Yu +5Efficient Latent Reasoning Autoregressive Language Models
Learning What to Forget: Improving LLM Unlearning via Learned Token-Level Importance
Jun 4, 2026Gizem Yüce, Giorgos Nikolaou, Nicolas FlammarionLarge Language Model Unlearning Autoregressive Language Models
Adapting Diffusion Language Models for Lossless Pixel-Level Image Transmission
Jun 4, 2026Tianqi Ren, Rongpeng Li, Xianfu Chen +2Source-Channel Coding Entropy Coding
Generative Criticality in Large Language Model Temperature Scaling
Jun 4, 2026Huajian Ruan, Jinyang Li, Xingyu Guo +1Large Models Autoregressive Generation
NAVIRA: Decoupled Stochastic Remasking for Masked Diffusion Language Models
Jun 4, 2026Andrey Fomenko, Maksim Kryzhanovskiy, Svetlana Glazyrina +1Masked Diffusion Language Models Diffusion Language Models
DiG-Plan: Mitigating Early Commitment for Tool-Graph Planning via Diffusion Guidance
Jun 4, 2026Yansi Li, Zhuosheng ZhangClassical Planning Planning Methods
Rethinking LoRA Memory Through the Lens of KV Cache Compression
Jun 4, 2026Chunsheng Zuo, Liaoyaqi Wang, William Jurayj +2Key-Value Cache Compression Key-Value Cache
FLAGG: Flexible Autoregressive Graph Generation
Jun 3, 2026Samuel Cognolato, Alessandro Sperduti, Luciano SerafiniAutoregressive Generation
SAID: Accelerating Diffusion-Based Language Models via Scaffold-Aware Iterative Decoding
Jun 3, 2026Na Li, Chengda Wang, Mingju Gao +1Diffusion Language Models Autoregressive Generation
SemBlock: Semantic Boundary Dynamic Blocks for Diffusion LLMs
Jun 3, 2026Xinrui Song, Zhuoran Wang, Mingju Gao +1Diffusion Language Models
STaR-Quant: State-Time Consistent Post-Training Quantization for Diffusion Large Language Models
Jun 3, 2026Xin Yan, Aqiang Wang, Zhenglin Wan +2Large Language Model Quantization Weight-Only Quantization
Data Attribution in Large Language Models via Bidirectional Gradient Optimization
Jun 3, 2026Frédéric Berdoz, Luca A. Lanzendörfer, Kaan Bayraktar +1Training Data Attribution Autoregressive Language Models
Dynamic Infilling Anchors for Format-Constrained Generation in Diffusion Large Language Models
Jun 3, 2026Boyan Han, Yiwei Wang, Yi Song +2Diffusion Language Models Residual Anchoring

Jun 12, 2026 · cs.CLJ/K move · Enter open · S save

Simplifying the Modeling of Arbitrary Conditionals in Natural Language

Yinhan Lu, Eric Elmoznino, Léo Gagnon, Sarthak Mittal+2

Causal Transformers model sequences through an autoregressive factorization of the joint distribution, which enables efficient left-to-right decoding and conditional likelihood computation. However, they cannot tractably sample from or evaluate arbitrary conditionals -- e.g., a block of text conditioned on past and future tokens. Recent work aims to solve this problem through novel architectures, but they often lead to sub-optimal modeling of such conditionals and degraded generations. We propose Arbitrary Conditionals GPT (AC-GPT) which introduces a simple modification to standard causal Transformers to enable evaluating and sampling from arbitrary conditionals -- including past, future, and mixed contexts -- within a single forward pass. Unlike prior approaches, our method preserves the standard left-to-right ordering and next-token prediction objective essential for both strong performance and efficient training on natural language. Crucially, this compatibility allows existing LLMs to be fine-tuned for arbitrary conditioning. Our empirical results indicate that our method outperforms baselines on modeling arbitrary conditionals, without degrading standard left-to-right performance.

High-Fidelity Conditional Generation Next-Token Prediction Autoregressive Model Likelihood

Open paper Ask about it PDF