Autoregressive Model

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

25 new papers

A weekly snapshot of new work published in Autoregressive Model.

Period ending 2026-09-14

11 new papers

A weekly snapshot of new work published in Autoregressive Model.

Inside this field

Focused directions

Focused topic

Diffusion Language Models

Within Autoregressive Model

268 papersExplore

Focused topic

Autoregressive Model

Within Autoregressive Model

222 papersExplore

Focused topic

Autoregressive Language Models

Within Autoregressive Model

82 papersExplore

Focused topic

Next-Token Prediction

Within Autoregressive Model

80 papersExplore

Focused topic

Masked Diffusion Language Models

Within Autoregressive Model

70 papersExplore

Focused topic

Autoregressive Generation

Within Autoregressive Model

68 papersExplore

681 papers

Latest in Autoregressive Model

Browse all topics →

Echo-Infinity: Learning Evolving Memory for Real-Time Infinite Video Generation
Jun 3, 2026Yuxuan Bian, Zeyue Xue, Songchun Zhang +9Long Video Generation Autoregressive Generation
Global Sketch-Based Watermarking for Diffusion Language Models
Jun 3, 2026Daniel ZhaoWatermarking Watermarks
D^2SD: Accelerating Speculative Decoding with Dual Diffusion Draft Models
Jun 3, 2026Liyuan Zhang, Jiarui Zhang, Jinwei Yao +6Speculative Decoding Diffusion Language Models
Read the Trace, Steer the Path: Trajectory-Aware Reinforcement Learning for Diffusion Language Models
Jun 3, 2026Anant Khandelwal, Manish GuptaDiffusion Language Models Denoising Trajectory
Scaling Novel Graph Generation via Lightweight Structure-Guided Autoregressive Models
Jun 2, 2026Alessio Barboni, Massimiliano Lupo Pasini, Bishal Lakha +1Graph Representations Generative Models
Supportive Token Revealing for Fast Diffusion Language Model Decoding
Jun 2, 2026Giries Abu Ayoub, Mario Barbara, Lluís Pastor-Pérez +4Diffusion Language Models
When Autoregressive Consistency Hurts Safety Alignment
Jun 2, 2026Bochen Lyu, Yiyang Jia, Xiaohao Cai +1Safety Alignment Large Language Model Alignment
Stationarity-Aware Retrieval-Augmented Time Series Forecasting
Jun 2, 2026Shiqiao Zhou, Holger Schöner, Zipeng Wu +3Time Series Autoregressive Model
Knowledge Editing for Masked Diffusion Language Models
Jun 2, 2026Haewon Park, Yohan JoMultimodal Knowledge Editing Masked Diffusion Language Models
MAGNIFIED: RL Fine-tuning of Multimodal Large Language Models for Motion Planning
Jun 2, 2026Letian Chen, Yiren Lu, Justin Fu +5Autonomous Driving Reinforcement Fine-Tuning
The Language of Elution: Autoregressive Prediction of the Next Feature in Untargeted LC-HRMS Lipidomics
Jun 2, 2026Dayanjan S. WijesingheTandem Mass Spectra Metabolic
Causal Evidence of Stack Representations in Modeling Counter Languages Using Transformers
Jun 2, 2026Nishit SinghTransformer Architectures Next-Token Prediction
Learning Temporal Causal Structure via Smooth Differentiable Optimization
Jun 2, 2026Tong Zhao, Ce Guo, Wayne Luk +2Causal Foundation Models Temporal Dependence
Experience-Driven Dynamic Exits for LLMs with Reinforcement Learning
Jun 2, 2026Yanyu Zhu, Hoilam Pao, Niu Hu +6Speculative Decoding LLM Inference Efficiency
Fast-dLLM++: Fréchet Profile Decoding for Faster Diffusion LLM Inference
Jun 1, 2026Siva Rajesh Kasa, Yasong Dai, Sumit Negi +1Diffusion Language Models LLM Inference Efficiency
From Zero to Hero: Training-Free Custom Concept Spawning in World Models
Jun 1, 2026Kiymet Akdemir, Pinar YanardagWorld Models Autoregressive Model
SimSD: Simple Speculative Decoding in Diffusion Language Models
Jun 1, 2026Junxia Cui, Haotian Ye, Runchu Tian +9Diffusion Language Models Speculative Decoding
MORPHOS: Autoregressive 4D Generation with Temporal Structured Latents
Jun 1, 2026Minkyung Kwon, Jinhyeok Choi, Youngjin Shin +33D Assets 4D Generation
Deep Learning for Remote Sensing to Improve Flood Inundation Mapping
Jun 1, 2026Yogesh Bhattarai, Vijay Chaudhary, Wai Lim Kim +1Flood Detection Sen1Floods11
BlockGen: Flexible Blockwise Sequence Modeling with Hybrid Samplers
Jun 1, 2026Justin Deschenaux, Caglar GulcehreDiffusion Language Models Diffusion Processes
Cost-Aware Diffusion Draft Trees for Speculative Decoding
Jun 1, 2026Shuai Zhang, Huachuan Qiu, Hongliang He +1Speculative Decoding Diffusion Language Models
FLARE: Diffusion for Hybrid Language Model
Jun 1, 2026Yuchen Zhu, Jing Shi, Chongjian Ge +9Diffusion Language Models Image Denoising
DiffuSent: Towards a Unified Diffusion Framework for Aspect-Based Sentiment Analysis
May 31, 2026Shu Long, Yanglei Gan, Xuchuan ZhouSentiment Analysis Autoregressive Diffusion
Time Series as Language: A Universal Tokenizer for General-Purpose Time Series Foundation Models
May 31, 2026Yunhao Zhang, Ruiying Qi, Jiale Zheng +3Time Series Foundation Models Time Series
Feature to Dynamics: Feature-space to Autoregression strategy for Zero-shot Time Series Forecasting
May 31, 2026Yifan Wu, Junjie Wu, Kai Wu +2Zero-Shot Forecasting Zero-Shot Inference
Revise, Don't Freeze: Sampler-Matched Training for Self-Correcting Masked Diffusion Language Models
May 31, 2026Longxuan Yu, Shaorong Zhang, Yu Fu +3Masked Diffusion Language Models Diffusion Language Models
DSL-LLaDA: Scaling Continuous Denoising to 8B Masked Diffusion LMs
May 31, 2026Longxuan Yu, Yunshu Wu, Yu Fu +5Masked Diffusion Language Models Summarization
WaveFilter: Enhancing the Long-Context Capability of Diffusion LLMs via Wavelet-Guided KV Cache Filtering
May 30, 2026Jinnan Yang, Yan Wang, Zhen Bi +5Efficient Long-Context Inference Key-Value Cache
EPIC: Efficient and Parallel Inference under CFG Constraints for Diffusion Language Models
May 30, 2026Hyundong Jin, Yo-Sub HanDiffusion Language Models Context-Free Grammars
DREAM-S: Speculative Decoding with Searchable Drafting and Target-Aware Refinement for Multimodal Generation
May 30, 2026Zining Liu, Yunhai Hu, Tianhua Xia +4Speculative Decoding Autoregressive Generation
Adaptive Order Policies for Masked Diffusion
May 29, 2026Jama Hussein Mohamud, Mohsin Hasan, Mirco Ravanelli +1Masked Diffusion Language Models Order Matters
ARCA: Adapter-Residual Credit Assignment When Token Signals Degenerate
May 29, 2026Rodney Lafuente-MercadoCredit Assignment Autoregressive Language Models
A Pre-Training Analogue of Grokking in Language Models: Tracing Delayed Grammatical Generalization
May 29, 2026Sherin Muckatira, Namrata Shivagunde, Vijeta Deshpande +1Large Language Model Pretraining Model Pretraining
What Gets Unmasked First? Trajectory Analysis of Diffusion Models for Graph-to-Text Generation
May 29, 2026Qing Wang, Jacob Devasier, Chengkai LiMasked Diffusion Language Models Diffusion Language Models
Flow map learning in nonlinear vector autoregressive models: influence of the feature-library structure on the training error
May 29, 2026Markus GrossNonlinear Dynamics Reservoir Computing
AR Forcing: Towards Long-Horizon Robot Navigation World Model
May 29, 2026Yifei Yang, Zehua Fan, Huan Li +9Autoregressive Model Long-Horizon Planning
Fixed-Point Masked Generative Modeling
May 29, 2026Andrea Miele, Yiming Qin, Alba Carballo-Castro +2Masked Diffusion Language Models Generative Models
QVGGT: Post-Training Quantized Visual Geometry Grounded Transformer
May 29, 2026Zhizhen Pan, Hesong Wang, Huan Wang3D Perception Self-Supervised Vision Transformers
Cognitive Fatigue in Autoregressive Transformers: Formalization and Measurement
May 29, 2026Riju Marwah, Ritvik Garimella, Vishal Pallagani +3Autoregressive Language Models Large Language Model Performance
AMix-2: Establishing Protein as a Native Modality in Large Language Models
May 29, 2026Keyue Qiu, Yixin Wu, Lihao Wang +19Protein Design Protein Data Bank
dMoE: dLLMs with Learnable Block Experts
May 29, 2026Sicheng Feng, Zigeng Chen, Gongfan Fang +2Mixture-of-Experts Models Diffusion Language Models
Speculative Pipeline Decoding: Higher-Accruacy and Zero-Bubble Speculation via Pipeline Parallelism
May 29, 2026Yijiong Yu, Huazheng Wang, Shuai Yuan +2Speculative Decoding Self-Speculative
Efficient Diffusion LLMs via Temporal-Spatial Parallel Decoding and Confidence Extrapolation
May 29, 2026Zekai Li, Ji Liu, Yiqing Huang +3Diffusion Language Models LLM Inference Efficiency
Unlocking the Working Memory of Large Language Models for Latent Reasoning
May 28, 2026Lukas Aichberger, Sepp HochreiterEfficient Latent Reasoning Large Language
Future Forcing: Future-aware Training-free KV Cache Policy for Autoregressive Video Generation
May 28, 2026Jiayi Luo, Qiyan Liu, Tengyang Wang +8Autoregressive Video Generation Controllable Video Generation
Masked Diffusion Modeling for Anomaly Detection
May 28, 2026Lixing Zhang, Yuchen Liang, Liyan XieReconstruction-Based Anomaly Detection Anomaly Detection
STAP: A Shuffle-Tokenized App Predictor with Ultra Long Context for Vocabulary-Free Mobile App Prediction
May 28, 2026Chengyu Fan, Hang LiuNext-Token Prediction Device
Masked Diffusion Vision-Language Models for Temporal Action Localization
May 28, 2026Fengshun Wang, Zhengbo Zhang, Zhigang TuTemporal Action Localization Masked Diffusion Language Models
NaRA: Noise-Aware LoRA for Parameter-Efficient Fine-Tuning of Diffusion LLMs
May 28, 2026Shuaidi Wang, Zhan Zhuang, Ruping Huang +1Diffusion Language Models Parameter-Efficient Fine-Tuning
The Little Book of Generative AI Foundations: An Intuitive Mathematical Primer
May 28, 2026Tianhua ChenGenerative Models Generative Artificial Intelligence
SuperVoxelGPT: Adaptive and Ordered 3D Tokenization for Autoregressive Shape Generation
May 28, 2026Yuan Li, Congyi Zhang, Xifeng Gao +1Voxel Autoregressive Generation
DLM-SWAI: Steering Diffusion Language Models Before They Unmask
May 28, 2026Hyeseon An, Yo-Sub HanDiffusion Language Models Activation Steering
Decoding Strategies for Diffusion-Based ASR: A Systematic Evaluation of Confidence-Based Thresholding
May 28, 2026Jeong Hun Yeo, Minsu Kim, Hyeongseop Rha +1Llm-Based Automatic Speech Recognition Autoregressive Decoding
Cluster-Level Attention-Guided Parallel Decoding for Masked Diffusion Language Models
May 28, 2026Heqiang Qi, Wei Huang, Mingyuan Bai +1Masked Diffusion Language Models Diffusion Language Models
GDSD: Reinforcement Learning as Guided Denoiser Self-Distillation for Diffusion Language Models
May 28, 2026Xiaohang Tang, Keyue Jiang, Che Liu +4Diffusion Language Models Unsupervised On-Policy Self-Distillation
BlockBatch: Multi-Scale Consensus Decoding for Efficient Diffusion Language Model Inference
May 28, 2026Xiaoyou Wu, Cheng-Jhih Shih, Binfei Ji +2Diffusion Language Models LLM Inference Efficiency
The Confidence Shortcut: A Reasoning Failure Mode of Masked Diffusion Models
May 27, 2026Dueun Kim, Albert NoMasked Diffusion Language Models Training-Inference Mismatch
Neural Scaling Laws for Jet Generation
May 27, 2026Oz Amram, Darius A. Faroughy, Tjarko Gerdes +5Scaling Laws High Energy Physics
Entropy-aware Masking for Masked Language Modeling
May 27, 2026Gokul Srinivasagan, Kai Hartung, Munir GeorgesMasked Diffusion Language Models Knowledge Distillation
Compositional Generalization in Autoregressive Models via Logit Composition
May 27, 2026Aakash Kumar, Maria Sofia Bucarelli, Emanuele NataleAutoregressive Model Compositionality

Jun 3, 2026 · cs.MMJ/K move · Enter open · S save

Echo-Infinity: Learning Evolving Memory for Real-Time Infinite Video Generation

Yuxuan Bian, Zeyue Xue, Songchun Zhang, Shiyi Zhang+8

1The Chinese University of Hong Kong · 2Joy Future Academy, JD · 3The Hong Kong University of Science and Technology · 4Tsinghua University · 5The University of Hong Kong

We present Echo Infinity, an autoregressive (AR) framework towards real-time infinite video generation that employs a learnable evolving memory to dynamically filter, abstract, and compress any-length history at constant cost. Existing methods mainly curate memory with predefined KV-cache schedules, fixed-ratio heuristic compression, or inference-time RoPE adaptation. These designs inevitably lose historical information and amplify compounding errors due to their limited cache window and ignorance of autoregressive generation noise. Inspired by human memory consolidation, Echo-Infinity replaces handcrafted memory curation with learnable Memory Query, which are updated by attention and a gating mechanism when past frames are evicted from the local window. The queries are optimized end-to-end with the video diffusion transformers (DiTs), forming an evolving memory that supports arbitrary compression ratios with constant computation independent of video length. They also act as a generalizable generation prior, improving quality even when only the optimized initial state is used. We further introduce Unified Relative RoPE Recipe, which anchors the sink frames to start from id 0 and lets the newest frame id grow at most to the DiTs' pretrained maximum temporal RoPE id throughout training and inference, freeing the model from the finite RoPE constraint and closing the train-test RoPE extrapolation gap. In long and short video generation, Echo-Infinity achieves state-of-the-art performance, and, to our knowledge, demonstrates promising 24-hour (>1.3 M frames) real-time rollouts for the first time, suggesting a practical path toward infinite video generation.

Long Video Generation Autoregressive Generation Rotary Position Embedding

Open paper Ask about it PDF