Overview

Autoregressive generation models how to build sequences one token, event, or chunk at a time, using prior outputs to create text, audio, images, motion, graphs, molecules, and other structured data. Common approaches include next-token transformers, hierarchical or coarse-to-fine prediction, compact learned tokenizations, and hybrids that combine autoregression with diffusion, flow matching, or reward-based optimization. Researchers use conditioning, structured representations, and training on imperfect rollouts to improve controllability, validity, and long-horizon consistency across benchmarks ranging from language and music to 3D geometry and scientific simulation. A central tension is that sequential dependencies support coherent, flexible outputs but can make generation slow and errors accumulate, motivating parallel decoding and better measures of quality beyond next-step prediction.

Latest papers

CardsList

115 papers11 papers in the last four weeks, down 21% on the four weeks before. 0.1% of all new papers.

  1. Beyond Flat Walks: Compositional Abstraction for Autoregressive Graph Generation

    Nov 9, 2026Kaiwen Bian, Andrew H. Yang, Yusu Wang +2Graph GenerationAutoregressive Generation

  2. G-STAR: Group-Scaled Token Capacity for Deeply Compressed Autoregressive Generation

    Nov 8, 2026Xu Huang, Ye Huang, Xiaotong Li +8Autoregressive Image GenerationAutoregressive Generation

  3. On the Generation Order in GFlowNets

    Oct 30, 2026Timofei Gritsaev, Evgeny Katasonov, Ildus Sadrtdinov +2Generative Flow NetworksAutoregressive Generation

  4. What to randomize matters: a controlled study of volume, axis and representation in low-data molecular generation

    Oct 28, 2026Neerav Kaushal, Alisa Teige, Ajay MNV PenmatsaMolecular GenerationSynthetic Data Augmentation

  5. Visual Autoregressive Generation with Next Token Imagination

    Oct 27, 2026Ruihang Jiang, Zongyao Zhao, Zhaolin Wang +2Visual Autoregressive ModelsAutoregressive Image Generation

  6. CrystalAR: Autoregressive Modeling for Symmetric Crystal Generation

    Oct 20, 2026Ziqiao Meng, Rongsheng Chen, Zhi Zheng +4Crystal Structure GenerationCrystal Structure Prediction

  7. OrderGPT: Generation Order as a Learnable Modeling Choice

    Oct 19, 2026Chenhe Yang, Yuhuan Lyu, Tianyang HuAutoregressive ModelingAutoregressive Generation

  8. FracTS: Hierarchical and Autoregressive Time Series Generation

    Oct 18, 2026Jiayu Li, Umair Afzal, Zilong Zhao +3Time Series GenerationAutoregressive Generation

  9. Power-Law Correlations Without Apparent Temperature-Tuned Criticality in Fixed-Tree Hierarchical Languages

    Oct 17, 2026Marcel Kühn, Bernd RosenowAutoregressive Generation

  10. Thought Blocks: Non-Autoregressive Latent Communication for Multi-Agent Systems via Trajectory-to-State Compilation

    Oct 16, 2026Zhenhan Guan, Xiaolong Liu, Hengwei Ye +1Multi-Agent CommunicationMulti-Agent LLM Systems

  11. MARS - A foundational map auto-regressor

    Oct 14, 2026Qi Zhang, Suvam Bag, Rupanjali Kukal +9Geospatial Foundation ModelsHD Map Construction

  12. Limitations on Autoregressive Token Generation via Sequential Sampling

    Oct 10, 2026Gal Arnon, Andrej Bogdanov, Paul Lou +3Autoregressive Generation

  13. Sonic-AMG: Streaming Human Motion Generation from Spatial Audio

    Oct 9, 2026Jingcheng Ni, Zekun Li, Zhiyang Dou +6Human Motion GenerationAutoregressive Generation

  14. The Lattice of Transition Laws

    Oct 8, 2026T. Y. Tsui, Jiatao Gu, Lingjie LiuParallel DecodingDiffusion Sampling

  15. Scaling Collider Event Generation with Residual-Quantized Tokens

    Sep 30, 2026Dan Godi, Dmitrii Kobylianskii, Eilam GrossAutoregressive GenerationConditional Generative Modeling

  16. Autoregressive Frontier Expansion: Growing Trees with Graph Machine Learning

    Sep 29, 2026Umer Gupta, Saku Peltonen, Martin RitzertGraph GenerationAutoregressive Generation

  17. GraphVQ: Structure-Aware Autoregressive Decoding over Context-Quantized Graph Tokens

    Sep 29, 2026Yuxiang Yao, Zijun ZhaoAutoregressive GenerationGraph Foundation Models

  18. DrawingsDreamer: A Unified Multi-View Engineering Drawings Generation Model

    Sep 28, 2026Shurui Liu, Weide Chen, Changwang Yi +1Vector Graphics GenerationGenerative Modeling

  19. HALO: Enhancing Time Series Generation via Hyperspherical Latents and Masked AutoregRessive Modeling

    Sep 28, 2026Chunyi Hou, Xiangfei Qiu, Hanyin Cheng +2Variational AutoencodersTime Series Generation

  20. Editable Map-Conditioned Trajectory Generation for Human Mobility Simulation

    Sep 26, 2026Takayuki Mizuno, Shouji Fujimoto, Mikito Hiruki +1Trajectory GenerationHuman Behavior Simulation

  21. ShapeLex: Decoupling Local Shape Symbolization and Global Scale Modeling for Text-Controlled Time Series Generation

    Sep 21, 2026Subo Wei, Jianqi Gao, Mingyan Fan +3Time Series GenerationAutoregressive Generation

  22. SewFusion: Tailored Generation of Topology and Panel-Level Geometry for Sewing Patterns

    Sep 20, 2026Jiaxin Lin, Xiao Pan, Hangjie Yuan +3Generative ModelingAutoregressive Generation

  23. Fraglingo: Molecular Design via Attachment-Aware Autoregressive Fragment Generation

    Sep 11, 2026Thao Nguyen, Jeonghwan Kim, Zhenhailong Wang +1Molecular GenerationMolecule Design

  24. Sparse auto-regressive modeling for scene generation from multi-view images

    Sep 3, 2026Thomas Lucas, Maxime Pietrantoni, Philippe Weinzaepfel +4Sparse-View 3D Reconstruction3D Scene Generation

  25. Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domains

    Aug 31, 2026Zi Wang, Minghui Xu, Tapan MukerjiGraph Neural NetworksNeural PDE Solvers