Overview

Autoregressive generation models how to build sequences one token, event, or chunk at a time, using prior outputs to create text, audio, images, motion, graphs, molecules, and other structured data. Common approaches include next-token transformers, hierarchical or coarse-to-fine prediction, compact learned tokenizations, and hybrids that combine autoregression with diffusion, flow matching, or reward-based optimization. Researchers use conditioning, structured representations, and training on imperfect rollouts to improve controllability, validity, and long-horizon consistency across benchmarks ranging from language and music to 3D geometry and scientific simulation. A central tension is that sequential dependencies support coherent, flexible outputs but can make generation slow and errors accumulate, motivating parallel decoding and better measures of quality beyond next-step prediction.

Latest papers

CardsList

115 papers7 papers in the last four weeks, down 59% on the four weeks before. 0.1% of all new papers.

  1. Preference Shapes Relevance: Cross-component Hierarchical Semantic Alignment for Personalized Generative Retrieval

    Aug 31, 2026Gaoming Zhang, Angqing Jiang, Jianchun Song +4Generative RetrievalSemantic Alignment

  2. Generation of High-Level Concepts in 3D Scene Graphs via Autoregressive Diffusion

    Aug 28, 2026Jose Andres Millan-Romera, Samuel Cognolato, Holger Voos +23D SGGAutoregressive Generation

  3. Reward-Guided Autoregressive Graph Generation for Efficient Multi-Agent Communication Topology Design

    Aug 20, 2026Poomphob Suwannapichat, Boonyarit Changaival, Caesar Wu +1Multi-Agent Communication TopologyGraph Generation

  4. MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modeling

    Aug 14, 2026Manwen Liao, Xinyu Lian, Jian Mao +11Autoregressive 3D Scene GenerationPart-Level 3D Generation

  5. MiDashengLM-Gen: Unified Audio Scene Generation via LLM-Driven Autoregressive Flow Matching

    Aug 12, 2026Xingwei Sun, Heinrich Dinkel, Gang Li +7Text-to-Audio GenerationAutoregressive Generation

  6. SynVAR: Synergizing Spatial and Semantic Alignment in Visual Autoregressive Model

    Aug 8, 2026Zhennan Chen, Tianxing Shi, Pengcheng Xu +5Visual Autoregressive ModelsAutoregressive Image Generation

  7. Stochastic Autoregressive Learning

    Aug 7, 2026Ilan Doron-Arad, Idan Mehalel, Elchanan MosselAutoregressive GenerationPAC Learning

  8. Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectification

    Aug 6, 2026Lisai Zhang, Yidi Wu, Qi Liu +7Audio-Video GenerationLong-Horizon Video Generation

  9. Scaling an Autoregressive Transformer for Single-Cell Generation

    Aug 3, 2026Aleksandr Sharipov, Yusif Mukhtarov, Igor MolybogTransformerAutoregressive Generation

  10. Learning to Tessellate: Point Cloud Generation via Recursive Spectral Partitioning

    Aug 3, 2026Monan Sun, Bangzhen Liu, Huaidong Zhang +1Point Cloud Learning3D Shape Generation

  11. Temperature-driven inversion and nonlinear dynamics in ChatGPT-like AIs

    Aug 2, 2026Neil F. Johnson, Frank Yingjie Huo, Bella Xinrui LiLanguage Model DecodingAutoregressive Generation

  12. Stable Autoregressive Speech Generation with Low-Frame-Rate High-Dimensional Continuous Tokens

    Jul 31, 2026Yi Luo, Rongzhi Gu, Jixun YaoFlow MatchingAudio Representation Learning

  13. Pointer-Augmented Autoregressive Generation of Patent Claims with Joint Topology and Content Decoding

    Jul 27, 2026Yongmin Yoo, Zhangkai Wu, Longbing CaoPointer NetworksAutoregressive Generation

  14. SketchMamba: A Lightweight State-Space Model for Joint Progressive Sketch Classification and Stroke Auto-Completion

    Jul 26, 2026Kavish Jhaveri, Arya ShahAutoregressive GenerationImage Classification

  15. Autoregressive B-Rep Shape Generation with Parametric Surfaces

    Jul 19, 2026Dafei Qin, Rui Xu, Zeyu Shen +8Parametric CAD Modeling3D Shape Generation

  16. Latent Trajectory Discrimination for AI-Generated Text Detection

    Jul 16, 2026Gianluca Bonifazi, Christopher Buratti, Michele Marchetti +5AI-Generated Text DetectionAutoregressive Generation

  17. AdaPCLA: Adaptive Prior-Calibrated Logit Adjustment for Long-Tailed Longitudinal EHR Generation

    Jul 14, 2026Shuai Cui, Chen Wenxuan, Wenjie Du +3Logit AdjustmentLong-Tail Learning

  18. ARDepth: Auto-regressive Monocular Depth Estimation with Progressive Visual Conditioning

    Jul 14, 2026Zijie Wang, Wei Zhang, Weiming Zhang +4Depth EstimationMonocular Depth Estimation

  19. Traj-VLN: Learning Pixel-Space Interaction via Autoregressive Trajectory Generation

    Jul 12, 2026Changfei Fu, Guangcheng Chen, Wenjun Xu +1VLM AdaptationVision-Language Navigation

  20. Next-Dense-Stride Prediction for Multimodal Autoregressive Visual Modeling

    Jul 10, 2026Chicago Y. Park, Jialin Mao, Xiaojian Xu +3Unified Multimodal ModelsAutoregressive Image Generation

  21. Autoregressive latent diffusion for 3D molecule generation

    Jul 10, 2026Federico Ottomano, Gaopeng Ren, Yingzhen Li +2Latent Diffusion ModelsMolecular Graph Generation

  22. DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation

    Jul 6, 2026Xin Cheng, Xingkai Yu, Chenze Shao +30LLM ServingSpeculative Decoding

  23. Autoregressive Boltzmann Generators

    Jun 25, 2026Danyal Rehman, Charlie B. Tan, Yoshua Bengio +2Autoregressive GenerationMolecular Generation

  24. SubdivAR: Autoregressive Next-Scale Prediction for Neural Mesh Subdivision

    Jun 25, 2026Huipeng Guo, Zikai Song, Hang Long +73D Mesh GenerationNeural Representation Geometry

  25. Latent Block-Diffusion Temporal Point Processes: A Semi-Autoregressive Framework for Asynchronous Event Sequence Generation

    Jun 23, 2026Shuai Zhang, Yancheng Chen, Chuan Zhou +5Temporal Point ProcessesLatent Diffusion Models