Autoregressive Decoding

Ask about this topic

Momentum

9 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 55

All topics
CardsList

  1. Tacit-TTS: From Autoregressive Decoding to Masked Prediction for Efficient Transcript-Free Voice Cloning

    Sep 29, 2026Jian Chen, You Zhang, Mark VintonCross-Lingual Voice CloningTranscript

    Dolby Laboratories

  2. RVQ Position Aware Speculative Decoding for On Device Text to Speech

    Sep 29, 2026Berkin Durmus, Eduardo Pacheco, Zach Nagengast +1Autoregressive Text-To-SpeechAutoregressive Decoding

    Argmax, Inc., USA

  3. HyperZip: Efficient Data Compression through Personalized Diffusion LLMs with Hypernetworks

    Sep 28, 2026Thai Nguyen, Khang Tran, NhatHai PhanTask-Aware CompressionAutoregressive Decoding

    New Jersey Institute of Technology

  4. Beneath the Tokens: A Performance Engineering Study of Multi-Token Prediction in GPU-Accelerated LLM Inference

    Sep 28, 2026Suwesh Prasad SahMulti-Token PredictionLLM Inference Optimization

  5. FoldAttention: Declared-Reference Softmax for Fast Decode and Deterministic Backward

    Sep 27, 2026Sriman AchantaBlock Sparse Flash AttentionAutoregressive Decoding

    Virginia Commonwealth University

  6. When Parallel Drafter Meets Parallel Speculative Decoding

    Sep 23, 2026Fuliang Liu, Xue Li, Kun Qian +4Speculative DecodingDrafter

    State Key Laboratory of Novel Software Technology, Nanjing University · Alibaba Group

  7. SPHQuant: Efficient extreme low bit weight quantization for Vision-Language Models

    Sep 21, 2026Kewei Zhang, Zheng Chen, Haotong Qin +1Matrix MultiplicationAutoregressive Decoding

    Shanghai Jiao Tong University · The Hong Kong Polytechnic University

  8. Look Less, Hear Better: Jointly Rewarded GRPO for Streaming ASR

    Sep 16, 2026Xiuwen ZhengAutomatic Speech RecognitionAutoregressive Decoding

    University of Illinois Urbana-Champaign

  9. Self-Orchestrating Language Models: Leveraging Semantic Dependence for Efficient Inference

    Sep 13, 2026Tian JinLLM Inference OptimizationAutoregressive Language Models

    Department of Electrical Engineering and Computer Science, MASSACHUSETTS INSTITUTE OF TECHNOLOGY

  10. Who Drives the Probability Game of VLMs? A Temporal Causal Drive Evaluation Framework

    Sep 2, 2026Shuyao Xiao, Shengling Wang, Haoyu Niu +4Multimodal GenerationAutoregressive Decoding

    College of Artificial Intelligence, Beijing Normal University · Kuaishou Technology

  11. Rethinking Language's Role in Efficient VLA for Autonomous Vehicles: Toward Smarter, Trustworthy Driving

    Aug 31, 2026Tongfei Guo, Lili SuAutonomous DrivingAutoregressive Language Models

    Department of Electrical and Computer Engineering, Northeastern University, Boston, MA, USA.

  12. BALANCE: Hybrid Autoregressive-Speculative LLM Inference in Wireless Edge Networks

    Aug 6, 2026Guanqiao Qu, Shuo Chen, Qian Chen +2LLM Inference OptimizationAutoregressive Decoding

    Department of Electrical and Computer Engineering, The University of Hong Kong, Hong Kong SAR, China · Electrical and Electronic Engineering Department, Imperial College, London SW7 2BT, U.K. · Electrical and Electronic Engineering, and Computing Departments, Imperial College, London SW7 2BT, U.K.

  13. Answer First, Reason Later: Commitment Order in Diffusion LLMs

    Aug 6, 2026Jewon Yeom, Jaewon Sok, Seonghyeon Park +3Diffusion Language ModelsLLM Reasoning Strategies

    Graduate School of Data Science, Seoul National University · Department of Rural Systems Engineering, Seoul National University · Department of Aerospace Engineering, Seoul National University

  14. From Chains to Trees: Parent-Conditioned Drafting for Semi-Autoregressive Speculative Decoding

    Aug 3, 2026Zixian Li, Tong Li, Chi Xie +2Speculative DecodingDrafts

    OPPO AI Center

  15. WAM-Diff2: Hierarchical AR-to-Diffusion Distillation for Highly Efficient Autonomous Driving VLA

    Aug 2, 2026Zhihao Zhu, Hanlin Shang, Mingwang Xu +6Autonomous DrivingDiffusion-Based Vision-Language-Actions

    Fudan University · Yinwang Inttelligent Technology Co.,Ltd

  16. ParaASR: Multi-Token Prediction for Fast and Long-Context LLM-Based Speech Recognition

    Jul 31, 2026Qingjian Lin, Yuxin Li, Haoyang Zhang +14Automatic Speech RecognitionMulti-Token Prediction

    StepFun · NTU · PKU +3

  17. Rethinking the Generation Order of Block Diffusion Language Models

    Jul 27, 2026Kai Syun Hou, James KwokDiffusion Language ModelsAutoregressive Decoding

    Department of Computer Science and Engineering The Hong Kong University of Science and Technology

  18. Unified Static-Dynamic Pruning for Efficient LLM Inference

    Jul 24, 2026Jinhyeok Kim, Yejoon Lee, Jaeyoung DoLLM Inference OptimizationDynamic Sparse Attention

    Seoul National University Seoul, South Korea

  19. Wavefront Parallelization for Efficient Learned Image Compression

    Jul 21, 2026Shimon Murai, Fangzheng Lin, Kasidis Arunruangsirilert +1Learned Image CompressionAutoregressive Image Generation

    School of Fundamental Science and Engineering Waseda University Tokyo, Japan · School of Engineering Institute of Science Tokyo Tokyo, Japan

  20. Lossless but Not Free: An Empirical Anatomy of Speculative Decoding on Consumer Hardware

    Jul 19, 2026Param ChordiyaSpeculative DecodingAutoregressive Decoding

    University of California, San Diego

  21. Adaptive Multi-Step Lookahead Decoding for Diffusion Language Models

    Jul 17, 2026Yingqian Cui, Wei Deng, Lantao Mei +4Diffusion Language ModelsMasked Diffusion Language Models

    Michigan State University · Morgan Stanley · IBM T.J. Watson Research Center

  22. T^2MLR: Transformer with Temporal Middle-Layer Recurrence

    Jul 16, 2026Ziyang Cai, Xingyu Zhu, Yihe Dong +2Transformer ArchitecturesRecurrent Model

    Princeton Language and Intelligence, Department of Computer Science Princeton University

  23. Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization

    Jul 9, 2026Jiantong Jiang, Peiyu Yang, Rui Zhang +1Kv-Cache ManagementLarge Language Model Serving

    School of Computing and Information Systems, The University of Melbourne · School of Computer Science and Technology, Huazhong University of Science and Technology (www.ruizhang.info)

  24. Compress the Cache, Not the Speech Embedding: KV Compression for Efficient Speech LLMs

    Jul 7, 2026Ke-Han Lu, Keqi Deng, Ruchao Fan +2Speech Language ModelsAutoregressive Decoding

    Microsoft, USA · National Taiwan University, Taiwan

  25. Trees from Marginals: Autoregressive drafting with factorized priors

    Jul 7, 2026Yuma Oda, Ryan Mathieu, Roman Knyazhitskiy +1Autoregressive DecodingDrafts

    Artur Chakhvadze1

  26. KVpop -- Key-Value Cache Compression with Predictive Online Pruning

    Jul 6, 2026Lukas Hauzenberger, Niklas Schmidinger, Anamaria-Roberta Hartl +5Key-Value Cache EvictionKey-Value Cache Compression

    1NXAI · 2Johannes Kepler University Linz, Austria

  27. Heaviside Continuity of Rolling Coefficients for Eliminating Epistemic Entropy in Large Language Models

    Jul 6, 2026MY Pitsane, Hope MogaleAutoregressive DecodingContinuum

    North-West University, RSA · Mankind Research Labs, Sandton · University of Pretoria, RSA

  28. Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning

    Jul 3, 2026Wenzheng Zeng, Siyi Jiao, Chen Gao +2Video CaptioningAutoregressive Video Generation

    National University of Singapore, Singapore

  29. Variable Bit-width Quantization: Learning Per-Group Precision for "Bigger-but-Smaller" Language Models

    Jul 3, 2026Hamish OgilvyLarge Language Model QuantizationAutoregressive Decoding

    Algolia Research

  30. Affix Cache for Diffusion Large Language Models

    Jun 26, 2026Kaihua Liang, An Zhong, Xin Tan +4CacheLLM Inference Optimization

    KAUST · CUHK · LUMS

  31. Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

    Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Multimodal ReasoningMultimodal Reasoning Benchmarks

    Sun Yat-sen University · Shenzhen Loop Area Institute · Harbin Institute of Technology (HIT) +3

  32. Scheduling Thoughts: Learning the Order of Thought in Diffusion Language Models

    Jun 22, 2026Jiawei Xu, Minghui Liu, Aakriti Agrawal +2Diffusion Language ModelsMasked Diffusion Language Models

    University of Maryland, College Park · University of California, Los Angeles.

  33. A Generalized Formalism of Auto-Regressive Decoding for Speech Processing

    Jun 16, 2026Julia Gachot, Philipp Allgeuer, Marie S. Bauer +1Autoregressive DecodingAutoregressive Model

    Knowledge Technology, Department of Informatics, University of Hamburg, Germany

  34. Non-Autoregressive Minimum Bayes' Risk Decoding for Fast Speech Recognition

    Jun 16, 2026Hiroyuki Deguchi, Takatomo Kano, Katsuki Chousa +1Autoregressive DecodingRisk

    NTT, Inc., Japan

  35. Positional Encoding in the Context of Memristor-Based Analog Computation for Automatic Speech Recognition

    Jun 11, 2026Benedikt Hilmes, Nick Rossenbach, Ralf SchlüterIn-Memory ComputingReram Crossbar

    Machine Learning and Human Language Technology Group, Faculty of Computer Science, RWTH Aachen University, Aachen, Germany

  36. ReSET: Accurate Latency-Critical NVFP4 Reasoning via Step-Aware Temperature Scaling

    Jun 11, 2026Sihwa Lee, Janghwan Lee, Donghoon Yoo +4Fp8Autoregressive Decoding

    Hanyang University, Seoul, Republic of Korea · Xenoscube Korean Inc., Seoul, Republic of Korea

  37. MemNovo: Look Back at the Spectrum for Balanced De Novo Peptide Sequencing from Mass Spectrometry

    Jun 10, 2026Dongxin Lyu, Jingbo Zhou, Hongxin Xiang +2Tandem Mass SpectraAutoregressive Decoding

    Westlake University Hangzhou, Zhejiang, China · Hunan University Changsha, Hunan, China · Shanghai Artificial Intelligence Laboratory Shanghai, China +1

  38. CLP: Collocation-Length Prediction for Zero-Loss Adaptive Multi-Token Inference

    Jun 9, 2026Xuezhen Xie, Zhiqiang ZhouMulti-Token PredictionLLM Inference Optimization

  39. TLDR: Compressing Audio Tokens for Efficient Autoregressive Text-to-Speech

    Jun 8, 2026Yejin Lee, Junwon Moon, Hyoeun Kim +3Autoregressive Text-To-SpeechAutoregressive Decoding

    Sungkyunkwan University · University of Seoul

  40. AsyncLane: Decoupling Refinement from Advancement in Diffusion Language Model Decoding

    Jun 7, 2026Yingxuan Ren, Yuxuan Lou, Yong Liu +4Diffusion Language ModelsAutoregressive Decoding

    1National University of Singapore · University of Southampton

  41. EditSR: Enhancing Neural Symbolic Regression via Edit-based Rectification

    Jun 6, 2026Da Li, Xinxin Li, Xingyu Cui +3Symbolic RegressionNeuro-Symbolic Framework

    Academy for Advanced Interdisciplinary Studies, Northeast Normal University, Changchun, 130024, Jilin, China · School of Mathematical Sciences, East China Normal University, Shanghai, 200241, Shanghai, China · Shanghai Zhangjiang Institute of Mathematics, Shanghai, 201203, Shanghai, China +3

  42. DRIFT: A Residual Flow Adapter for Decoding Continuous Outputs in Vision-Language Models

    Jun 4, 2026Zhuoming Liu, Jinhong Lin, Kwan Man Cheng +3Autoregressive Decoding

    University of Wisconsin–Madison · 2West Lafayette Jr./Sr. High School

  43. KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks

    Jun 2, 2026Lorenz K. Muller, Philippe Bich, Chiara Boretti +3Key-Value Cache QuantizationAutoregressive Decoding

    Huawei

  44. MURMUR: An Efficient Inference System for Long-Form ASR

    May 31, 2026Wei-Tzu Lee, Keisuke Kamahori, Baris KasikciAutomatic Speech RecognitionEfficient Long-Context Inference

    University of Washington

  45. Decoding Strategies for Diffusion-Based ASR: A Systematic Evaluation of Confidence-Based Thresholding

    May 28, 2026Jeong Hun Yeo, Minsu Kim, Hyeongseop Rha +1Automatic Speech RecognitionAutoregressive Decoding

    KAIST, Daejeon, Republic of Korea · Google DeepMind, Tokyo, Japan

  46. KVCapsule: Efficient Sequential KV Cache Compression for Vision-Language Models with Asymmetric Redundancy

    May 14, 2026Yingbing Huang, Tharun Adithya Srikrishnan, Steven K. Reinhardt +1Key-Value Cache CompressionToken Compression

    University of Illinois Urbana-Champaign · AMD

  47. Attention Drift: What Autoregressive Speculative Decoding Models Learn

    May 11, 2026Doğaç Eldenk, Payal Mohapatra, Yigitcan Comlek +3Speculative DecodingDrafter

    Northwestern University · GE Aerospace · fal +1

  48. APCD: Adaptive Path-Contrastive Decoding for Reliable Large Language Model Generation

    May 10, 2026Tianyu Zheng, Hong Wu, Jiaji ZhongContrastive DecodingLarge Language Model Decoding

    University of Electronic Science and Technology of China

  49. Non-Monotonic Latency in Apple MPS Decoding: KV Cache Interactions and Execution Regimes

    May 9, 2026Willy Fitra HendriaAutoregressive DecodingDecoding

    1Independent Researcher, Seoul, South Korea.

  50. MiniMind-O Technical Report: An Open Small-Scale Speech-Native Omni Model

    May 5, 2026Jingyao GongSmall ModelsTechnical Report

    Independent Researcher

  51. Stochastic Sparse Attention for Memory-Bound Inference

    May 3, 2026Kyle Lee, Corentin Delacour, Kevin Callahan-Coray +5Dynamic Sparse AttentionAutoregressive Decoding

    Department of Electrical and Computer Engineering, University of California, Santa Barbara, CA, USA · Department of Electrical and Computer Engineering, University of Michigan, Ann Arbor, MI, USA · Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, USA

  52. Making Every Verified Token Count: Adaptive Verification for MoE Speculative Decoding

    May 1, 2026Lehan Pan, Ziyang Tao, Ruoyu Pang +3Speculative DecodingAutoregressive Decoding

    University of Science and Technology of China · Tianyijiaotong Technology Ltd., Suzhou, China

  53. WhisperPipe: A Resource-Efficient Streaming Architecture for Real-Time Automatic Speech Recognition

    Apr 28, 2026Erfan Ramezani, Mohammad Mahdi Giahi, Mohammad Erfan Zarabadipour +2Whisper-Large-V3Automatic Speech Recognition

    Mechatronics Research Laboratory, Dept. of Computer and Electrical Engineering, Qazvin Islamic Azad University, Qazvin, Iran · Department of Electrical Engineering, Qa. C., Islamic Azad University, Qazvin, Iran.

  54. RACER: Retrieval-Augmented Contextual Rapid Speculative Decoding

    Apr 16, 2026Zihong Zhang, Zuchao Li, Lefei Zhang +2Speculative DecodingAutoregressive Decoding

    School of Artificial Intelligence, Wuhan University, Wuhan, China · School of Computer Science, Wuhan University, Wuhan, China · School of Information Management, Wuhan University, Wuhan, China +1

  55. Decoding Order Matters in Autoregressive Speech Synthesis

    Jan 13, 2026Minghui Zhao, Anton RagniAutoregressive Text-To-SpeechAutoregressive Decoding

    School of Computer Science, University of Sheffield, 211 Portobello, Sheffield S1 4DP, UK