Language Model Decoding

Follow this topic Ask about this topic

Momentum

18 papers in the last four weeks, up 200% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 108

All topics

Fast-dLLM++: Fréchet Profile Decoding for Faster Diffusion LLM Inference
Jun 1, 2026Siva Rajesh Kasa, Yasong Dai, Sumit Negi +1Language Model Decoding Parallel Decoding
Amazon Inc. · School of Computing, Australian National University.
Decoding in Order-Agnostic Language Models: Chain-Rule Deviation and Uniform Spreading
May 31, 2026Lin YaoLanguage Model Decoding Confidence Estimation in Language Models
School of Computer Science, Shanghai Jiao Tong University, Shanghai, 200240, China · Zhongguancun Academy, Beijing, 100097, China
Mitigating Hallucinations in Large Language Models Via Decoder Layer Skipping
May 30, 2026Hanze Li, Jinhao You, Yichen Guo +3Language Model Decoding LLM Hallucination Mitigation
De Artificial Intelligence Lab
Score $\times$ Decoder: A Unified View of Unsupervised Inference-Time Scaling for Hallucination Mitigation
May 30, 2026Yun-Chen Cheng, Che-Yu Lin, Cheng-Lin YangLanguage Model Decoding LLM Hallucination Mitigation
CyCraft AI Lab, Taiwan
Grounded Decoding: Retrieval-Anchored Probability Fusion for Faithful RAG
May 29, 2026Ibne Farabi Shihab, Fariya Afrin, Sanjeda Akter +1Retrieval-Augmented Generation Language Model Decoding
Department of Computer Science, Iowa State University · Department of Computer Science, Kalinga Institute of Industrial Technology · Department of Civil, Construction & Environmental Engineering, Iowa State University
MarginGate: Sparse Margin-Triggered Verification for Batch-Invariant LLM Inference
May 28, 2026Kexin Chu, Yang Zhou, Wei ZhangLLM Inference Efficiency Language Model Decoding
University of Connecticut · UC Davis
Projectional Decoding: Towards Semantic-Aware LLM Generation
May 28, 2026Boqi Chen, José Antonio Hernández López, Aren A. BabikianLanguage Model Decoding LLM-Based Program Synthesis
University of Ottawa · University of Murcia · University of Toronto
Decoding Strategies for Diffusion-Based ASR: A Systematic Evaluation of Confidence-Based Thresholding
May 28, 2026Jeong Hun Yeo, Minsu Kim, Hyeongseop Rha +1Language Model Decoding Automatic Speech Recognition
KAIST, Daejeon, Republic of Korea · Google DeepMind, Tokyo, Japan
The Confidence Shortcut: A Reasoning Failure Mode of Masked Diffusion Models
May 27, 2026Dueun Kim, Albert NoMasked Diffusion Models Language Model Decoding
Department of Artificial Intelligence, Yonsei University
When Confidence Misleads: Suffix Anchoring and Anchor-Proximity Confidence Modulation for Diffusion Language Models
May 27, 2026Jungwon Park, Jimyeong Kim, Jungmin Ko +2Non-Autoregressive Text Generation Language Model Decoding
1RICS · 2AIIS · 3IPAI +2
The Missing Piece in Pre-trained Model Evaluation: Reward-Guided Decoding Unlocks Task-Oriented Behavior Without Parameter Updates
May 27, 2026Shaobo Wang, Guo Chen, Ziyue Wang +5LLM Evaluation Language Model Decoding
Shanghai Jiao Tong University · Qwen Team, Alibaba Group · The Chinese University of Hong Kong, Shenzhen
SYNAPSE: Neuro-Symbolic Visual Thought-to-Text Decoding via Topological Semantic Denoising
May 27, 2026Akshaj Murhekar, Abhijit MishraLanguage Model Decoding EEG Decoding
School of Information University of Texas at Austin
Lost in Sampling: Assessing Lexical Reachability in LLMs via the Word Coverage Score (WCS)
May 26, 2026Samer Awad, Javier Conde, Carlos Arriaga +3LLM Evaluation Language Model Decoding
Information and Processing Telecommunications Center Universidad Politécnica de Madrid Madrid, Spain · Politecnico di Milano Milano, Italy · Banco de España Madrid, Spain
Visual-Redundancy-Controlled Parallel Decoding for Diffusion-Based Multimodal Large Language Models
May 25, 2026Yulin Yuan, Hongshuo Zhao, Xiangming MengLanguage Model Decoding Multimodal Large Language Models
Zhejiang University · ZJUI-UIUC Institute
Summoning the Oracle to Slay It: Mitigating Look-Ahead Bias in Financial Backtesting with Large Language Models
May 23, 2026Weixian Waylon Li, Mengyu Wang, Tiejun MaLanguage Model Decoding Quantitative Finance
University of Edinburgh
When Do LLMs Reason? A Dynamical Systems View via Entropy Phase Transitions
May 20, 2026Wei Xia, Haoqing Wang, Zhi-Hong Deng +1Language Model Decoding CoT Reasoning
Samsung Research, Beijing, China · State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University
Verifier-Guided Code Translation via Meta-Step Decoding
May 17, 2026Tianyang Zhou, Somesh Jha, Mihai Christodorescu +2Code Translation Constrained Decoding
University of Illinois Urbana-Champaign · University of Wisconsin–Madison and Google · Google
Selective Safety Steering via Value-Filtered Decoding
May 14, 2026Bat-Sheva Einbinder, Hen Davidov, Yee Whye Teh +2Language Model Decoding Language Model Steering
Department of Electrical and Computer Engineering, Technion IIT, Israel · Department of Statistics, University of Oxford, Oxford, UK · OATML, Department of Computer Science, University of Oxford, Oxford, UK +1
Sampling from Flow Language Models via Marginal-Conditioned Bridges
May 13, 2026Iskander Azangulov, Leo ZhangFlow Matching Language Model Decoding
Department of Statistics, University of Oxford
Orthrus: Memory-Efficient Parallel Token Generation via Dual-View Diffusion
May 12, 2026Chien Van Nguyen, Chaitra Hegde, Van Cuong Pham +3Language Model Decoding Diffusion Language Model Inference
University of Oregon · Google DeepMind · Adobe Research
Mitigating Context-Memory Conflicts in LLMs through Dynamic Cognitive Reconciliation Decoding
May 12, 2026Yigeng Zhou, Wu Li, Yifan Lu +6Language Model Decoding Knowledge Conflicts in Language Models
Harbin Institute of Technology, Shenzhen, 518055, China · Beijing Academy of Artificial Intelligence, China · Nanyang Technological University, Singapore
The Illusion of Power Capping in LLM Decode: A Phase-Aware Energy Characterisation Across Attention Architectures
May 12, 2026Bole Ma, Ayesha Afzal, Jan Eitzinger +1LLM Inference Efficiency Language Model Decoding
Erlangen National High Performance Computing Center, Erlangen, Germany · Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
Sampling More, Getting Less: Calibration is the Diversity Bottleneck in LLMs
May 11, 2026Amin Banayeeanzade, Qingchuan Yang, Dhruv Tarsadiya +6LLM Evaluation Language Model Decoding
♠University of Southern California · ♣Capital One
Task-Aware Calibration: Provably Optimal Decoding in LLMs
May 11, 2026Tim Tomov, Dominik Fuchsgruber, Rajeev Verma +1Language Model Decoding MBR Decoding
School of Computation, Information & Technology, Technical University of Munich · Munich Data Science Institute · Munich Center for Machine Learning +1
Entropy-informed Decoding: Adaptive Information-Driven Branching
May 10, 2026Benjamin Patrick Evans, Sumitra Ganesh, Leo ArdonLanguage Model Decoding LLM Inference Acceleration
JP Morgan AI Research, London, UK · JP Morgan AI Research, New York, USA
APCD: Adaptive Path-Contrastive Decoding for Reliable Large Language Model Generation
May 10, 2026Tianyu Zheng, Hong Wu, Jiaji ZhongLanguage Model Decoding LLM Reliability
University of Electronic Science and Technology of China
A Communication-Theoretic Framework for LLM Agents: Cost-Aware Adaptive Reliability
May 9, 2026Hamed Omidvar, Vahideh AkhlaghiLLM Inference Efficiency AI Agent Reliability
INTELLERCE LLC San Jose, CA, USA
The Model Knows, the Decoder Finds: Future Value Guided Particle Power Sampling
May 4, 2026Tu Nguyen, Matthieu Zimmer, Rasul Tutunov +2Language Model Decoding LLM Inference Acceleration
1Huawei Heisenberg Research Center · 2Huawei Noah’s Ark Lab · 3UCL Centre for Artificial Intelligence
Decoding-Time Debiasing via Process Reward Models: From Controlled Fill-in to Open-Ended Generation
May 4, 2026Muneeb Ur Raheem KhanDebiased ML Language Model Decoding
Lahore University of Management Sciences (LUMS)
Large Language Models Explore by Latent Distilling
Apr 27, 2026Yuanhao Zeng, Ao Lu, Lufei Li +3Language Model Decoding Test-Time Training
School of Information Science and Technology, ShanghaiTech University, Shanghai, China · State Key Laboratory of General Artificial Intelligence, BIGAI, Beijing, China.

Jun 1, 2026, cs.CLJ/K move · Enter open · S save

Fast-dLLM++: Fréchet Profile Decoding for Faster Diffusion LLM Inference

Siva Rajesh Kasa, Yasong Dai, Sumit Negi, Hongdong Li

Amazon Inc. · School of Computing, Australian National University.

Language Model Decoding Parallel Decoding Diffusion Language Model Decoding Diffusion Language Models Diffusion Model Inference Acceleration

Open paper AskPDF arXiv

Diffusion large language models promise parallel token generation, yet inference remains bottlenecked by deciding which masked tokens can be safely committed together. Fast-dLLM addressed this with KV caching and confidence-guided parallel decoding, but its decoding theory uses a homogeneous high-confidence assumption that effectively reduces each candidate set to its weakest selected token. We argue that this leaves speed on the table because real decoding steps exhibit heterogeneous confidence profiles. We propose \textbf{Fast-dLLM++}, a training-free extension that introduces \emph{Fréchet profile decoding}: selecting parallel commit sets from the full sorted confidence profile rather than a single worst-case confidence. The resulting rule is a heterogeneous-confidence generalization of Fast-dLLM's factor selector and it recovers the previous rule exactly in the equal-confidence case and adds a provable \emph{heterogeneity bonus} when the selected tokens have uneven confidences. Fast-dLLM++ leaves the model, diffusion process, and cache implementation entirely unchanged, making it a drop-in replacement for existing Fast-dLLM decoding. Experiments on GSM8K, MATH, HumanEval, and MBPP with the LLaDA-8B model show that the theoretical improvement translates directly into empirical gains: profile-aware selection improves the accuracy--throughput frontier by exploiting safe parallelism that weakest-token rules miss, achieving up to 37% higher throughput at comparable accuracy. Our code release is at https://github.com/Ringo-Star/FastdLLM_plusplus.

Momentum

Related topics

Latest papers 108