Speculative Decoding

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

10 new papers

A weekly snapshot of new work published in Speculative Decoding.

Period ending 2026-09-14

12 new papers

A weekly snapshot of new work published in Speculative Decoding.

Period ending 2026-09-07

21 new papers

A weekly snapshot of new work published in Speculative Decoding.

Inside this field

Focused directions

231 papers

Latest in Speculative Decoding

Browse all topics →
CardsList

  1. Revisiting Lossy Verification in Speculative Decoding: Mechanisms, Trade-offs, and Failure Modes

    Jul 29, 2026Tianyu Wang, Yuxuan Zhou, Wenbin Wang +3Speculative DecodingLLM Inference Efficiency

  2. AngelSpec: Towards Real-World High Performance Inference with Speculative Decoding

    Jul 28, 2026Hong Liu, Rui Cen, Junhan Shi +10Speculative DecodingLLM Inference Efficiency

  3. Speculate While You Reason: Teaching Agents to Predict Their Next Tool Call via Joint Agent-Speculator RL

    Jul 28, 2026Jiabao Ji, Yujian Liu, Li An +4Large Language Model AgentsAgentic Reinforcement-Learning Framework

  4. Specula: Scaling formal specifications for autonomous model checking of system code

    Jul 28, 2026Qian Cheng, Saad Mohammad Rafid Pial, Ruize Tang +6Probabilistic Model CheckingAgentic Systems

  5. DraftExpert: Expansion-Aware Self-Speculative Decoding for End-Device MoE Inference

    Jul 27, 2026Dengke HanMixture-Of-Expert InferenceMixture-of-Experts Models

  6. Rethinking the Generation Order of Block Diffusion Language Models

    Jul 27, 2026Kai Syun Hou, James KwokDiffusion Language ModelsAutoregressive Decoding

  7. Unified Static-Dynamic Pruning for Efficient LLM Inference

    Jul 24, 2026Jinhyeok Kim, Yejoon Lee, Jaeyoung DoLLM Inference EfficiencyHeterogeneous Pruning Scores

  8. Adversarial Prompts for Acceptance Collapse in Speculative Decoding

    Jul 23, 2026Run Wang, Chaoyi Zhou, Xi Liu +7Speculative DecodingAd

  9. Windowed-MTP: Removing the Full-Context Draft-KV Tax at Million-Token Context

    Jul 23, 2026Alagappan ValliappanSpeculative DecodingPer-Token Latency

  10. Leaky Language Models: Stealing Architecture and Inference Optimizations via Per-Token Timing

    Jul 22, 2026Sadegh Majidi, Niloofar Mireshghallah, Kazem TaramLanguage Model Evasion AttacksLLM Inference Efficiency

  11. Speculative Correction: Draft-then-Refine Decoding for Diffusion Language Models

    Jul 21, 2026Brian K Chen, Chong Wu, Kenji KawaguchiDiffusion Language ModelsSpeculative Decoding

  12. AdaFlash: Adaptive Speculative Decoding via On-Policy Distilled Diffusion Drafters

    Jul 21, 2026Yu-Yang Qian, Hao-Cong Wu, Chen Chen +4Speculative DecodingDiffusion Language Models

  13. WAR: Workload-Aware Rollouts for Synchronous Agentic Reinforcement Learning

    Jul 19, 2026Ryan Xu, Atlas Zhao, David Bao +1Agentic Reinforcement-Learning FrameworkRollout

  14. Lossless but Not Free: An Empirical Anatomy of Speculative Decoding on Consumer Hardware

    Jul 19, 2026Param ChordiyaSpeculative DecodingAutoregressive Decoding

  15. SpecLA: Efficient Speculative Decoding for Linear-Attention Models

    Jul 18, 2026Zhibin Wang, Xuying Han, Zhaohua Yang +5Speculative DecodingQuadratic Attention

  16. Adaptive Multi-Step Lookahead Decoding for Diffusion Language Models

    Jul 17, 2026Yingqian Cui, Wei Deng, Lantao Mei +4Diffusion Language ModelsMasked Diffusion Language Models

  17. T^2MLR: Transformer with Temporal Middle-Layer Recurrence

    Jul 16, 2026Ziyang Cai, Xingyu Zhu, Yihe Dong +2Efficient Latent ReasoningTransformer Architectures

  18. D-cut: Adaptive Verification Depth Pruning for Batched Speculative Decoding

    Jul 16, 2026Tianyu Liu, Yuhao Shen, Rui Cen +7Speculative DecodingLLM Inference Efficiency

  19. Less Experts, Faster Decoding: Cost-Aware Speculative Decoding for Mixture-of-Experts

    Jul 14, 2026Jincheng Xie, Runheng Liu, Heyan Huang +4Speculative DecodingMixture-of-Experts Models

  20. Accepted Prefixes Are Not All You Need: A Negative Result on PEFT-Based Block-Diffusion Drafting

    Jul 14, 2026Abdurrahman Javat, Allan KazakovSpeculative DecodingLLM Inference Efficiency

  21. Speculate with Memory: Lossless Acceleration for LLM Agents

    Jul 14, 2026Yu Li, Qinyuan Ye, Prafulla Kumar Choubey +2Self-SpeculativeLarge Language Model Agents

  22. TIGER: Text-Conditioned Visual Gated Routing with Acceptance Alignment for Multimodal Speculative Decoding

    Jul 13, 2026Quynh Vo, Cong-Duy Nguyen, Ponhvoan Srey +2Speculative DecodingModality-Specific Encoders

  23. Unlocking Parallelism in Autoregressive Language Models via Speculative Decoding with Progressive Tree Drafting

    Jul 12, 2026Zipeng Gao, Zhi Zheng, Qingrong Xia +5Speculative DecodingAutoregressive Language Models

  24. A Symbolic Neural CPU for Quantization-Simulated Writeback and Interpretable Program Execution

    Jul 10, 2026Jose Luis Lima de Jesus SilvaNeuro-Symbolic FrameworkNeural Network Verification

  25. A Practical Investigation of Training-free Relaxed Speculative Decoding

    Jul 9, 2026Guoxuan Xia, Luka Ribar, Paul BalancaSpeculative DecodingNext-Token Prediction

  26. DominoTree: Conditional Tree-Structured Drafting with Domino for Speculative Decoding

    Jul 9, 2026Saw S. Lin, Jyh-Shing Roger JangSpeculative DecodingLLM Inference Efficiency

  27. Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization

    Jul 9, 2026Jiantong Jiang, Peiyu Yang, Rui Zhang +1Key-Value CacheLarge Language Model Serving

  28. DeLS-Spec: Decoupled Long-Short Contexts for Parallel Speculative Drafting

    Jul 8, 2026Hong-Kai Zheng, Piji LiSpeculative DecodingDrafter

  29. Compress the Cache, Not the Speech Embedding: KV Compression for Efficient Speech LLMs

    Jul 7, 2026Ke-Han Lu, Keqi Deng, Ruchao Fan +2Speech Large Language ModelsAutoregressive Decoding

  30. Trees from Marginals: Autoregressive drafting with factorized priors

    Jul 7, 2026Yuma Oda, Ryan Mathieu, Roman Knyazhitskiy +1Autoregressive DecodingAutoregressive Language Models

  31. Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding

    Jul 7, 2026Yonggan Fu, Lexington Whalen, Abhinav Garg +23Autoregressive Language ModelsSelf-Speculative

  32. DSpark: Confidence-Scheduled Speculative Decoding with Semi-Autoregressive Generation

    Jul 6, 2026Xin Cheng, Xingkai Yu, Chenze Shao +30Speculative DecodingSelf-Speculative

  33. KVpop -- Key-Value Cache Compression with Predictive Online Pruning

    Jul 6, 2026Lukas Hauzenberger, Niklas Schmidinger, Anamaria-Roberta Hartl +5Key-Value Cache EvictionKey-Value Cache Compression

  34. Heaviside Continuity of Rolling Coefficients for Eliminating Epistemic Entropy in Large Language Models

    Jul 6, 2026MY Pitsane, Hope MogaleAutoregressive Decoding

  35. Quantize the Target, Quantize the Drafter: Efficient Inference with Qwen3.5-4B

    Jul 5, 2026Jaeyeon Kim, Jewon Lee, Bo-Kyeong KimLLM Inference EfficiencyQwen3

  36. AdaptiveSD A Stability-Aware, Runtime-Adaptive Speculative Decoding Framework with Multi-Policy Orchestration for CPU-Constrained LLM Inference

    Jul 4, 2026Sadra SaremiSpeculative DecodingLLM Inference Efficiency

  37. SPORK: Self-Speculative Forking to Accelerate Agentic LLM Inference

    Jul 3, 2026Huajun Bai, Weiwei Lv, Huichuan Zheng +2Self-SpeculativeSpeculative Decoding

  38. Don't Wait to Reply: Towards Responsive yet Thoughtful Dialogue through Proactive Thinking

    Jul 3, 2026Ante Wang, Jiaqi Fu, Xuanyi Chen +4Conversational Artificial IntelligenceProactive

  39. Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning

    Jul 3, 2026Wenzheng Zeng, Siyi Jiao, Chen Gao +2Video CaptioningAutoregressive Video Generation

  40. Variable Bit-width Quantization: Learning Per-Group Precision for "Bigger-but-Smaller" Language Models

    Jul 3, 2026Hamish OgilvyLarge Language Model QuantizationQuantizer

  41. Spec-AUF: Accept-Until-Fail Training under Train-Inference Misalignment for Masked Block Drafters

    Jul 2, 2026Tianjian Yang, Meng LiDrafterSpeculative Decoding

  42. FinPersona-Bench: A Benchmark for Longitudinal Psychometric Stability of Autonomous Financial Agents

    Jun 30, 2026Muhammad Usman Safder, Ayesha Gull, Rania Elbadry +7Self-SpeculativeSaliency

  43. BlockPilot: Instance-Adaptive Policy Learning for Diffusion-based Speculative Decoding

    Jun 30, 2026Hao Zhang, Yiming Hu, Yong Wang +3Speculative DecodingPilot

  44. Reasoning-aware Speculative Decoding for Efficient Vision-Language-Action Models in Autonomous Driving

    Jun 30, 2026Anh Dung Dinh, Simon Khan, Flora SalimEfficient Vision-Language-Action ModelsAutonomous Driving

  45. Certified Speculative Execution for Untrusted AI Agents

    Jun 30, 2026Chenyu Zhou, Qiliang Jiang, Shuning Wu +1Trustworthy Artificial IntelligenceArtificial Intelligence Agents

  46. When Is a Draft Accepted? A Theory of Acceptance in Speculative Decoding

    Jun 29, 2026Aaryam SharmaSpeculative DecodingAcceptance

  47. Citation Discipline in Spec-Driven Development: A Cross-Model Empirical Study of Output Determinism and Automated Hallucination Detection in LLM-Generated Code

    Jun 28, 2026Subham PandaTraceabilityDeterministic

  48. Speculative Pre-Positioning: Decoding Stateful Sessions to the Next Decision Point Off the Critical Path

    Jun 28, 2026Victor NorgrenPrefillLLM Inference Efficiency

  49. CSD: Content-aware Speculative Decoding for Efficient Image Generation

    Jun 26, 2026Mingcheng Wang, Junbo Qiao, Yunchen Li +8Autoregressive Image GenerationSpeculative Decoding

  50. EntMTP: Accelerating LLM Inference with Entropy Guided Multi Token Prediction

    Jun 25, 2026Carrie ChenNext-Token PredictionLLM Inference Efficiency

  51. The Spec Growth Engine: Spec-Anchored, Code-Coupled, Drift-Enforced Architecture for AI-Assisted Software Development

    Jun 25, 2026Hartwig GrabowskiSoftware EngineeringAi-Ran

  52. HyperDFlash: Hyper-Connection-Aligned Block Speculative Decoding with Gated Residual Reduction

    Jun 25, 2026Luxi Lin, Shuang Peng, Rui Ma +7Speculative DecodingSelf-Speculative

  53. Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

    Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Multimodal ReasoningMultimodal Reasoning Benchmarks

  54. Speculative Decoding at Temperature Zero: A Scoped Safety-Invariance Screen with a 48,072-Sample Expansion

    Jun 23, 2026Sahil KadadekarSpeculative DecodingLarge Language Model Safety

  55. Dustin: Draft-Augmented Sparse Verification for Efficient Long-Context Generation with Speculative Decoding

    Jun 23, 2026WenHung Lee, Jian-Jia Chen, Xiaolin Lin +6Speculative DecodingEfficient Long-Context Inference

  56. Scheduling Thoughts: Learning the Order of Thought in Diffusion Language Models

    Jun 22, 2026Jiawei Xu, Minghui Liu, Aakriti Agrawal +2Diffusion Language ModelsMasked Diffusion Language Models

  57. RLM-Cascade: Response-Level Speculative Decoding for Cost-Efficient LLM API Serving

    Jun 22, 2026Haifeng Wu, Srinivasan Manoharan, Fangbo Tu +2Large Language Model CallsLarge Language Model Serving

  58. SSD: Spatially Speculative Decoding Accelerates Autoregressive Image Generation

    Jun 18, 2026Shilong Xiang, Zirui Zhang, Lijun Yu +1Autoregressive Image GenerationImage Generation

  59. SafeSpec: Fast and Safe LLM via Dynamic Reflective Sampling

    Jun 18, 2026Haotian Xu, Zeyang Zhang, Linbao Li +3Inference-Time DefenseSpeculative Decoding

  60. EfficientRollout: System-Aware Self-Speculative Decoding for RL Rollouts

    Jun 17, 2026Minseo Kim, Minjae Lee, Seunghyuk Oh +7Autoregressive RolloutRollout