Adaptive Inference

Ask about this topic

Overview

Adaptive inference studies how to change the amount or form of computation according to each input, the system’s current resources, or the data collected so far. Common approaches include early-exit networks, confidence-based cascades and model routing, dynamic depth or resolution, and adaptive reasoning or sampling under a compute budget. In statistics, related work develops calibration, conformal prediction, and asymptotic guarantees for estimates produced by adaptive experiments such as contextual bandits. The central tension is whether signals like confidence or difficulty reliably identify when extra computation helps, especially under distribution shift and when efficiency gains must not compromise accuracy, coverage, or safety.

Latest papers

CardsList

95 papers10 papers in the last four weeks, level with the four weeks before. 0.1% of all new papers.

  1. Thermal-Headroom Routing for Efficient Robot Perception in Extreme Heat

    Oct 26, 2026Sparsh Roy, Kevin Zhou, Arhaan Shah +4Power-Efficient InferenceAdaptive Inference

    Massachusetts Institute of Technology, Cambridge, MA, USA · Hopewell Valley Central High School, Pennington, NJ, USA · Paradise Valley High School, Phoenix, AZ, USA

  2. TrustAgent-RFF: Agentic Diagnostic Planning for Reliable RF Fingerprinting under Domain Shift

    Oct 18, 2026Chuan Liu, Tianya Zhao, Yiting Wang +2RF Fingerprint IdentificationDistribution Shift Robustness

    Knight Foundation School of Computing and Information Sciences, Florida International University, Miami, FL 33199, USA · School of Computer Science and Informatics, University of Liverpool, Liverpool, United Kingdom

  3. Efficient CPU-GPU collaborative MoE inference via Adaptive Expert Assignment

    Oct 16, 2026Wenhui Lv, Yunming Liao, Hongli Xu +2Mixture-of-Experts InferenceLLM Inference Acceleration

  4. DIAL: Dynamic and Informed Adjustment of the Native Stochastic Law for Reliable Weather Ensembles

    Oct 15, 2026Yucheng Wang, Haonan Guo, Tianhao Zhao +4Weather ForecastingProbabilistic Forecasting

    Wuhan University · Zhongguancun Academy

  5. DPA-MoE: A Runtime Precision Control Framework for MoE Inference

    Oct 15, 2026Jaeyun Kim, Hoonki Lee, Susie Shin +3Mixture-of-Experts InferenceAdaptive Inference

    Agency for Defense Development · Yonsei University

  6. Selection-Safe Conformal Early Exit: Distribution-Free Coverage under Adaptive Depth

    Oct 14, 2026Adria Binte Habib, Ibne Farabi ShihabConformal PredictionAdaptive Inference

    Department of Computer Science, BRAC University · Department of Computer Science, Iowa State University

  7. Exploring Jailbreak Vulnerability Across Depth-Based Dynamic Inference in Large Language Models

    Oct 10, 2026Lass Najmuldeen, Seyedhamidreza MousaviAdversarial Robustness of Language ModelsLLM Jailbreak Attacks

    School of Innovation, Design and Engineering, Mälardalen University, Västerås, Sweden

  8. Sampling Allocation of LinUCB: Optimal Design Limits in the Small-Gap Regime

    Oct 5, 2026Yujie Liu, Vincent Y. F. Tan, Yunbei XuAdaptive InferenceContextual Bandits

    National University of Singapore

  9. Adaptive Self-Consistency: From Black-Box Sampling to Distribution-Valued Feedback

    Sep 30, 2026Jingkai Huang, Yunfan Zhang, Will Ma +2LLM Inference EfficiencyAdaptive Inference

    Stern School of Business New York University · School of Management Zhejiang University

  10. Not Every Correction Helps: Gain-Guided Continual Test-Time Adaptation

    Sep 29, 2026Youjia Zhang, Huiling Liu, Soyun Choi +2Adaptive InferenceTest-Time Adaptation

    Sungkyunkwan University · Nanyang Technological University

  11. Scheduling Recursive Reasoning in Looped Transformers

    Sep 29, 2026Boyuan Wang, Chengyao Yu, Jiaxi Ren +3Adaptive InferenceRecurrent Transformers

    Southern University of Science and Technology · The Chinese University of Hong Kong, Shenzhen · Shenzhen Loop Area Institute

  12. AnyStep-WAM: Budget-Aligned Distillation and Adaptive Inference for World Action Models

    Sep 27, 2026Rui Wang, Xiangyu Wang, Donglin Yang +4Adaptive InferenceDiffusion Model Distillation

    Southern University of Science and Technology · Shenzhen Loop Area Institute · The University of Hong Kong

  13. SenseAgent: An LLM Agent for Adaptive Cross-Domain IMU Sensing

    Sep 25, 2026Tianya Zhao, Chuan Liu, Xuyu WangAdaptive SensingWearable Sensing

    Florida International University Miami, Florida, USA

  14. SlackDrive: Reclaiming Runtime Slack for Adaptive Driving Inference

    Sep 23, 2026Xiaohuan Pei, Hengguang Zhou, Yuanhao Ban +7Inference-Time Compute AllocationAdaptive Inference

    The University of Sydney · University of California, Los Angeles · Shanghai Jiao Tong University +2

  15. LearnActCoder: Role-Aware Error Memory for Adaptive Clinical Coding Agents

    Sep 17, 2026Meysam Ghaffari, Bhaskar Sen, Nasim Sabetpour +3Adaptive InferenceAutomated Medical Coding

    Optum AI · Harvard University

  16. Route, Don't Fix: Regime-Dependent Decoding Correction and a Trajectory-Gated Router for Reliable Clinical LLM Answer Selection

    Sep 13, 2026Zeyu Dong, Benjamin Wang, Joyee W. JinAdaptive InferenceLanguage Model Decoding

    St. Theresa of Lisieux Catholic High School Toronto, Canada · Department of Computer Science University of Toronto Toronto, Canada

  17. Not All Speech Is Intent: Adaptive Self-Correcting Inference Layer for Post-ASR False Wake-Up

    Sep 11, 2026Preeti Saraswat, Divya Neelagiri, Anil YadavAdaptive InferenceOnline Learning

    Samsung Research America, Mountain View, CA, USA

  18. Settling: Equilibrium Inference for Non-Convex Validity Sets

    Sep 9, 2026Lyes Saad SaoudAdaptive Inference

    Independent Researcher, Chicago, IL, USA.

  19. Adaptive Gated Deepfake Detection for Low-Resolution and Resource-Constrained Environments

    Sep 4, 2026Vaishnavi Sen, Cody Laurie, Rashida HasanDeepfake DetectionAdaptive Inference

    Department of Computer Science California State University, Northridge California, USA

  20. Choosing the Right Language Mode at Inference Time for Multilingual Reliability

    Sep 4, 2026Ekata Mitra, Ameeta AgrawalCross-Lingual Reasoning in Language ModelsLLM Reliability

    PortNLP, Portland State University, USA

  21. StreamScout: Learning When to Look Deeper for Streaming Video Understanding

    Aug 31, 2026Ce Zhang, Jing Bi, Jinxi He +9Adaptive InferenceStreaming Video Understanding

    Carnegie Mellon University · TikTok · University of Rochester +2

  22. AutoCRAT: Within-trajectory Joint Control of Stochasticity and Compute for LLM Reasoning

    Aug 30, 2026Hanjun Luo, Qiushi Liu, Jingya Zhang +8Adaptive InferenceLLM Inference Acceleration

    New York University · New York University Abu Dhabi · University of Washington Seattle +4

  23. AERA: Adaptive Evidence Residual Allocation for Efficient Test-Time Reasoning

    Aug 28, 2026Ziming Wang, Ivor Tsang, Hangwei QianAdaptive InferenceEfficient Language Model Reasoning

    National University of Singapore, Singapore · Agency for Science, Technology and Research (A*STAR), Centre for Frontier AI Research (CFAR), Singapore · Nanyang Technological University, Singapore

  24. ROI-Gated SAHI: Content-Adaptive Slicing-Based Inference for Efficient Object Detection

    Aug 25, 2026Rashid Riyadh, Abd Ullah Khan, Imad Gohar +1Object DetectionEfficient Inference

    Faculty of Information Technology, City University, Malaysia · Department of Information Convergence Engineering, Kyung Hee University, South Korea · Department of Computer Science, National University of Sciences and Technology, Pakistan +3

  25. Structure, Association, and Decision Value: Representation-Based Difficulty Estimation for Adaptive Inference in African-Language NLI

    Aug 19, 2026Toheeb OgunadeAdaptive InferenceAfrican Language Processing

    University of Lagos

  26. MM-BEV: Enhancing Timeliness by Computing Where and When it Matters

    Aug 15, 2026Liangkai Liu, Kang G. ShinAutonomous Driving PerceptionAdaptive Inference

    Department of Computer Science, Texas Tech University, USA · Department of Computer Science and Engineering, University of Michigan, USA

  27. SCOPE: Score-Isolated Agentic Optimization for Video World Models

    Aug 15, 2026Yuhua Jiang, Jiaming Wang, Qingbin Liu +1Adaptive InferenceVideo World Models

    Tsinghua University · National University of Singapore · Tencent

  28. Neural Introspection Gating for Adaptive KV-Cache Reuse in Vision-Language-Action Models

    Aug 11, 2026Zhijie Wu, Kento Kawaharazuka, Kei OkadaAdaptive InferenceKV Caching

    Graduate School of Information Science and Technology, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656, Japan

  29. Interoceptive Attention as Dynamic Homeostatic Prioritization in a Foraging Agent

    Aug 4, 2026St John Grimbly, Nicolas Kuske, Evert A. Boonstra +7Adaptive InferenceActive Inference

    Dept. of Mathematics & Applied Mathematics, Univ. of Cape Town, South Africa · Neuroscience Institute, Univ. of Cape Town, South Africa · MIND Institute and CSAM, University of the Witwatersrand, South Africa +3

  30. TrimMoE A communication aware and adaptive depth framework for distributed edge inference

    Aug 1, 2026Ning Li, Shuting Bai, Xin Yuan +3Adaptive InferenceEdge Inference

    School of Artificial Intelligence, University of Science and Technology Beijing, China · School of Computer Science and Technology, Harbin Institute of Technology, Heilongjiang, China · School of Ocean Engineering, Harbin Institute of Technology, Heilongjiang, China +2