Adaptive Inference

Follow this topic Ask about this topic

Momentum

7 papers in the last four weeks, up 133% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 63

All topics

AI Level of Detail: Distance-Aware ML Model Precision Selection for Real-Time Human Motion Prediction in Games
Jun 4, 2026Mathew VargheseAdaptive Inference
University of Washington Seattle, WA, USA
Resource-Constrained Adaptive Inference for Sequential Pricing
Jun 2, 2026Ruicheng Ao, Jiashuo Jiang, David Simchi-LeviAdaptive Inference Cost-Aware Inference
Institute for Data, Systems, and Society, Massachusetts Institute of Technology, Cambridge, MA 02139 · Department of Industrial Engineering and Decision Analytics, Hong Kong University of Science and Technology, Hong Kong · Department of Civil and Environmental Engineering and Operations Research Center, Massachusetts Institute of Technology, Cambridge, MA 02139
Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving
May 27, 2026Qitao Weng, Heechul YunEfficient Neural Network Inference Adaptive Inference
University of Kansas Lawrence, KS, USA
Online Irregular Multivariate Time Series Forecasting via Uncertainty-Driven Dual-Expert Calibration
May 27, 2026Haonan Wen, Hanyang Chen, Songhe FengIrregular Time-Series Modeling Multivariate Time Series Forecasting
Key Laboratory of Big Data & Artificial Intelligence in Transportation (Beijing Jiaotong University), Ministry of Education School of Computer Science and Technology, Beijing Jiaotong University Beijing, China · School of Computer Science and Technology, Beijing Jiaotong University Beijing, China · Tangshan Research Institute, Beijing Jiaotong University Tangshan, China
HRBench: Benchmarking and Understanding Thinking-Mode Switch Strategies in Hybrid-Reasoning LLMs
May 27, 2026Yansong Ning, Mianpeng Liu, Jingwen Ye +2LLM Evaluation Adaptive Inference
AI Thrust, The Hong Kong University of Science and Technology (Guangzhou) · AIPD, Tencent
Profiling-Driven Adaptive Distributed Transformer Inference on Embedded Edge Deployment
May 25, 2026Muhammad Azlan Qazi, Alexandros Iosifidis, Qi ZhangEfficient Transformer Inference Transformer Inference
Aarhus University · Aarhus, Denmark · Tampere University +1
Slimmable ConvNeXt: Width-Adaptive Inference for Efficient Multi-Device Deployment
May 21, 2026Janek Haberer, Jon Eike Wilhelm, Olaf LandsiedelEfficient Neural Network Inference Adaptive Inference
Kiel University, Germany · Hamburg University of Technology (TUHH), Germany · UNU-INWEH, Germany
Thinking in Scales: Accelerating Gigapixel Pathology Image Analysis via Adaptive Continuous Reasoning
May 19, 2026Jiusong Ge, Yingkang Zhan, Wenjie Zhao +13Computational Pathology Adaptive Inference
School of Computer Science and Technology, Xi’an Jiao-tong University, Xi’an, China · Department of Transmedia Art, Xi’an Academy of Fine Arts, Xi’an, China · Language Technology Lab, University of Cambridge, Cambridge, U.K. +3
SafeLens: Deliberate and Efficient Video Guardrails with Fast-and-Slow Screening
May 17, 2026Shahriar Kabir Nahin, Hadi Askari, Muhao Chen +1Adaptive Inference Efficient VLM Inference
University of South Florida · University of California, Davis
Adaptive Generate-Rank-Verify: Inference-Time Search with Costly Verification
May 17, 2026Shaddin Dughmi, Mahdi Haghifam, Yusuf Hakan KalayciAdaptive Inference Inference-Time Search
University of Southern California · Data Science Institute at the University of Chicago · Northwestern University +2
CADS: Conformal Adaptive Decision System for Cost-Efficient Image Classification
May 12, 2026Mikael Turkoglu, Tim Bary, Vincent Thielens +2Adaptive Inference Cost-Aware Inference
1ICTEAM, UCLouvain, Belgium · 2SAFiR Lab, Univ. of Sherbrooke, Canada · 3Univ. of Mons, Belgium
Trajectory-Aware Adaptive Inference in Object Detection Models
May 12, 2026Grigorios Papanikolaou, Ioannis Kontopoulos, Giannis Spiliopoulos +2Adaptive Inference Dynamic Neural Networks
Department of Electrical and Computer Engineering, National Technical University of Athens, Greece · Department of Product and Systems Design Engineering, University of the Aegean, Syros, Greece
Think as Needed: Geometry-Driven Adaptive Perception for Autonomous Driving
May 11, 2026Donghyun Kim, Jaehyoung ParkAdaptive Inference Lidar-Based 3D Object Detection
Stony Brook University
Active Multiple-Prediction-Powered Inference
May 8, 2026Nicholas Brawand, Nima Leclerc, Anhthy Ngo +4Adaptive Inference Cost-Aware Inference
The MITRE Corporation · Georgia Institute of Technology
Scene-Adaptive Continual Learning for CSI-based Human Activity Recognition with Mixture of Experts
May 7, 2026Wenhan Zheng, Yuyi Mao, Ivan Wang-Hei HoAdaptive Inference Human Activity Recognition
Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong · School of Computer Science and Engineering, The Macau University of Science and Technology, Macau
Balancing Stability and Plasticity in Sequentially Trained Early-Exiting Neural Networks
May 6, 2026Alaa Zniber, Ouassim Karrakchou, Mounir GhoghoAdaptive Inference Dynamic Neural Networks
⋆TICLab, International University of Rabat, Morocco · ‡ School of Electronic and Electrical Engineering, University of Leeds, UK
PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning
May 1, 2026Guandong Li, Mengxia YeAdaptive Inference Visual Spatial Reasoning
iFLYTEK · Aegon THTF
Hierarchical adaptive control for real-time dynamic inference at the edge
Apr 29, 2026Francesco Daghero, Mahyar Tourchi Moghaddam, Mikkel Baun KjærgaardAdaptive Inference Distribution Shift
MMMI Software Engineering University of Southern Denmark Odense, Denmark
An Algorithm for On-Sensor Agnostic Detection of Changes in Human Activity for Ultra-Low-Power Applications
Apr 24, 2026Sara Rimoldi, Arianna De Vecchi, Hazem Hesham Yousef Shalby +1Adaptive Inference Human Activity Recognition
Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Politecnico di Milano, Milan, Italy
VADF: Vision-Adaptive Diffusion Policy Framework for Efficient Robotic Manipulation
Apr 17, 2026Xinglei Yu, Zhenyang Liu, Shufeng Nan +2Adaptive Inference Diffusion Policy
Fudan University · Shanghai Innovation Institute
When Do Early-Exit Networks Generalize? A PAC-Bayesian Theory of Adaptive Depth
Apr 17, 2026Dongxin Guo, Jikun Wu, Siu Ming YiuNeural Network Generalization PAC-Bayesian Generalization Bounds
The University of Hong Kong, Hong Kong, China · Brain Investing Limited, Hong Kong, China
SecureRouter: Encrypted Routing for Efficient Secure Inference
Apr 16, 2026Yukuan Zhang, Mengxin Zheng, Qian LouEfficient Transformer Inference Secure Multi-Party Computation
University of Central Florida · Orlando, Florida, USA
CoDe-R: Refining Decompiler Output with LLMs via Rationale Guidance and Adaptive Inference
Apr 14, 2026Qiang Zhang, Zhongnian LiAdaptive Inference Software Reverse Engineering
School of Computer Science and Technology / School of Artificial Intelligence, China University of Mining and Technology, Xuzhou, China · Mine Digitization Engineering Research Center of the Ministry of Education, China University of Mining and Technology, Xuzhou, China
EcoFair: Energy-Efficient Inference Routing for Edge AI under Data Degradation
Mar 27, 2026Mostafa Anoosha, Dhavalkumar Thakker, Kuniko Paxton +4Adaptive Inference Energy-Efficient ML
School of Digital and Physical Science, University of Hull Kingston upon Hull, HU6 7RX, U.K.
Channel-Adaptive Edge AI: Maximizing Inference Throughput by Adapting Computational Complexity to Channel States
Mar 3, 2026Jierui Zhang, Jianhao Huang, Kaibin HuangAdaptive Inference Edge Inference
Department of Electrical and Computer Engineering, The University of Hong Kong, Hong Kong
TIDE: Temporal Incremental Draft Engine for Self-Improving LLM Inference
Feb 5, 2026Jiyoung Park, Hankyu Jang, Changseok Song +1Adaptive Inference LLM Inference Serving
Moreh, Inc.
Streaming-dLLM: Accelerating Diffusion LLMs via Suffix Pruning and Dynamic Decoding
Jan 25, 2026Zhongyu Xiao, Zhiwei Hao, Jianyuan Guo +4Adaptive Inference Blockwise Diffusion Language Models
School of information and Electronics, Beijing Institute of Technology, Beijing · Department of Computer Science, City University of Hong Kong, Hong Kong · School of Computer Science, Wuhan University, Wuhan +2
Decoding Order Matters in Autoregressive Speech Synthesis
Jan 13, 2026Minghui Zhao, Anton RagniAdaptive Inference TTS Synthesis
School of Computer Science, University of Sheffield, 211 Portobello, Sheffield S1 4DP, UK
When Models Know When They Do Not Know: Calibration, Cascading, and Cleaning
Jan 12, 2026Chenjie Hao, Weyl Lu, Yuko Ishiwaka +3Adaptive Inference Confidence Estimation in Language Models
University of California, Davis · SoftBank Corp. · Aizip
Blind Quality Enhancement of Compressed Video via Fine-Grained Degradation-Guided Sequential Inference
Nov 20, 2025Li Yu, Yingbo Zhao, Shiyu Wu +3Adaptive Inference Representation Learning
School of Computer Science, Nanjing University of Information Science & Technology, Nanjing, China, and also with Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), Nanjing University of Information Science & Technology, Nanjing, China · School of Computer Science, Nanjing University of Information Science & Technology, Nanjing, China · School of Software, Nanjing University of Information Science & Technology, Nanjing, China +3

Jun 4, 2026, cs.GRJ/K move · Enter open · S save

AI Level of Detail: Distance-Aware ML Model Precision Selection for Real-Time Human Motion Prediction in Games

Mathew Varghese

University of Washington Seattle, WA, USA

Adaptive Inference

Open paper AskPDF arXiv

Modern game engines spend significant compute animating NPCs with learned motion models. This paper proposes AI Level of Detail (AI LOD), a framework in which machine learning inference precision is adapted based on the distance between each NPC and the player camera. The core idea mirrors classical geometry LOD: substitute a cheaper approximation where the difference is imperceptible. Here, the approximation is a lower-precision quantized machine learning model rather than a lower-polygon mesh. The contribution of this work is the AI LOD concept itself: that inference-time quantization can serve as the LOD axis for AI-driven character animation - and more broadly, for any AI-based runtime system where perceptual sensitivity varies with context. The convolutional sequence-to-sequence model of Li et al. is used as a representative example to demonstrate the concept, with its trained checkpoint exported into three ONNX Runtime variants (FP32, FP16, and INT8 per-tensor), intended to be routed by a distance-based selector at runtime. Evaluation on the CMU Mocap dataset provides initial evidence that each precision tier can be served at its assigned distance range with negligible perceptible degradation, supporting the broader premise that distance-aware ML model precision selection is a viable LOD strategy for AI-based character animation.

Momentum

Related topics

Latest papers 63