Real-Time Inference

Follow this topic Ask about this topic

Recent momentum

-25%

12 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

7 new papers

A weekly snapshot of new work published in Real-Time Inference.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Real-Time Inference.

Period ending 2026-09-07

4 new papers

A weekly snapshot of new work published in Real-Time Inference.

149 papers

Latest in Real-Time Inference

Browse all topics →

Efficient Network Inference via Hardware-Aware Architecture Search, Model Pruning & Quantization
Jun 22, 2026Lucas Heublein, Mark Deutel, Axel Plinge +1Graph Neural Network Inference Real-Time Inference
StreamPPG: Low-Latency rPPG Estimation via Consistent Privileged Learning
Jun 22, 2026Yiming Li, Yihan Yang, Yuguang Chu +6Remote Photoplethysmography Real-Time Inference
Start Right, Arrive Right: Asynchronous Execution via Initial Noise Selection
Jun 18, 2026Trong-Bao Ho, Quang-Tan Nguyen, Thien-Loc Ha +7Action Chunks Asynchronous Execution
FrequencyFormer: A Co-Designed Sensor-to-Processor Pipeline for Frequency-Domain Vision Transformer Inference
Jun 17, 2026Chengwei Zhou, Ovishake Sen, Xuming Chen +5Self-Supervised Vision Transformers Vision Transformer
ConTex: Reformulating Counterfactual Generation For Time Series Forecasting
Jun 16, 2026Jan Voets, Hasan Tercan, Tobias Meisen +1Counterfactual Reasoning Time Series
Beyond Benchmarks: Continuous Edge Inference for Fine-Grained Roadside Perception
Jun 15, 2026Aditya Mishra, Haroon LoneNvidia Jetson Orin Nano Autonomous Driving Perception
Embedded Arena: Iterative Optimization via Hardware Feedback
Jun 15, 2026Zhihan Zhang, Alexander Le Metzger, Jiuyang Lyu +10Real-Time Inference Human-In-The-Loop
DYNA-PRUNER: Input-Adaptive Data-Model Co-Pruning for Efficient and Scalable Spatio-Temporal Media Prediction
Jun 13, 2026Fuyan Zhang, Yuqi Li, Qing Xu +2Spatiotemporal Prediction Heterogeneous Pruning Scores
HumP-KD: A Hybrid Uncertainty-Aware Multi-Stage Progressive Knowledge Distillation Framework for Efficient Fire Classification
Jun 12, 2026Mohammed Arif Mainuddin, Najifa Tabassum, Omar Ibne Shahid +1Knowledge Distillation Real-Time Inference
Real-Time Execution with Autoregressive Policies
Jun 11, 2026Sangkyu Lee, Seohyeon Park, Tackgeun You +4Real-Time Inference Real-Time Systems
Battery detection of XRay images using transfer learning
Jun 10, 2026Nermeen Abou Baker, David Rohrschneider, Uwe HandmannYolo26 Lithium-Ion Batteries
Lip Forcing: Few-Step Autoregressive Diffusion for Real-time Lip Synchronization
Jun 9, 2026Paul Hyunbin Cho, Jinhyuk Jang, SeokYoung Lee +7Pre-Trained Video Diffusion Models Object Articulation
Bridged SBI: Correcting Biased Low-Fidelity Posteriors for Cost-Efficient High-Fidelity Inference
Jun 8, 2026Gahee Kim, Yuki Kadokawa, Sandro M. Alcantara Tacora +5Posterior Bayesian
vla.cpp: A Unified Inference Runtime for Vision-Language-Action Models
Jun 6, 2026Khanh D. Nguyen, Hung T. Ho, Chinh T. Nguyen +5Real-Time Inference Executable Robot Behavior
Think Like a Pilot: Fine-Grained Long-Horizon UAV Navigation
Jun 5, 2026Xiangyi Zheng, Xiangyu Wang, Qinan Liao +6Aerial Vision-Language Navigation Pilot
GenAutoML: An Agentic Framework for Dynamic Architecture Generation and Optimization in Time-Series Analysis
Jun 4, 2026Oleeviya Babu Poikarayil, Cédric Schockaert, Abdulrahman Nahhas +3Neural Architecture Search Real-Time Inference
Multilingual Detection of Alzheimer's Disease from Speech: A Cross-Linguistic Transfer Learning Approach
Jun 4, 2026Nadine Yasser Abdelhalim, Emmanuel Akinrintoyo, Nicole SalomonsMultilingual Language Models Cross-Lingual Transfer
Audio Interaction Model
Jun 3, 2026Zhifei Xie, Zihang Liu, Ze An +8Audio Representation Audio
Reconstructing Unobservable Temperature Fields via Simulation-Aided Intelligent Sensing
Jun 3, 2026Monika Stipsitz, Hèlios Sanchis-Alepuz, Jacob Reynvaan +1Thermal Imaging Neural Fields
OctoT2I: A Self-Evolving Agentic Text-to-Image Router
Jun 1, 2026Xu Jiang, Bin Chen, Gehui Li +3Text-To-Image Real-Time Inference
Training-Free Imitation Learning with Closed-Form Diffusion Policies
May 31, 2026Raghav Mishra, Ian R. ManchesterDiffusion Policies Imitation Learning
VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policies
May 28, 2026Mingjian Gao, Wenqiao Zhang, Yuqian Yuan +9Flow-Matching Vision-Language-Action Vision-Language-Action Models
PrunePath: Towards Highly Structured Sparse Language Models
May 27, 2026Zhexuan Gu, Zixun Fu, Yancheng YuanPruning Sparsity
MobileExplorer: Accelerating On-Device Inference for Mobile GUI Agents via Online Exploration
May 26, 2026Runxi Huang, Liyu Zhang, Shengzhong Liu +1Graphical User Interface Agents Device
StreamSplit: Continuous Audio Representation Learning via Uncertainty-Guided Adaptive Splitting
May 26, 2026Minh K. Quan, Pubudu N. PathiranaAudio Latent Real-Time Inference
RED: Adaptive Real-Time DAG Scheduling for Robotic Inference under Environmental Dynamics
May 21, 2026Zexin Li, Tao Ren, Johnathan Liu +2Multi-Robot Systems Nvidia Jetson Orin Nano
MambaGaze: Bidirectional Mamba with Explicit Missing Data Modeling for Cognitive Load Assessment from Eye-Gaze Tracking Data
May 21, 2026Amir Mousavi, Mohammad Sadegh Sirjani, Erfan Nourbakhsh +5Eye Tracking Cognitive Load
Hierarchical Variational Policies for Reward-Guided Diffusion
May 20, 2026Kushagra Pandey, Farrin Marouf Sofian, Jan Niklas Groeneveld +2Diffusion Sampling Reward-Guided Diffusion
DEFLECT: Temporal Counterfactual Preference Learning for Delay-Robust Asynchronous VLAs
May 19, 2026Yixiang Zhu, Yonghao Chen, Zijie Yang +2Asynchronous Execution Counterfactual Rollouts
Latent Action Reparameterization for Efficient Agent Inference
May 18, 2026Wenhao Huang, Qingwen Zeng, Qiyue Chen +11Latent Actions LLM Inference Efficiency
SafeLens: Deliberate and Efficient Video Guardrails with Fast-and-Slow Screening
May 17, 2026Shahriar Kabir Nahin, Hadi Askari, Muhao Chen +1Streaming Guardrails Inference-Time Defense
ElasticDiT: Efficient Diffusion Transformers via Elastic Architecture and Sparse Attention for High-Resolution Image Generation on Mobile Devices
May 15, 2026Kunpeng Du, Haizhen Xie, Sen Lu +11Multimodal Diffusion Transformers Mobilenetv2
Uncertainty Quantification for Large Language Diffusion Models
May 14, 2026Artem Vazhentsev, Vladislav Smirnov, David Li +3Large Language Model Uncertainty Diffusion Language Models
Attention Once Is All You Need: Efficient Streaming Inference with Stateful Transformers
May 13, 2026Victor NorgrenLLM Inference Efficiency Real-Time Inference
INAR-VL: Input-Aware Routing for Edge-Cloud Vision-Language Inference
May 13, 2026Ahmed Šabanović, Paul Joe Maliakel, Ivona BrandićReal-Time Inference Large Vision Language Models
Trajectory-Aware Adaptive Inference in Object Detection Models
May 12, 2026Grigorios Papanikolaou, Ioannis Kontopoulos, Giannis Spiliopoulos +2Object Detection Open-Vocabulary Object Detection
STARS: Spike Tail-Aware Relational Synthesis for ANN-to-SNN Data-Free Knowledge Distillation
May 12, 2026Shuhan Ye, Yi Yu, Qixin Zhang +5Spiking Neural Networks Knowledge Distillation
Self-Distilled Trajectory-Aware Boltzmann Modeling: Bridging the Training-Inference Discrepancy in Diffusion Language Models
May 12, 2026Kecheng Chen, Ziru Liu, Xijia Tao +9Diffusion Language Models Autoregressive Language Models
OOM-Free Alpamayo via CPU-GPU Memory Swapping for Vision-Language-Action Models
May 12, 2026Seungwoo Roh, Huiyeong Kim, Jong-Chan KimGraphics Processing Unit Memory Real-Time Inference
MicroViTv2: Beyond the FLOPS for Edge Energy-Friendly Vision Transformers
May 11, 2026Novendra Setyawan, Chi-Chia Sun, Mao-Hsiu Hsu +2Self-Supervised Vision Transformers Vision Transformer
ORICF -- Open Robotics Inference and Control Framework
May 10, 2026Andrés Meseguer Valenzuela, Luís Miguel Bartolín ArnauReal-Time Inference Offloading
PoHAR: Understanding Hyperlocal Human Activities with Pollution Sensor Networks
May 10, 2026Prasenjit Karmakar, Karthik Reddy, Sandip ChakrabortyHuman Activity Recognition Air Pollution
Large Language Models over Networks: Collaborative Intelligence under Resource Constraints
May 9, 2026Liangqi Yuan, Wenzhi Fang, Shiqiang Wang +2Artificial Intelligence Infrastructure Collaboration
XiYOLO: Energy-Aware Object Detection via Iterative Architecture Search and Scaling
May 7, 2026Tony Tran, Richie R. Suganda, Bin HuYolo26 Heterogeneous Edge Devices
CARMEN: CORDIC-Accelerated Resource-Efficient Multi-Precision Inference Engine for Deep Learning
May 7, 2026Sonu Kumar, Mukul Lokhande, Santosh Kumar Vishvakarma +1Sparse Deep Neural Network Accelerators Real-Time Inference
ExecuTorch -- A Unified PyTorch Solution to Run AI Models On-Device
May 5, 2026Mergen Nachin, Digant Desai, Sicheng Stephen Jia +36Pytorch Heterogeneous Edge Devices
Understanding Asynchronous Inference Methods for Vision-Language-Action Models
May 4, 2026Ayoub AgouzoulVision-Language-Action Models Real-Time Inference
Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models
May 4, 2026Srinivas Soumitri Miriyala, Sowmya Vajrala, Sravanth Kodavanti +2Image Restoration Hybrid Transformer
EdgeLPR: On the Deep Neural Network trade-off between Precision and Performance in LiDAR Place Recognition
May 4, 2026Pierpaolo Serio, Hetian Wang, Zixiang Wei +4Visual Place Recognition Heterogeneous Edge Devices
MSACT: Multistage Spatial Alignment for Stable Low-Latency Fine Manipulation
May 1, 2026Xianbo Cai, Hideyuki Ichiwara, Masaki Yoshikawa +1Real-World Manipulation Tasks Manipulation
GD4: Graph-based Discrete Denoising Diffusion for MIMO Detection
May 1, 2026Qincheng Lu, Sitao Luan, Xiao-Wen ChangMultiple-Input Multiple-Output Detection Framework
Generalizable Sparse-View 3D Reconstruction from Unconstrained Images
Apr 30, 2026Vinayak Gupta, Chih-Hao Lin, Shenlong Wang +23D Reconstruction Surface Reconstruction
LLM-Guided Runtime Parameter Optimization for Energy-Efficient Model Inference
Apr 29, 2026Katelyn Crumpacker, Dimitrios NikolopoulosLLM Inference Efficiency Real-Time Inference
Density Field State Space Models: 1-Bit Distillation, Efficient Inference, and Knowledge Organization in Mamba-2
Apr 28, 2026Chirag ShindeBidirectional Mamba Efficient Inference
WhisperPipe: A Resource-Efficient Streaming Architecture for Real-Time Automatic Speech Recognition
Apr 28, 2026Erfan Ramezani, Mohammad Mahdi Giahi, Mohammad Erfan Zarabadipour +2Automatic Speech Recognition Systems Speech Large Language Models
DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executors
Apr 27, 2026Pengcheng Wang, Kaiwen Hong, Chensheng Peng +4Diffusion Policies Action Chunks
Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deployment
Apr 27, 2026Kaijun Zhou, Qiwei Chen, Da Peng +3Vision-Language-Action Models Real-Time Inference
Scalable Production Scheduling: Linear Complexity via Unified Homogeneous Graphs
Apr 26, 2026Jonathan Hoss, Moritz Link, Noah KlarmannOptimal Scheduling Hierarchical Reinforcement Learning
ELSA: Exact Linear-Scan Attention for Fast and Memory-Light Vision Transformers
Apr 26, 2026Chih-Chung Hsu, Xin-Di Ma, Wo-Ting Liao +1Quadratic Attention Real-Time Inference
On-Device Vision Training, Deployment, and Inference on a Thumb-Sized Microcontroller
Apr 24, 2026Jeremy EllisCortex Mobilenetv2

Jun 22, 2026 · cs.LGJ/K move · Enter open · S save

Efficient Network Inference via Hardware-Aware Architecture Search, Model Pruning & Quantization

Lucas Heublein, Mark Deutel, Axel Plinge, Felix Ott

Fraunhofer Institute for Integrated Circuits IIS, 90411 Nürnberg, Germany

Embedded global navigation satellite system (GNSS) interference monitoring requires fast and memory-efficient inference to process large volumes of raw in-phase and quadrature (IQ) samples in real time. At the same time, increasingly expressive deep neural networks (DNNs) are needed for robust interference classification and characterization across diverse signal conditions. This creates a fundamental tension between predictive performance and deployability on resource-constrained hardware. In this paper, we investigate efficient network inference for GNSS interference characterization using iterative structured pruning, post-training static quantization, and hardware-aware zero-shot neural architecture search (NAS). Starting from MCUNet as a compact baseline, we analyze how model compression and automated architecture optimization affect model size, computational complexity, and memory usage while maintaining task performance. Experiments on a GNSS interference dataset, covering both classification and generalized characterization, show the benefits of combining compression and hardware-aware design for embedded deployment. Our results provide practical guidance for developing compact machine learning (ML) models for real-time GNSS interference monitoring on embedded platforms (iMXRT1062 MCU, Raspberry Pi Zero 2W, and Raspberry Pi 5).

Graph Neural Network Inference Real-Time Inference Mixed-Precision Quantization Global Navigation Satellite System Heterogeneous Pruning Scores Interference Quantization

Open paper Ask about it PDF