Efficient Neural Network Inference

Follow this topic Ask about this topic

Momentum

39 papers in the last four weeks, up 225% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 314

All topics

Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving
May 27, 2026Qitao Weng, Heechul YunEfficient Neural Network Inference Adaptive Inference
University of Kansas Lawrence, KS, USA
Accelerating HEVC Intra Partitioning via a CNN-Hierarchical Attention Transformer Hybrid
May 27, 2026Krishna Kumar Sharma, Somdyuti PaulEfficient Neural Network Inference Hybrid CNN-Transformer Architectures
Department of Artificial Intelligence, Indian Institute of Technology Kharagpur, Kharagpur, West Bengal 721302, India
CaMBRAIN: Real-time, Continuous EEG Inference with Causal State Space Models
May 27, 2026Abhilash Durgam, Nyle Siddiqui, Jeffrey A. Chan-Santiago +3Efficient Neural Network Inference Electroencephalography
CRCV, University of Central Florida · Department of MAE, University of Central Florida · Department of Neurology, Loma Linda University
Not All NVFP4 QAT Recipes Are Equal: How Architecture and Scale Shape Model Quality for Anomaly Segmentation
May 26, 2026Zijian Du, Oleg RybakovEfficient Neural Network Inference Image Segmentation
NVIDIA
Comparative Analysis of Liquid Neural Networks and LSTM for Sequential Pattern Recognition: Robustness, Efficiency, and Clinical Utility
May 26, 2026Ye Kyaw Thu, Thazin Myint Oo, Thepchai SupnithiEfficient Neural Network Inference Liquid Neural Networks
National Electronics and Computer Technology Center (NECTEC), Pathumthani, Thailand · Language Understanding Lab., Yangon, Myanmar
Sleep-stage efficient classification using a lightweight self-supervised model
May 25, 2026Eldiane Borges dos Santos Durães, João Batista FlorindoEfficient Neural Network Inference Sleep Stage Classification
Institute of Mathematics, Statistics and Scientific Computing, University of Campinas, Street Sergio Buarque de Holanda, 651, Campinas, Brazil
GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization
May 25, 2026Maoyang Xiang, Tao Luo, Bo WangLLM Quantization Efficient Neural Network Inference
Information Systems Technology and Design Singapore University of Technology and Design Singapore · Institute of High Performance Computing (IHPC) Agency for Science, Technology and Research (A*STAR) Singapore
Towards the Connection between Activation Sparsity and Flat Minima
May 25, 2026Ze Peng, Jian Zhang, Lei Qi +2Efficient Neural Network Inference Activation Sparsity
State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing 210023, China · Institute of Brain-Machine Interface, Nanjing University, Nanjing 210023, China · School of Computer Science and Engineering, Southeast University, Nanjing 211189, China
LAPLEX: The FFT of Learnable Laplace Kernels
May 23, 2026Łukasz Struski, Hanna Blazhko, Piotr Kubaty +1Efficient Neural Network Inference Kernel Methods
Faculty of Mathematics and Computer Science, Jagiellonian University, Kraków, Poland · Doctoral School of Exact and Natural Sciences, Jagiellonian University, Kraków, Poland · Centre for Credible Artificial Intelligence, Warsaw University of Technology, Poland
RED: Adaptive Real-Time DAG Scheduling for Robotic Inference under Environmental Dynamics
May 21, 2026Zexin Li, Tao Ren, Johnathan Liu +2Efficient Neural Network Inference Real-Time Scheduling
University of California, Riverside, USA · University of Pittsburgh, USA · University of Maryland, Baltimore County, USA +1
Slimmable ConvNeXt: Width-Adaptive Inference for Efficient Multi-Device Deployment
May 21, 2026Janek Haberer, Jon Eike Wilhelm, Olaf LandsiedelEfficient Neural Network Inference Adaptive Inference
Kiel University, Germany · Hamburg University of Technology (TUHH), Germany · UNU-INWEH, Germany
Decision-Aware Quadratic ReLU Replacement for HE-Friendly Inference
May 21, 2026Rui Li, Wenyuan Wu, Weijie MiaoEfficient Neural Network Inference Homomorphic Encryption
Chongqing Key Laboratory of Secure Computing for Biology, Chongqing Institute of Green and Intelligent Technology, Chinese Academy of Sciences, 266 Fangzheng Avenue, Beibei District, Chongqing 400714, China · Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University, Hung Hom, Hong Kong, China
Position: The Time for Sampling Is Now! Charting a New Course for Bayesian Deep Learning
May 20, 2026Emanuel Sommer, David RügamerBayesian Neural Networks Efficient Neural Network Inference
Department of Statistics, LMU Munich, Munich, Germany · Munich Center for Machine Learning, Munich, Germany.
AutoMCU: Feasibility-First MCU Neural Network Customization via LLM-based Multi-Agent Systems
May 20, 2026Penglin Dai, Zijie Zhou, Xincao Xu +3Efficient Neural Network Inference Hardware-Aware NAS
School of Computing and Artificial Intelligence, Southwest Jiaotong University, Chengdu 611756, China · Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China, Shenzhen 518110, China · School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China
OlmoEarth v1.2: A more efficient family of OlmoEarth models
May 20, 2026Gabriel Tseng, Yawen Zhang, Favyen Bastani +8Efficient Neural Network Inference Geospatial Foundation Models
Allen Institute for AI
ELSA: An ELastic SNN Inference Architecture for Efficient Neuromorphic Computing
May 20, 2026Kang You, Chen Nie, Lee Jun Yan +6Efficient Neural Network Inference Spiking Neural Networks
Intelligent Computing Research Group, School of Computer Science, Shanghai Jiao Tong University, Shanghai, CN · Shanghai AI Laboratory, Shanghai, CN · School of Computer Science, Shanghai Jiao Tong University, Shanghai, CN +1
SpineContextResUNet: A Computationally Efficient Residual UNet for Spine CT Segmentation
May 20, 2026K S Nithurshen, Saurabh J. ShigwanEfficient Neural Network Inference U-Net
Shiv Nadar University, Delhi NCR, India
Memory-Efficient Partitioned DNN Inference on Resource-Constrained Android Crowds
May 20, 2026Lakshani Manamperi, Disumi Pathirana, Thiwanka Pathirana +2Efficient Neural Network Inference Edge Computing
Department of Computer Science and Engineering, University of Moratuwa, Moratuwa, Sri Lanka.
Neuromorphic Control of a Flapping-Wing Robot on Resource-Constrained Hardware
May 19, 2026Rim El Filali, Chenrui Feng, Chao Gao +1Efficient Neural Network Inference Aerial Robotics
Institute for AI Industry Research (AIR), Tsinghua University, Beijing, PR China · Department of Computer Science and Technology, Tsinghua University, Beijing, PR China · Xinchen Qihang Inc., Beijing, PR China
Scalable, Energy-Efficient Optical-Neural Architecture for Multiplexed Deepfake Video Detection
May 19, 2026Parnian Ghapandar Kashani, Shiqi Chen, Aydogan OzcanEfficient Neural Network Inference Deepfake Detection
Electrical and Computer Engineering Department, University of California, Los Angeles, CA, 90095, USA · Bioengineering Department, University of California, Los Angeles, CA, 90095, USA · California NanoSystems Institute (CNSI), University of California, Los Angeles, CA, 90095, USA
Quantized Machine Learning Models for Medical Imaging in Low-Resource Healthcare Settings
May 19, 2026Sumanth Meenan Kanneti, Aryan ShahEfficient Neural Network Inference Medical Image Classification
Georgia State University · University of Southern California
Distilling Tabular Foundation Models for Structured Health Data
May 18, 2026Aditya Tanna, Nassim Bouarour, Mohamed Bouadi +2Tabular Foundation Models Efficient Neural Network Inference
Lexsi Labs
Embedded ConvNet Ensembles: A Lightweight Approach to Recognize Arabic Handwritten Characters
May 18, 2026Mohsine El Khayati, Rachid Elouahbi, Abdelillah SemmaEfficient Neural Network Inference Ensemble Learning
Systems theory and informatics laboratory Moulay Ismail University of Meknes Meknes, Morocco · Laboratory of Computer Science and Applications Moulay Ismail University of Meknes Meknes, Morocco · Computer Science Dept. EST of Sidi Bennour Chouaib Doukkali University Eljadida, Morocco
Latency-Aware Deep Learning Benchmark for Real-Time Cyber-Physical Attack and Fault Classification in Inverter-Dominated Power Grids
May 17, 2026Emad Abukhousa, Saman Zonouz, A. P. Sakis MeliopoulosEfficient Neural Network Inference Time Series Classification
School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA, USA
TabPFN-MT: A Natively Multitask In-Context Learner for Tabular Data
May 16, 2026Cormac Cureton, Narges ArmanfardTabular Foundation Models Efficient Neural Network Inference
McGill University · Mila - Quebec AI Institute · Montreal, QC, Canada
Public-Decay Homomorphic State Space Models for Private Sequence Inference
May 15, 2026Luis BritoEfficient Neural Network Inference Homomorphic Encryption
School of Technology and Management (ESTG-IPVC) Polytechnic Institute of Viana do Castelo, Viana do Castelo, Portugal
Ti-iLSTM: A TinyDL Approach for Logic-Level Anomaly Detection in Industrial Water Treatment Systems
May 15, 2026Mandar Joshi, Farzana Zahid, Judy Bowen +3Efficient Neural Network Inference Industrial Anomaly Detection
University of Waikato, Hamilton, New Zealand · Auckland University of Technology, Auckland, New Zealand · Aalto University, Espoo, Finland
EVA-0: Test-Time Model Evolution with Only Two Forward Passes per Sample
May 15, 2026Guohao Chen, Shuaicheng Niu, Geng Li +4Efficient Neural Network Inference Test-Time Adaptation
Nanyang Technological University · Tulane University
Enjoy Your Layer Normalization with the Computational Efficiency of RMSNorm
May 14, 2026Yuxin Guo, Yihao Yue, Yunhao Ni +4Efficient Neural Network Inference Layer Normalization
State Key Laboratory of Complex and Critical Software Environment (SKLCCSE), Beihang University, Beijing, China · Hangzhou International Innovation Institute, Beihang University, Hangzhou, China
Evolving Layer-Specific Scalar Functions for Hardware-Aware Transformer Adaptation
May 13, 2026Kieran Carrigg, Sigur de Vries, Amirhossein Sadough +1Efficient Neural Network Inference Efficient ViTs
Department of Machine Learning and Neural Computing Donders Institute for Brain, Cognition, and Behaviour Thomas van Aquinostraat 4, 6525 GD Nijmegen, The Netherlands

May 27, 2026, cs.ROJ/K move · Enter open · S save

Multi-Resolution End-to-End Deep Neural Network for Optimizing Latency-Accuracy Tradeoff in Autonomous Driving

Qitao Weng, Heechul Yun

University of Kansas Lawrence, KS, USA

Efficient Neural Network Inference Adaptive Inference Dynamic Neural Networks End-to-End Autonomous Driving Convolutional Neural Networks

Open paper AskPDF arXiv

Latency-accuracy tradeoffs are fundamental in real-time applications of deep neural networks (DNNs) for cyber-physical systems. In autonomous driving, in particular, safety depends on both prediction quality and the end-to-end delay from sensing to actuation. We observe that (1) when latency is accounted for, the latency-optimal network configuration varies with scene context and compute availability; and (2) a single fixed-resolution model becomes suboptimal as conditions change. We present a multi-resolution, end-to-end deep neural network for the CARLA urban driving challenge using monocular camera input. Our approach employs a convolutional neural network (CNN) that supports multiple input resolutions through per-resolution batch normalization, enabling runtime selection of an ideal input scale under a latency budget, as well as resolution retargeting, which allows multi-resolution training without access to the original training dataset. We implement and evaluate our multi-resolution end-to-end CNN in CARLA to explore the latency-safety frontier. Results show consistent improvements in per-route safety metrics - lane invasions, red-light infractions, and collisions - relative to fixed-resolution baselines.

Momentum

Related topics

Latest papers 314