Efficient Neural Network Inference

Follow this topic Ask about this topic

Momentum

39 papers in the last four weeks, up 225% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 314

All topics

Towards Real-Time ECG and EMG Modeling on $μ$ NPUs
Apr 20, 2026Josh Millar, Ashok Samraj Thangarajan, Soumyajit Chatterjee +1Efficient Neural Network Inference Electrocardiography
Imperial College London London, United Kingdom · Nokia Bell Labs London, United Kingdom · Brave Software & University of Cambridge London, United Kingdom
Fully Analog Resonant Recurrent Neural Network via Metacircuit
Apr 19, 2026Zixin Zhou, Tianxi Jiang, Menglong Yang +3Efficient Neural Network Inference Time Series Classification
Institute of Humanoid Robots, CAS Key Laboratory of Mechanical Behavior and Design of Materials, Department of Precision Machinery and Precision Instrumentation, University of Science and Technology of China, Hefei 230026, People’s Republic of China · State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai 200240, People’s Republic of China
Revisiting Auxiliary Losses for Conditional Depth Routing: An Empirical Study
Apr 19, 2026Qingwei LinEfficient Neural Network Inference Conditional Computation
Independent Researcher
When Spike Sparsity Does Not Translate to Deployed Cost: VS-WNO on Jetson Orin Nano
Apr 18, 2026Jason Yoo, Shailesh Garg, Souvik Chakraborty +1Efficient Neural Network Inference Activation Sparsity
University of Illinois Urbana-Champaign Department of Nuclear, Plasma & Radiological Engineering Urbana, IL, USA · Indian Institute of Technology Delhi Department of Applied Mechanics New Delhi, India · National Center for Supercomputing Applications Urbana, IL, USA
Towards Deep Encrypted Training: Low-Latency, Memory-Efficient, and High-Throughput Inference for Privacy-Preserving Neural Networks
Apr 18, 2026Nges Brian Njungle, Eric Jahns, Michel A. KinsyEfficient Neural Network Inference Memory-Efficient Inference
STAM Center, Ira A. Fulton Schools of Engineering · Arizona State University, Tempe, AZ 85281, USA
EdgeVTP: Exploration of Latency-efficient Trajectory Prediction for Edge-based Embedded Vision Applications
Apr 18, 2026Seungjin Kim, Reza Jafarpourmarzouni, Christopher Neff +2Efficient Neural Network Inference Edge Inference
University of Wyoming · University of North Carolina at Charlotte · North Carolina A&T State University
Combining Convolution and Delay Learning in Recurrent Spiking Neural Networks
Apr 17, 2026Lúcio Folly Sanches Zebendo, Eleonora Cicciarella, Michele RossiConvolutional RNNs Efficient Neural Network Inference
University of Padova, Department of Information Engineering · Department of Mathematics “Tullio Levi Civita” at the University of Padova, Italy
MambaBack: Bridging Local Features and Global Contexts in Whole Slide Image Analysis
Apr 17, 2026Sicheng Chen, Chad Wong, Tianyi Zhang +3Efficient Neural Network Inference Multiple Instance Learning
Nhu Department of Electrical Engineering and Computer Science, University of California, Irvine · Department of Electrical & Computer Engineering, National University of Singapore · PuzzleLogic Pte Ltd, Singapore 229594, Singapore
Towards Topology-Aware Very Large-Scale Photonic AI Accelerators
Apr 16, 2026Belal Jahannia, Abdolah Amirany, Hamed DalirEfficient Neural Network Inference Photonic Computing
Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, USA
NeuroMesh: A Unified Neural Inference Framework for Decentralized Multi-Robot Collaboration
Apr 16, 2026Yang Zhou, Yash Shetye, Long Quang +8Efficient Neural Network Inference Multi-Robot Systems
New York University, New York, USA · U.S. Army Combat Capabilities Development Command, Army Research Laboratory, Adelphi, MD 20783, USA · Vanderbilt University, Tennessee, USA +1
KVNN: Learnable Multi-Kernel Volterra Neural Networks
Apr 16, 2026Haoyu Yun, Hamid Krim, Yufang BaoEfficient Neural Network Inference Kernel Methods
Department of Electrical and Computer Engineering, North Carolina State University, Raleigh, NC, USA · Department of Mathematics and Computer Science, Fayetteville State University, Fayetteville, NC, USA
DLink: Distilling Layer-wise and Dominant Knowledge from EEG Foundation Models
Apr 16, 2026Jingyuan Wang, Zhihao Jia, Chenyu Liu +7Efficient Neural Network Inference EEG Decoding
1Xiamen University · 2Nanyang Technological University · Institute of Automation, Chinese Academy of Sciences +1
Pushing the Limits of On-Device Streaming ASR: A Compact, High-Accuracy English Model for Low-Latency Inference
Apr 16, 2026Nenad Banfic, David Fan, Kunal Vaishnavi +5Efficient Neural Network Inference Streaming ASR
CoreAI, Microsoft
Hardware-Oriented Inference Complexity of Kolmogorov-Arnold Networks
Apr 3, 2026Bilal Khalid, Pedro Freire, Sergei K. Turitsyn +1Efficient Neural Network Inference Kolmogorov-Arnold Networks
Aston Institute of Photonic Technologies, Aston University, Birmingham, B4 7ET, UK
E-TIDE: Fast, Structure-Preserving Motion Forecasting from Event Sequences
Mar 29, 2026Biswadeep Sen, Benoit R. Cottereau, Nicolas Cuperlier +1Event-Based Vision Efficient Neural Network Inference
National University of Singapore, Singapore · CerCo, CNRS UMR 5549, Universit´e de Toulouse, France · ETIS UMR8051, CY Cergy Paris Universit´e, ENSEA, CNRS, Cergy, France +1
ET-SAM: Efficient Point Prompt Prediction in SAM for Unified Scene Text Detection and Layout Analysis
Mar 26, 2026Xike Zhang, Maoyuan Ye, Juhua Liu +1Efficient Neural Network Inference Promptable Image Segmentation
School of Computer Science, National Engineering Research Center for Multimedia Software, Institute of Artificial Intelligence, and Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University, China
Latency Coding for Efficient and Low-Latency Deep Spiking Neural Networks
Mar 24, 2026Yi Lu, Jianhao Ding, Zhaofei YuEfficient Neural Network Inference Spiking Neural Networks
School of Software and Microelectronics, Peking University, Beijing, China · School of Computer Science, Peking University, Beijing, China · Institute for Artificial Intelligence and the School of Computer Science, Peking University, Beijing, China
ECoLAD: Selecting Anomaly Detectors for Automotive Deployment via Compute-Reduction Evaluation
Mar 11, 2026Kadir-Kaan Özer, René Ebeling, Markus EnzweilerEfficient Neural Network Inference Automated Evaluation
Mercedes-Benz AG, Germany. · Esslingen University of Applied Sciences, Germany.
Toward Generalizable Deep Learning Based Peatland Fire Detection via Walsh Hadamard Transform and Domain Adaptation
Mar 2, 2026Emadeldeen Hamdan, Ahmad Faiz Tharima, Mohd Zahirasri Mohd Tohir +4Efficient Neural Network Inference
Department of Electrical and Computer Engineering, University of Illinois Chicago, Chicago, IL, USA · Fire and Rescue Department of Malaysia, Malaysia · Dept. of Chemical and Environmental Engineering, Faculty of Engineering, Universiti Putra Malaysia, Malaysia. +2
VTC: DNN Compilation with Virtual Tensors for Data Movement Elimination
Feb 11, 2026Muyan Hu, Ahan Gupta, Jiachen Yuan +7Efficient Neural Network Inference Memory-Efficient Inference
University of Illinois Urbana-Champaign · Georgia Institute of Technology · Microsoft
CauScale: Neural Causal Discovery at Scale
Feb 9, 2026Bo Peng, Sirui Chen, Jiaguo Tian +2Efficient Neural Network Inference Causal Discovery
Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Shanghai Innovation Institute +1
Physical Analogue Kolmogorov-Arnold Networks based on Reconfigurable Nonlinear-Processing Units
Feb 7, 2026Manuel Escudero, Mohamadreza Zolfagharinejad, Sjoerd van den Belt +2Efficient Neural Network Inference Kolmogorov-Arnold Networks
1NanoElectronics Group, MESA+ Institute and BRAINS Center for Brain-Inspired Computing, University of Twente, P.O. Box 217, Enschede,2026 7500 AE, The Netherlands. · 2CAESUniversity GroupofandTwente,BRAINSEnschede,Center 7500for Brain-InspiredAE, The Netherlands.Computing · Institute of Physics, University of Münster, Münster, 48149 Germany.
BitLogic: Training Framework for Gradient-Based FPGA-Native Neural Networks
Feb 7, 2026Simon Bührer, Andreas Plesner, Aczel Till +1Efficient Neural Network Inference FPGA-Based Neural Network Acceleration
ETH Zurich · Zurich, Switzerland
Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometries
Feb 4, 2026Hang Zhou, Haixu Wu, Haonan Shangguan +4Efficient Neural Network Inference Neural PDE Solvers
School of Software, BNRist, Tsinghua University, China.
Efficient Neural Controlled Differential Equations via Attentive Kernel Smoothing
Feb 2, 2026Egor Serov, Ilya Kuleshov, Alexey ZaytsevEfficient Neural Network Inference Neural Controlled Differential Equations
Applied AI Institute · Risk AI Research Lab
Animal Re-Identification on Microcontrollers
Dec 9, 2025Yubo Chen, Di Zhao, Yun Sing Koh +1Efficient Neural Network Inference Animal Re-Identification
University of Auckland Auckland, New Zealand
SparsePixels: Efficient Convolution for Sparse Data on FPGAs
Dec 5, 2025Ho Fung Tsoi, Dylan Rankin, Vladimir Loncar +1Efficient Neural Network Inference Convolutional Neural Networks
University of Pennsylvania, USA · Institute of Physics Belgrade, Serbia · 3Massachusetts Institute of Technology, USA +1
Hardware-Algorithm Co-Optimization of Early-Exit Neural Networks for Multi-Core Edge Accelerators
Dec 4, 2025Alaa Zniber, Arne Symons, Ouassim Karrakchou +2Efficient Neural Network Inference Dynamic Neural Networks
TICLab, International University of Rabat, Morocco · MICAS, KU Leuven, Belgium
NeuroFlex: Lossless Element-Level ANN-SNN Co-Execution for Efficient Sparse Inference
Nov 7, 2025Varun Manjunath, Pranav Ramesh, Gopalakrishnan SrinivasanEfficient Neural Network Inference Spiking Neural Networks
Electrical Engineering Indian Institute of Technology Madras Chennai, India · Computer Science and Engineering Indian Institute of Technology Madras Chennai, India
Time-multiplexed layer reuse for physical neural networks
Oct 28, 2025Kohei Tsuchiyama, Andre Roehm, Takatomo Mihana +1Efficient Neural Network Inference
Graduate School of Information Science and Technology, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, 113-8656, Tokyo, Japan.

Apr 20, 2026, cs.LGJ/K move · Enter open · S save

Towards Real-Time ECG and EMG Modeling on $μ$ NPUs

Josh Millar, Ashok Samraj Thangarajan, Soumyajit Chatterjee, Hamed Haddadi

Imperial College London London, United Kingdom · Nokia Bell Labs London, United Kingdom · Brave Software & University of Cambridge London, United Kingdom

Efficient Neural Network Inference Electrocardiography On-Device Inference

Open paper AskPDF arXiv

The miniaturisation of neural processing units (NPUs) and other low-power accelerators has enabled their integration into microcontroller-scale wearable hardware, supporting near-real-time, offline, and privacy-preserving inference. Yet physiological signal analysis has remained infeasible on such hardware; recent Transformer-based models show state-of-the-art performance but are prohibitively large for resource- and power-constrained hardware and incompatible with

μ

NPUs due to their dynamic attention operations. We introduce PhysioLite, a lightweight, NPU-compatible model architecture and training framework for ECG/EMG signal analysis. Using learnable wavelet filter banks, CPU-offloaded positional encoding, and hardware-aware layer design, PhysioLite reaches performance comparable to state-of-the-art Transformer-based foundation models on ECG and EMG benchmarks, while being <10% of the size (

\sim

370KB with 8-bit quantization). We also profile its component-wise latency and resource consumption on both the MAX78000 and HX6538 WE2

μ

NPUs, demonstrating its viability for signal analysis on constrained, battery-powered hardware. We release our model(s) and training framework at: https://github.com/j0shmillar/physiolite.

Momentum

Related topics

Latest papers 314