Efficient Neural Network Inference

Ask about this topic

Momentum

39 papers in the last four weeks, up 225% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 314

All topics
CardsList

  1. ExaGEMM: Exploration Framework for CPU-Driven ML Inference via Associative In-Register Computing for Low-Bit GEMM

    Jul 16, 2026Hyunwoo Oh, Suyeon Jang, Hanning Chen +3Efficient Neural Network InferenceHardware-Software Co-Design

    University of California, Irvine

  2. EMAGN: Efficient Multi-Attention Graph Network via Learned Clustering for Scalable Traffic Forecasting

    Jul 14, 2026Mingxing Xu, Rakesh Chowdary Machineni, Ke Liu +7Efficient Neural Network InferenceGraph Attention Networks

    Shanghai Jiao Tong University · University of Michigan, Ann Arbor · University of California, Berkeley +5

  3. MambaPSA: A Mamba-based Replacement for C2PSA in YOLO26

    Jul 14, 2026Sheng-Wei Chan, Chia-Min Lin, Hsin-Jui Pan +4Efficient Neural Network InferenceEfficient Object Detection

    Department of Electrical and Computer Engineering, Tamkang University, New Taipei City, Taiwan

  4. Improving Autonomous Nano-drones Performance via Automated End-to-End Optimization and Deployment of DNNs

    Jul 14, 2026Vlad Niculescu, Lorenzo Lamberti, Francesco Conti +2Efficient Neural Network InferenceAerial Robotics

    Integrated Systems Laboratory - ETH Zürich, Switzerland · Department of Electrical, Electronic and Information Engineering - University of Bologna, Italy · Dalle Molle Institute for Artificial Intelligence - USI-SUPSI, Switzerland

  5. DeGuNet: Depth-Guided Ultra-Compact Backbones for Efficient LiDAR-Camera 3D Detection

    Jul 14, 2026Haifa Zhang, Yijing Wang, Peixi Peng +1Efficient Neural Network InferenceRepresentation Learning

    Tianjin University, Tianjin, China · Peking University, Beijing, China

  6. Towards Efficient Convolutional Neural Network for Embedded Hardware via Multi-Dimensional Pruning

    Jul 13, 2026Hao Kong, Di Liu, Xiangzhong Luo +5Efficient Neural Network InferenceConvolutional Neural Networks

    School of Computer Science and Engineering, Nanyang Technological University, Singapore · HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University, Singapore · Department of Computer Science, Norwegian University of Science and Technology, Trondheim, Norway. +1

  7. Event-based Neural Decoding for Neuroprosthetic Motor Control

    Jul 13, 2026Khaleelulla Khan Nazeer, Sirine Arfa, Matthias Jobst +2Efficient Neural Network InferenceBrain-Computer Interfaces

    Chair of Highly-Parallel VLSI-Systems and Neuromorphic Circuits, Technische Universität Dresden, Germany · Centre for Tactile Internet with Human-in-the-Loop (CeTI), Dresden, Germany

  8. Benchmarking Edge Inference Strategies for Deep Learning Models in Industrial Machine Vision

    Jul 13, 2026Miguel Gomez Fernandez, David Castro Boga, Roi Mendez-Rial +1Efficient Neural Network InferenceInference-Time Optimization

    Smart Systems and Smart Manufacturing (S3M) AIMEN O Porri˜no, Spain

  9. LSTrans: Efficient Knowledge Transfer for Lightweight and Automated ECG Classification

    Jul 12, 2026Yi Zhao, Jiajun Gao, Chenyang Xu +2Efficient Neural Network InferenceHybrid CNN-Transformer Architectures

    School of Mechano-Electronic Engineering · Xidian University · Xi’an, China +5

  10. WaveNet-Style Guitar Amplifier Model Pruning for Real-Time iOS Deployment

    Jul 11, 2026Ryota Sato, Eli SilversteinEfficient Neural Network InferenceOn-Device Inference

    Dept. of Electrical Engineering Stanford University Stanford, USA

  11. EvoLP: Self-Evolving Latency Predictor for Model Compression in Real-Time Edge Systems

    Jul 10, 2026Shuo Huai, Hao Kong, Shiqing Li +5Efficient Neural Network InferenceEdge Computing

    School of Computer Science and Engineering, Nanyang Technological University, Singapore · HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University, Singapore · HP Inc., Palo Alto, California, USA

  12. ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device

    Jul 9, 2026Fabio Tosi, Luca Bartolomei, Matteo Poggi +1Efficient Neural Network InferenceMonocular Depth Estimation

    University of Bologna, Bologna, Italy

  13. FPGN: Redefining Ultra-Fast Programmable Gate-based Neural Acceleration with Differentiable LUTs

    Jul 9, 2026Jiawei Liang, Haotong Qin, Linfeng Du +7Efficient Neural Network InferenceFPGA-Based Neural Network Acceleration

    HKUST · ETH Zurich · HKUST (GZ)

  14. Collate: Collaborative Neural Network Learning for Latency-Critical Edge Systems

    Jul 9, 2026Shuo Huai, Di Liu, Hao Kong +5Efficient Neural Network InferenceFederated Learning Aggregation

    School of Computer Science and Engineering, Nanyang Technological University, Singapore · HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University, Singapore · HP Inc., Palo Alto, California, USA

  15. Latency-Constrained DNN Architecture Learning for Edge Systems using Zerorized Batch Normalization

    Jul 8, 2026Shuo Huai, Di Liu, Hao Kong +4Efficient Neural Network InferenceEdge Inference

    aSchool of Computer Science and Engineering, Nanyang Technological University, 639798, Singapore · cDepartment of Computer Science, Norwegian University of Science and Technology, 7491, Trondheim, Norway · bHP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University, 639798, Singapore +1

  16. Smart Scissor: Coupling Spatial Redundancy Reduction and CNN Compression for Embedded Hardware

    Jul 8, 2026Hao Kong, Di Liu, Shuo Huai +5Efficient Neural Network InferenceEdge Inference

    School of Computer Science and Engineering, Nanyang Technological University, Singapore · HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University, Singapore · HP Inc., Palo Alto, California, USA

  17. DBNN: Neural Spike Classification Using a Deep Binarized Neural Network

    Jul 6, 2026Binyi Ren, Luca M. Meyer, Majid ZamaniEfficient Neural Network InferenceBrain-Computer Interfaces

    The School of Electronics and Computer Science (ECS), University of Southampton, Southampton SO17 1BJ, U.K.

  18. Lightweight ML-Based Automatic Sleep Staging Framework with Constrained CNN and Mamba for Small-Sample EEG Datasets

    Jul 6, 2026Zihao Wei, Yulin Gong, Yudan LvEfficient Neural Network InferenceElectroencephalography

    School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, Jilin Province, China · Jilin University, Changchun 130012, Jilin Province, China

  19. BitFair: A 12nm Bit-Serial CNN Accelerator with Learnable Early Termination and Adaptive Bit Ordering for Ultra-Low-Power XR Vision

    Jul 4, 2026Ang Li, Chang GaoEfficient Neural Network InferenceAI Accelerator Inference

    Department of Microelectronics, Delft University of Technology, Delft, The Netherlands

  20. DistillH-Mamba: A Hypergraph-Mamba-Based Knowledge Distillation Model for Efficient Impact Fall Detection

    Jul 3, 2026Tresor Y. Koffi, Youssef Mourchid, Mohammed Hindawi +1Skeleton-Based Action RecognitionEfficient Neural Network Inference

    CESI, CESI LINEACT, Dijon, France · CESI, CESI LINEACT, Lyon, France · CESI, CESI LINEACT, Paris, France

  21. CodeJeNN: A simple C++ neural network generator for physics applications

    Jul 2, 2026Jay Arcities, Pavel Popov, Eric J Ching +2Efficient Neural Network Inference

    San Diego State University, Aerospace Engineering Department, San Diego, CA 92182 · U.S. Naval Research Laboratory, Laboratories of Computational Physics and Fluid Dynamics, Washington, DC 20375

  22. Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots

    Jul 2, 2026Ling Xu, Chuyu Han, Borui Li +6Efficient Neural Network InferenceEfficient VLA Model Inference

    Southeast University · Nanjing University · Microsoft Research +1

  23. Do Newer Lightweight CNNs Perform Better Under Resource Constraints? A Controlled Multigenerational Study of Architecture, Initialization, Training Budget, and Efficiency

    Jul 2, 2026Tasnim ShahriarEfficient Neural Network InferenceConvolutional Neural Networks

    Independent Researcher

  24. Scaling Up Thermodynamic AI Models

    Jun 30, 2026Andrew G. MooreEfficient Neural Network InferenceAI Accelerator Inference

  25. SpikeLogBERT: Energy-Efficient Log Parsing Using Spiking Transformer Networks

    Jun 30, 2026Thuan Bui, Duong Do, Tung Vu +2Efficient Neural Network InferenceSpiking Transformers

    Swinburne Vietnam, FPT University Hanoi, Vietnam · Posts and Telecommunications Institute of Technology Hanoi, Vietnam · Academy of Cryptography Techniques Hanoi, Vietnam +1

  26. HASTE: A Framework for Training-Free, Dynamic, and Steerable Compression of Pre-Trained Convolutional Neural Networks

    Jun 29, 2026Lukas Meiner, Jens Mehnert, Alexandru Paul ConduracheEfficient Neural Network InferenceConvolutional Neural Networks

    Robert Bosch GmbH, Leonberg, Germany. · Universität zu Lübeck, Lübeck, Germany.

  27. Implementation of Hyperelastic Physics-Augmented Neural Networks in the Explicit Finite Element Codes Simcenter Radioss and OpenRadioss with Applications to Impact Events

    Jun 29, 2026Lukas Maurer, Sascha Eisenträger, Marian Bulla +1Neural Surrogate ModelingEfficient Neural Network Inference

    Institute of Materials, Technologies and Mechanics Otto von Guericke University Magdeburg Magdeburg, D-39106 · Siemens Digital Industries Am Kabellager 9 Köln, D-51063

  28. Evolutionary Hyperparameter Optimization to Find Lightweight CNN Models for Autonomous Steering

    Jun 29, 2026Devson Butani, Ryan Kaddis, Chan-Jin ChungEfficient Neural Network InferenceAutonomous Driving

    Dept. of Math and Computer Science Lawrence Technological University Southfield, MI, USA

  29. SEADA: An efficient methodology for optimizing mixed-precision DNNs on multi-precision spatial architectures

    Jun 26, 2026Leandro Fiorin, Marco Ronzani, Cristina SilvanoMixed-Precision QuantizationEfficient Neural Network Inference

    Indipendent Researcher Groningen, The Netherlands · Dipartimento di Elettronica e Informazione, Politecnico di Milano. Milano, Italy

  30. Criticality-Constrained Iterative Pruning for Energy-Efficient Spiking Neural Networks via Combined Importance Scoring

    Jun 26, 2026Muhammad HamzaEfficient Neural Network InferenceSpiking Neural Networks

    Indian Institute of Technology Kharagpur, West Bengal 721302, India