Edge Inference

Ask about this topic

Overview

Edge inference studies how to run AI models close to where data is collected, often on devices with limited memory, power, and computing capacity. Common approaches include quantization, pruning and distillation, hardware-aware model and accelerator design, and adaptive methods such as early exits, model routing, and device-edge splitting. Work spans tasks from object detection and segmentation to language and multimodal models, with evaluation on benchmarks such as COCO and MVTec as well as phones, Raspberry Pi, Jetson, microcontrollers, and FPGAs. A central challenge is balancing accuracy, latency, energy, and robustness: proxy measures such as FLOPs may not predict real-device performance, which also varies with hardware, workload contention, and sustained operation.

Latest papers

CardsList

228 papers24 papers in the last four weeks, down 4% on the four weeks before. 0.1% of all new papers.

  1. BlankSkip: Early-exit Object Detection onboard Nano-drones

    Mar 30, 2026Carlo Marra, Beatrice Alessandra Motetti, Alessio Burrello +3Efficient Object DetectionObject Detection

    †Politecnico di Torino, Turin, Italy

  2. Amped: Adaptive Multi-stage Non-edge Pruning for Edge Detection

    Mar 29, 2026Yuhan Gao, Xinqing Li, Xin He +4Edge DetectionEdge Inference

    VCIP, College of Computer Science, Nankai University · Academy for Advanced Interdisciplinary Studies, Nankai University · School of Computer Science and Engineering, Tianjin University of Technology +3

  3. CarbonEdge: Carbon-Aware Deep Learning Inference Framework for Sustainable Edge Computing

    Mar 28, 2026Guilin Zhang, Wulan Guo, Ziqi Tan +2Edge InferenceEdge Computing

    Department of Engineering Management and Systems Engineering, George Washington University, USA · Department of Computer Science, Information, and Engineering Technology, Youngstown State University, USA

  4. Computer Vision with a Superpixelation Camera

    Mar 27, 2026Sasidharan Mahalingam, Rachel Brown, Atul IngleSuperpixel SegmentationImage Segmentation

    Portland State University · Willamette University

  5. Beyond MACs: Hardware Efficient Architecture Design for Vision Backbones

    Mar 27, 2026Moritz Nottebaum, Matteo Dunnhofer, Christian MicheloniEfficient Neural Network InferenceEfficient ViTs

    Machine Learning and Perception Lab, University of Udine Via delle Scienze 206, Udine, 33100, UD, Italy. · Centre for Vision Research, York University 4700 Keele St, Toronto, M3J 1P3, ON, Canada.

  6. EcoFair: Energy-Efficient Inference Routing for Edge AI under Data Degradation

    Mar 27, 2026Mostafa Anoosha, Dhavalkumar Thakker, Kuniko Paxton +4Adaptive InferenceEnergy-Efficient ML

    School of Digital and Physical Science, University of Hull Kingston upon Hull, HU6 7RX, U.K.

  7. Edge Radar Material Classification Under Geometry Shifts

    Mar 24, 2026Jannik Hohmann, Dong Wang, Andreas NüchtermmWave Radar SensingDistribution Shift

    Department of Informatics XVII (Robotics), Julius-Maximilians-University Würzburg, 97074 Würzburg, Germany. · Zentrum für Telematik e.V., Würzburg · U2IS, ENSTA, Institut Polytechnique de Paris, France.

  8. TorR: Towards Brain-Inspired Task-Oriented Reasoning via Cache-Oriented Algorithm-Architecture Co-design

    Mar 24, 2026Hyunwoo Oh, SungHeon Jeong, Suyeon Jang +4Efficient Object DetectionHardware-Software Co-Design

    Department of Computer Science, University of California, Irvine Irvine, CA, USA

  9. Efficient Universal Perception Encoder

    Mar 23, 2026Chenchen Zhu, Saksham Suri, Cijo Jose +8Visual Representation LearningVision Foundation Models

    Meta Reality Labs · FAIR at Meta

  10. SparseDVFS: Sparse-Aware DVFS for Energy-Efficient Edge Inference

    Mar 23, 2026Ziyang Zhang, Zheshun Wu, Jie Liu +1Efficient Neural Network InferenceEnergy-Efficient ML

    Politecnico di Milano, Milan, Italy · Harbin Institute of Technology, Shenzhen, China

  11. MEMO: Human-like Crisp Edge Detection Using Masked Edge Prediction

    Mar 21, 2026Jiaxin Cheng, Yue Wu, Yicong ZhouEdge DetectionEdge Inference

    Department of Computer and Information Science, University of Macau, Macau, China · Capital One, USA

  12. A reconfigurable smart camera implementation for jet flames characterization based on an optimized segmentation model

    Mar 19, 2026Gerardo Valente Vazquez-Garcia, Carmina Perez Guerrero, Eduardo Garduño +7Semantic SegmentationEdge Inference

    Universidad Autónoma de Guadalajara, Maestria en Ciencias Computacionales, Guadalajara, 45017, Jalisco, Mexico · Escuela de Ingeniería y Ciencias, Tecnológico de Monterrey, Monterrey, 64849, N.L., Mexico · Universidad de las Américas Puebla, Department of Chemical, Food and Environmental Engineering, Puebla, 72810, Mexico +1

  13. VeloxNet: Efficient Spatial Gating for Lightweight Embedded Image Classification

    Mar 19, 2026Md Meftahul Ferdaus, Elias Ioup, Mahdi Abdelguerfi +4Image ClassificationLightweight CNNs

    Canizaro Livingston Gulf States Center for Environmental Informatics, the University of New Orleans, New Orleans, USA · Center for Geospatial Sciences, Naval Research Laboratory, Stennis Space Center, Hancock County, Mississippi, USA · US Army Corps of Engineers, Engineer Research and Development Center, Vicksburg, Mississippi, USA

  14. Hardware Utilization and Inference Performance of Edge Object Detection Under Fault Injection

    Mar 19, 2026Faezeh Pasandideh, Mehdi Azarafza, Achim RettbergEdge Inference

    Department of Electrical Engineering, Hamm-Lippstadt University of Applied Sciences (HSHL), Lippstadt, Germany

  15. DyMoE: Dynamic Expert Orchestration with Mixed-Precision Quantization for Efficient MoE Inference on Edge

    Mar 19, 2026Yuegui Huang, Zhiyuan Fang, Weiqi Luo +3Mixture-of-Experts InferenceMixture-of-Experts Quantization

    Sun Yat-sen University, Guangzhou, China · Tencent, Shenzhen, China

  16. EdgeCrafter: Compact ViTs for Edge Dense Prediction via Task-Specialized Distillation

    Mar 19, 2026Longfei Liu, Yongjie Hou, Yang Li +7Dense PredictionEfficient ViTs

    Intellindust AI Lab

  17. Noise-Aware Misclassification Attack Detection in Collaborative DNN Inference

    Mar 18, 2026Shima Yousefi, Saptarshi DebroyAdversarial Example DetectionAnomaly Detection

    City University of New York

  18. MAED: Mathematical Activation Error Detection for Mitigating Physical Fault Attacks in DNN Inference

    Mar 18, 2026Kasra Ahmadi, Saeed Aghapour, Mehran Mozaffari Kermani +1Fault DetectionEdge Inference

    Department of Computer Science and Engineering, University of South Florida, Tampa, FL 33620, USA. · Department of Computer and Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL 33431, USA.

  19. Efficient Visual Anomaly Detection at the Edge: Enabling Real-Time Industrial Inspection on Resource-Constrained Devices

    Mar 18, 2026Arianna Stropeni, Fabrizio Genilotti, Francesco Borsatti +3Industrial Anomaly DetectionEdge Inference

    University of Padua, Padua, Italy

  20. Edge-Efficient Two-Stream Multimodal Architecture for Non-Intrusive Bathroom Fall Detection

    Mar 17, 2026Haitian Wang, Yiren Wang, Xinyu Wang +2Fall DetectionMultimodal Sensor Fusion

    The University of Western Australia, 35 Stirling Highway, Crawley, WA 6009, Australia

  21. vAccSOL: Efficient and Transparent AI Vision Offloading for Mobile Robots

    Mar 17, 2026Adam Zahir, Michele Gucciardom Falk Selker, Anastasios Nanos +4Efficient Neural Network InferenceEdge Inference

    University Carlos III of Madrid (UC3M), Madrid, Spain. · NEC Laboratories Europe, Heidelberg, Germany. · Nubificus Ltd, United Kingdom.

  22. TinyGLASS: Real-Time Self-Supervised In-Sensor Anomaly Detection

    Mar 17, 2026Pietro Bonazzi, Rafael Sutter, Luigi Capogrosso +2Anomaly DetectionIndustrial Anomaly Detection

    ETH Zurich, Zurich, Switzerland · Interdisciplinary Transformation University of Austria, Linz, Austria · Swiss Engineering Partners AG, Zurich, Switzerland

  23. GLANCE: Gaze-Led Attention Network for Compressed Edge-inference

    Mar 16, 2026Neeraj Solanki, Hong Ding, Sepehr Tabrizchi +4Edge InferenceEfficient Object Detection

    Neeraj Solanki, Hong Ding, Sepehr Tabrizchi, Ali Shafiee Sarvestani, and Arman Roohi are with the Department of Electrical and Computer Engineering, University of Illinois Chicago, Chicago IL, USA. · S. Angizi is with the Department of Electrical and Computer Engineering, New Jersey Institute of Technology (NJIT), Newark, NJ, USA · D. Z. Pan is with the Department of Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX 78712, USA.

  24. Covariance-Guided Resource Adaptive Learning for Efficient Edge Inference

    Mar 15, 2026Ahmad N. L. Nabhaan, Zaki Sukma, Rakandhiya D. Rachmanto +4Power-Efficient InferenceInference-Time Optimization

    Universitas Amikom Yogyakarta, Department of Informatics · University of Georgia, School of Computing · Universitas Gadjah Mada, Department of Computer Science and Electronics +1

  25. PicoSAM3: Real-Time In-Sensor Region-of-Interest Segmentation

    Mar 12, 2026Pietro Bonazzi, Nicola Farronato, Stefan Zihlmann +2In-Sensor ComputingPromptable Image Segmentation

    Equal contribution · ETH Zürich, Zürich, Switzerland. · IBM Research, Zürich, Switzerland.

  26. AsyncMDE: Real-Time Monocular Depth Estimation via Asynchronous Spatial Memory

    Mar 11, 2026Lianjie Ma, Yuquan Li, Bingzheng Jiang +3Edge InferenceMonocular Depth Estimation

    School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China. · Yichang Testing Technology Research Institute, Yichang, China. · School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China.

  27. Hardware Efficient Approximate Convolution with Tunable Error Tolerance for CNNs

    Mar 10, 2026Vishal Shashidhar, Anupam Kumari, Roy P PailyEfficient Neural Network InferenceNeural Network Hardware Acceleration

    Department of Electronics and Electrical Engineering, Indian Institute of Technology Guwahati

  28. Multi-DNN Inference of Sparse Models on Edge SoCs

    Mar 10, 2026Jiawei Luo, Di Wu, Simon Dobson +1Efficient Neural Network InferenceEdge Inference

    School of Computer Science, University of St Andrews, Scotland UK

  29. Real-Time Glottis Detection Framework via Spatial-decoupled Feature Learning for Nasal Transnasal Intubation

    Mar 8, 2026Jinyu Liu, Gaoyang Zhang, Yang Zhou +3Efficient Object DetectionReal-Time Object Detection

    Hubei Key Laboratory of Modern Manufacturing Quality Engineering, Hubei University of Technology, Nanhu Avenue 28, Wuhan, 430068, Hubei, China · School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Luoyu Road 1037, Wuhan, 430074, Hubei, China · Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong, 999077, China +2

  30. Explainable and Hardware-Efficient Jamming Detection for 5G Networks Using the Convolutional Tsetlin Machine

    Mar 7, 2026Vojtech Halenka, Mohammadreza Amini, Per-Arne Andersen +2Wireless CommunicationsEdge Inference

    Center of Artificial Intelligence Research, University of Agder, Grimstad, Norway · School of Electrical Engineering and Computer Science, University of Ottawa, Ottawa, ON, Canada