Edge Inference

Ask about this topic

Overview

Edge inference studies how to run AI models close to where data is collected, often on devices with limited memory, power, and computing capacity. Common approaches include quantization, pruning and distillation, hardware-aware model and accelerator design, and adaptive methods such as early exits, model routing, and device-edge splitting. Work spans tasks from object detection and segmentation to language and multimodal models, with evaluation on benchmarks such as COCO and MVTec as well as phones, Raspberry Pi, Jetson, microcontrollers, and FPGAs. A central challenge is balancing accuracy, latency, energy, and robustness: proxy measures such as FLOPs may not predict real-device performance, which also varies with hardware, workload contention, and sustained operation.

Latest papers

CardsList

228 papers24 papers in the last four weeks, down 4% on the four weeks before. 0.1% of all new papers.

  1. Quantized Edge Inference of a Self-Supervised SAR-Optical Encoder on Commodity x86 Hardware

    Oct 27, 2026Christian Sanchez-Leon, Dongming ChenEfficient Transformer InferenceEdge Inference

    Software College, Northeastern University, Shenyang 110819, China

  2. Real-Time Conveyor Belt Defect Detection via Edge TPU-Accelerated YOLOv11 on Raspberry Pi 5

    Oct 25, 2026Muhammad Nur Bijak Bestari, Mulki Indana ZulfaIndustrial Anomaly DetectionIndustrial Inspection

    Department of Electrical Engineering, Faculty of Engineering, Universitas Jenderal Soedirman, Purwokerto 53123, Central Java, Indonesia

  3. StickFigure: Enabling Pose-Only IoT Cameras for Privacy-Preserving Edge Vision

    Oct 25, 2026Aveline Xiaoyuan Han, Chenshu WuHuman Pose EstimationEdge Inference

    The University of Hong Kong

  4. TinyFlow: Breaking the Warping Bottleneck for Edge Optical Flow

    Oct 23, 2026Xiao'ao Song, Chahat Deep SinghOptical FlowEdge Inference

    The authors are with the Perception, Robotics, AI, Sensing (PRAISe) Lab, University of Colorado, Boulder, CO, USA.

  5. RootDown: Deploying and Benchmarking Models for Beet-Root Detection on Edge Devices

    Oct 23, 2026Gerardus Croonen, Andreas Trondl, Julia Simon +1Object DetectionAgricultural Image Analysis

    AIT Austrian Institute of Technology, Giefinggasse 4, 1210 Vienna, Austria Center for Vision, Automation & Control

  6. Benchmarking Model Compression Techniques Across Heterogeneous Edge Platforms: A Predictive Maintenance Use Case for Rotating Machinery

    Oct 21, 2026Matheus Calheira Guimarães de Oliveira, Marco Aurélio da Silva Cruz, Regis Cardoso +9Model CompressionEdge Inference

    SENAI CIMATEC University, Salvador, BA, Brazil · Surrey Institute for People-Centred AI, School of Computer Science and Electronic Engineering, Faculty of Engineering and Physical Sciences, University of Surrey, Guildford, UK · SENAI Institute of Innovation in Embedded Systems, Florianópolis, SC, Brazil +6

  7. Which Depth Estimator for Jetson AGX Orin? A 2026 Benchmark of Monocular and Stereo Methods

    Oct 19, 2026Leaf JiangMetric Depth EstimationMonocular Depth Estimation

    NODAR Inc.

  8. YUTELA: A Scalable Edge Cloud AIoT System for Multi-Site Video Anomaly Detection with Scene Specific Adaptation

    Oct 19, 2026Shanle Yao, Babak Rahimi Ardabili, Amir Kimiyaie +1Video Anomaly DetectionEdge Inference

    The authors are with the Electrical and Computer Engineering Department, The University of North Carolina at Charlotte, Charlotte, NC, 28223 USA.

  9. LateMatch: Breaking the Interaction Bottleneck via Cacheable Matching for Efficient Visual Localization

    Oct 18, 2026Mohammad Omama, Aeyan Ashraf, Sandeep ChinchaliImage MatchingVisual Place Recognition

    The University of Texas at Austin · University of Massachusetts Amherst

  10. Edge Deployable Lightweight Framework for Real-Time Driver Safety System with Integrated Lane Departure and Traffic Sign Recognition

    Oct 18, 2026Hassaan Ali Qureshi, Danish Hussain, Ali Hassan +5Traffic Sign DetectionAutonomous Driving Perception

    Department of Mechatronics Engineering, College of Electrical and Mechanical Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan · Department of Robotics and Artificial Intelligence, School of Mechanical and Manufacturing Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan · Department of Computer and Software Engineering, College of Electrical and Mechanical Engineering, National University of Sciences and Technology, Islamabad 44000, Pakistan +2

  11. PanoDent-KD: From Generalist Knowledge Distillation to Cross-Dataset Specialist Detection and Embedded Deployment in Panoramic Radiographs

    Oct 18, 2026Muhammad Waqas Ashraf, Imad Ali Shah, Ali HassanMedical Image Object DetectionObject Detection

  12. Replay Pruning and Few-Bit Integer Inference for Hardware-Efficient Speed-Sign Recognition

    Oct 16, 2026Se Un Park, Kyungkeon Chung, Huigeol Kim +1Channel PruningEfficient Inference

    UX Factory, Inc. · BTree Co., Ltd.

  13. TRACE: Transformer Residual Activation Codebook Encoding for Communication-efficient Distributed Edge Inference

    Oct 15, 2026Muhammad Azlan Qazi, Alexandros Iosifidis, Qi ZhangEfficient Transformer InferenceTransformer Inference

    DIGIT and the Department of Electrical and Computer Engineering, Aarhus University, Denmark · the Data Science Research center, Tampere University, Finland

  14. Exposing AI Inference as a Telco Network API over the 5G User Plane

    Oct 10, 2026Rodrigo Moreira, Larissa Ferreira Rodrigues Moreira, Joberto S. B. Martins +2Edge InferenceSplit Inference

    Federal University of Viçosa (UFV), Minas Gerais, Brazil · University of Salvador (UNIFACS), Salvador, Brazil · University of São Paulo (USP), São Paulo, Brazil +1

  15. Edge-Native Temporal--Graph Dual-Expert Inference for Dexterous Grasp Classification

    Oct 10, 2026Jiajian Zheng, Bin Zhang, Wen Fan +1Robotic GraspingRobotic Perception

    School of Microelectronics Shanghai University Shanghai, 201800, China · Department of Bioengineering Imperial College London London SW7 2AZ, United Kingdom

  16. Seamless Deployment of Machine Learning Inference at the Far Edge: An Empirical AWS IoT Greengrass Architecture for Industrial Predictive Maintenance

    Oct 10, 2026Prince Kwabena Appiah Boadu, Jeffery Baafi Kyei, Enoch Kofi Koranteng +1Edge InferenceIndustrial Internet of Things

    Department of Computer Engineering, Kwame Nkrumah University of Science and Technology, Kumasi, Ghana

  17. EV-JEPA: Elastic V-JEPA for Any Device and Cross-Device Inference

    Oct 9, 2026Anxhelo Diko, Jieyu Lin, Stefano Ambrogio +5Elastic Neural NetworksEdge-Cloud Collaborative Inference

    Meta Reality Labs Research · FAIR at Meta

  18. Multi-Source and Multi-Dimensional Information Fusion in Resource-Constrained Edge Networks

    Oct 9, 2026Yushi Wang, Zhengxin Yu, Guhan Zheng +2Multimodal FusionEdge Computing

    School of Computing and Communications, Lancaster University, LA1 4YW, U.K. · School of Communication and Information Engineering, Shanghai University, 200444, China · Department of Computer Science, University of Exeter, EX4 4QF, U.K. +1

  19. UltraLight Luma: A Novel Edge-Deployable Perception Network for Crop-Row Segmentation in Agricultural Robotics

    Oct 8, 2026Dhanushka Balasingham, Shamod Ginigaddarage, Hanojhan Rajahrajasingh +2Image SegmentationAgricultural Robotics

    Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka · Lincoln Centre for Autonomous Systems (L-CAS), University of Lincoln, UK

  20. Agentic Design Space Exploration for Joint Hardware Configuration Selection and Mapping of AI Inference Workloads on Heterogeneous Edge SoCs

    Oct 5, 2026Geetha Prasuna Yarramneni, Surya Selvam, Wilfried Haensch +1Hardware-Software Co-DesignElectronic Design Automation

    Elmore Family School of ECE, Purdue University, West Lafayette, IN, USA · Pritzker School of Molecular Engineering, University of Chicago, Chicago, IL, USA · Argonne National Laboratory, Argonne, IL, USA

  21. Rethinking Streaming-Perception Evaluation on Heterogeneous Edge Platforms

    Oct 4, 2026Misun Yu, Jinyoung Moon, Jemin LeeEdge InferenceHeterogeneous Computing

    Electronics and Telecommunications Research Institute (ETRI), Daejeon, Republic of Korea · Division of Electronics and Information Engineering, Jeonbuk National University, Jeonju, Republic of Korea

  22. SFlexRCA: Lightweight, Scalable, and Flexible Root Cause Analysis for IIoT Edge Systems

    Oct 4, 2026Amr M. Zaki, Farhoud Jafari, Honggeun Ji +2Industrial Internet of ThingsRoot Cause Analysis

    Lassonde School of Engineering, York University, Toronto, ON, Canada

  23. RepTC: Representation-Aware Optimization for Efficient Traffic Classification on Edge IoT Devices

    Oct 3, 2026Adel Chehade, Edoardo Ragusa, Paolo Gastaldo +1Edge InferenceCost-Aware Inference

    Department of Naval, Electrical, Electronic and Telecommunications Engineering (DITEN), University of Genoa, 16126 Genoa, Italy

  24. Learning While Inferring: Local and Parallel Learning for Edge SNNs across Sensing Modalities

    Oct 2, 2026Yanxun Zhang, Yifei Wang, Changze Lv +6Spiking Neural NetworksOn-Device Training

    College of Computer Science and Artificial Intelligence, Fudan University · Shanghai Key Laboratory of Intelligent Information Processing · School of Software Technology, Zhejiang University

  25. Embedded Bi-Temporal Building Damage Assessment for On-Board Data Reduction

    Sep 29, 2026Thomas Goudemant, Benjamin Francesconi, Marjorie Bellizzi +1Disaster Damage AssessmentBuilding Damage Assessment

    IRT Saint Exupéry, France · CNES, France

  26. A packet-level digital hardware twin for commissioning megahertz diagnostic edge AI and plasma control system integration in tokamaks

    Sep 27, 2026Semin Joung, Abhilasha Dave, Luca Scomparin +6Edge InferenceDigital Twins

    Department of Nuclear Engineering and Engineering Physics, University of Wisconsin–Madison, Madison, WI, USA · SLAC National Accelerator Laboratory, Menlo Park, CA, USA

  27. CSCWD: Cross-Scale Channel-wise Knowledge Distillation for Lightweight Tiny Object Detection on Edge Devices

    Sep 24, 2026Amir Zamani, Zeinab Ghasemi-NaraghiSmall Object DetectionEfficient Object Detection

    Department of Computer Engineering, Islamic Revolution Comprehensive University, Tehran, Iran · Department of Computer Engineering, K.N. Toosi University of Technology, Tehran, Iran

  28. RAMP: Robust Adaptive Mixed-Precision Quantization for Edge CPU Vision Models

    Sep 23, 2026David Población-Criado, Dario Garcia-Gasulla, Eduardo QuinonesMixed-Precision QuantizationEdge Inference

    Barcelona Supercomputing Center (BSC) · Universitat Politècnica de Catalunya - BarcelonaTech (UPC)

  29. GTR: Gated Token Recurrence for Efficient Dense Prediction

    Sep 22, 2026Zhe Feng, Longfei Liu, Wei Liu +7Efficient Neural Network InferenceGated Attention

    Didi International Business Group · Intellindust AI Lab · Institute of Automation, Chinese Academy of Sciences +2

  30. Empirical Auditing of Edge-Private Graph Generators

    Sep 21, 2026Anum Fatima, Stratis Limnios, James Adams +4Privacy AuditingEdge Inference

    Department of Statistics University of Oxford Oxford, United Kingdom · Plenitude Consulting, London, United Kingdom · National Physical Laboratory Teddington, United Kingdom +3