On-Device Inference

Ask about this topic

Momentum

11 papers in the last four weeks, up 175% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 117

All topics
CardsList

  1. DepthART: Scaling Foundation Monocular Depth to Tiny Models

    Jul 19, 2026Feng Xue, Wu Chen, Mingshuai Zhao +7Metric Depth EstimationMonocular Depth Estimation

    University of Trento Trento, Italy · Beijing University of Posts and Telecommunications Beijing, China · The Hong Kong University of Science and Technology Hong Kong, China +1

  2. Mitigating Compiler Fusion-Induced Power Bursts in Mobile NPU Inference as the Battery Depletes

    Jul 17, 2026Ryoga Yuzawa, Masayoshi TomizukaEnergy-Efficient MLOn-Device Inference

    UC Berkeley · Sony · Visiting researcher at University of California, Berkeley.

  3. Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference

    Jul 14, 2026Zebin Yang, Qi Wang, Yunhe Wang +6Efficient VLA Model InferenceVision-Language-Action Models

    Peking University · PrimeBot Research Institute · AIRS

  4. MobileSAM2: Lightweight Segment Anything for Spatial Intelligence

    Jul 14, 2026Kai Jiang, Jiaxing Huang, Jingyi Zhang +5Video Object SegmentationSegment Anything Models

    Hong Kong Polytechnic University, HK, China · Nanyang Technological University, Singapore · Xidian University, China +1

  5. NanoVSR: Towards Real-Time Video Super-Resolution on Edge Devices

    Jul 11, 2026Filip Pawlicki, Marcel Kańduła, Marcin Pucek +1Edge ComputingVideo Super-Resolution

    Gdańsk University of Technology, Faculty of Electronics, Telecommunications and Informatics, Department of Computer Architecture, Gdańsk, Poland · Gdańsk University of Technology, Faculty of Electronics, Telecommunications and Informatics, Department of Software Engineering, Gdańsk, Poland

  6. Adaptive Model Compression (AMC): Saliency-Driven Resource Allocation for Ultra-Low-Power Transformer Inference

    Jul 11, 2026Jiayin Hu, Kai Yuan, Vanessa Hu +3Efficient Transformer InferenceModel Compression

    Apple USA

  7. WaveNet-Style Guitar Amplifier Model Pruning for Real-Time iOS Deployment

    Jul 11, 2026Ryota Sato, Eli SilversteinEfficient Neural Network InferenceOn-Device Inference

    Dept. of Electrical Engineering Stanford University Stanford, USA

  8. STEEL: Sparsity-Aware Fused Attention for Energy-Efficient Long-Sequence Inference on AMD's XDNA NPU

    Jul 10, 2026Victor J. B. Jung, Gagandeep Singh, Joseph Melber +3Efficient Transformer InferenceEnergy-Efficient ML

    Integrated Systems Laboratory (IIS), ETH Zürich, Switzerland. · AMD Research and Advanced Development (RAD). · Department of Electrical, Electronic and Information Engineering (DEI), University of Bologna, Italy.

  9. ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device

    Jul 9, 2026Fabio Tosi, Luca Bartolomei, Matteo Poggi +1Efficient Neural Network InferenceMonocular Depth Estimation

    University of Bologna, Bologna, Italy

  10. A Quantized Native Runtime for On-Device Semantic Audio Generation

    Jul 9, 2026Matteo Spanio, Antonio RodàText-to-Audio GenerationControllable Music Generation

    Centro di Sonologia Computazionale (CSC) · Dept. of Information Engineering, University of Padova

  11. LEXIC: Lightweight On-Device Decoding of Reading Comprehension from Eye Movements

    Jul 9, 2026Sumin Lee, Kyeonghun Kim, Subeen Lee +5Recurrent Neural NetworksEye Tracking

    Seoul National University · OUTTA · NVIDIA

  12. Rethinking Small VLM Quantization: From Component-Wise Analysis to Hardware-Aware Edge Deployment

    Jul 9, 2026Hyeju Shin, Chorwon Kim, Ryangsoo Kim +2Mixed-Precision QuantizationVision-Language Models

    1ETRI, Republic of Korea.

  13. ECGLight: Compute-Light Framework For Paper ECG Digitization and Myocardial Infarction Screening

    Jul 8, 2026Shreyasvi Natraj, Cyrus Achtari, Felice Gragnano +3ElectrocardiographyElectrocardiogram Classification

    Spinal Cord and Artificial Intelligence (SCAI) Lab, ETH Zürich, Zürich, Switzerland · Swiss Paraplegic Research, Nottwil, Luzern, Switzerland · Department of Translational Medical Sciences, University of Campania “Luigi Vanvitelli”, Naples, Italy +1

  14. Low-Power License Plate Detection and Recognition on a RISC-V Multi-Core MCU-Based Vision System

    Jul 7, 2026Lorenzo Lamberti, Manuele Rusci, Marco Fariselli +2Energy-Efficient MLTiny ML

    Department of Electrical, Electronic and Information Engineering - University of Bologna, Italy · GreenWaves Technologies, Grenoble, France · Integrated System Laboratory - ETH Zurich, Switzerland

  15. CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation

    Jul 4, 2026Xuyao Huang, Zelai Deng, Xu Wang +2Camera-Controlled Video GenerationImage-to-Video Generation

    Shanghai Jiao Tong University · Nankai University · Transsion

  16. GeoSAM-Lite: A Lightweight Foundation Model for Onboard Remote Sensing Segmentation

    Jul 4, 2026Yongcong Wang, Jie Zhang, Rui Jiang +3Remote Sensing Image SegmentationGeospatial Foundation Models

    College of Telecommunications and Information Engineering, Nanjing University of Posts and Telecommunications, Nanjing 210003, China

  17. OpenGlass: A Sensing-Computing Split Architecture for Local MLLM-Driven Real-Time Visual Assistance

    Jul 3, 2026Mengzhang Li, Yuan YaoEfficient Multimodal InferenceOn-Device Inference

    Shanghai Qizhi Institute · College of AI, Tsinghua University

  18. Cross-device Collaborative Test-time Adaptation with Zeroth-order Optimization and Model Merging

    Jul 3, 2026Yu Mitsuzumi, Akisato Kimura, Yasuhiro Fujiwara +1Test-Time AdaptationOn-Device Inference

    NTT, Inc. · Kyoto University

  19. Embodied.cpp: A Portable Inference Runtime of Embodied AI Models on Heterogeneous Robots

    Jul 2, 2026Ling Xu, Chuyu Han, Borui Li +6Efficient Neural Network InferenceEfficient VLA Model Inference

    Southeast University · Nanjing University · Microsoft Research +1

  20. NPUsper: Eliminating Redundant Computation for Real-Time Whisper on Mobile NPUs

    Jul 1, 2026Sihyeon Lee, Hojeong Lee, Sungwon Woo +3Efficient Transformer InferenceStreaming ASR

    Korea University · University of Wisconsin–Madison

  21. SoK: Attack and Defense Landscape of Mobile On-device AI Systems

    Jul 1, 2026Yujin Huang, Xin Zheng, Xingliang Yuan +1On-Device Inference

    The University of Melbourne · RMIT University · Nanyang Technological University

  22. Detecting Audio Deepfakes on the Edge:Lightweight SSL-Based Detection in a Browser Plugin

    Jun 29, 2026Octavian Pascu, Dan Oneata, Horia Cucu +1Audio Deepfake DetectionOn-Device Inference

    National University of Science and Technology POLITEHNICA Bucharest, Romania · Fraunhofer AISEC, Germany

  23. JuZhou 1.0 Technical Report: The First Edge-Native Text-to-Image Foundation Model Trained Entirely on China-Developed AI Accelerators

    Jun 25, 2026Ce Chen, Congrui Wang, Yonglin Li +20T2I GenerationDiffusion Model Inference Acceleration

    JuZhou Team, HSW Group

  24. AnySimLite: A Lightweight Few-Shot Similarity Encoder for On-Device Speech-Adjacent Classification

    Jun 24, 2026Sourav Ghosh, Yash Bhatia, Keshav Goyal +3Semantic Textual SimilarityText Classification

    Samsung R&D Institute Bangalore, India · ITBHU

  25. Lightweight Transformer Models for On-Device Fault Detection: A Benchmark Study on Resource-Constrained Deployment

    Jun 23, 2026Disha PatelEfficient Transformer InferenceAdaptive Inference

    Department of Computer Science California State University, Fullerton

  26. Towards Whole Hand and Wrist Kinematic Tracking with a Wearable A-Mode Ultrasound Probe

    Jun 21, 2026Giusy Spacone, Luca Benini, Andrea CossettiniWearable SensingIncremental Learning

    Integrated Systems Laboratory, ETH Zurich, Zürich, Switzerland · DEI, University of Bologna, Bologna, Italy

  27. Execution-State Capsules: Graph-Bound Execution-State Checkpoint and Restore for Low-Latency, Small-Batch, On-Device Physical-AI Serving

    Jun 18, 2026Liang SuLLM Inference ServingLLM Inference Acceleration

  28. Embedded Machine Learning for Microcontroller-Class Edge Devices: Data, Feature, Evaluation, and Deployment Pipelines

    Jun 16, 2026Mostafa DarvishiEfficient Neural Network InferenceKeyword Spotting

  29. From Compression to Deployment: Real-Time and Energy-Efficient FastGRNN on Ultra-Constrained Microcontrollers

    Jun 15, 2026Emre Can KizilatesEfficient Neural Network InferenceRecurrent Neural Networks

    Independent Researcher, Izmir, Turkey

  30. An affordable hardware-aware neural architecture search for deploying convolutional neural networks on ultra-low-power computing platforms

    Jun 15, 2026Andrea Mattia Garavagno, Edoardo Ragusa, Antonio Frisoli +1Efficient Neural Network InferenceTiny ML

    Dept. of Electrical, Electronic, Telecommunications Engineering and Naval Architecture (DITEN), University of Genoa, Genoa, Italy · Department of Excellence in Robotics & AI and Institute of Mechanical Intelligence, Scuola Superiore Sant’Anna, 56127 Pisa, Italy