On-Device Inference

Latest papers 117

All topics
CardsList
  1. Right In-Place (RiP) Convolution: A Simple, General, and Near-Optimal Strategy for Memory-Efficient CNN Inference

    Sep 30, 2026Opegbemi Matthias Busoye, Tolulope Matthew Busoye, Eghonghon-aye EigbeMemory-Efficient InferenceConvolutional Neural Networks

  2. Bad: Taming the Bioacoustic Data Deluge with a Bat Activity Detector

    Sep 29, 2026Stefano Ciapponi, Santiago Martinez Balvanera, Andrea Cesaretti +2Sound Event DetectionBioacoustics

  3. Sol-H3: Recursive Self-Improvement for MiniMax-H3 Inference Acceleration on Sol-Engine across Cloud and Edge

    Sep 28, 2026Yitong Li, Jincheng Yu, Junsong Chen +6Video Diffusion ModelsGPU Kernel Optimization

  4. Sub-Model Short-Term Memory Convolutions for Keyword Spotting Systems on Device

    Sep 28, 2026Paweł Warlewski, Artur Czeczko, Artur Szumaczuk +2Keyword SpottingSpeech Processing

  5. Does per-frame early exit pay? A compute-matched study of dynamic depth for on-device speech enhancement

    Sep 24, 2026Clément Laroche, Riccardo MicciniEfficient Neural Network InferenceSpeech Enhancement

  6. Edge AI on Constrained Devices for Binary Sleep-Wake Classification in Dynamic Environments

    Sep 24, 2026Stefan Reitmann, Lena OdenTime Series ClassificationWearable Sensing

  7. Leveraging Industrial Foundation Models at the Edge of Particle Physics Detectors via Distillation Learning and Hardware Co-design

    Sep 20, 2026Gia Ancone, Qibin Liu, Liangyu Wu +1High-Energy PhysicsTime-Series Foundation Models

  8. VLA-ULAP: Interleaving Cloud VLA Calls with Ultra-Lightweight Local Action Prediction at the Edge

    Sep 16, 2026Deyu Cao, Ryuji Oi, Kosuke Matsushima +4Efficient VLA Model InferenceVision-Language-Action Models

  9. Efficient AI Model Deployment Using Quantization Analysis Tool

    Sep 14, 2026Dwith Chenna, Kanishka MacherlaEfficient Neural Network InferenceNeural Network Quantization

  10. Affective Agent: On-Device Personalized Intervention Reasoning for Wearable Systems

    Sep 14, 2026Reina Mun, Zishen Wan, Vijay Janapa ReddiMemory-Augmented AgentsAffective Computing

  11. HoliBench: A Cross-Platform Benchmarking and Deployment Toolkit for Foundation Models in CPS-IoT Applications

    Sep 14, 2026Inesh Chakrabarti, Zejun Xiong, Pragya Sharma +1Cyber-Physical SystemsEfficient Neural Network Inference

  12. FORGE: Forward-Only Test-Time Adaptation for Integer-Only Vision Models on Microcontrollers

    Sep 1, 2026Muhammad Rehan, Haider Ali, Muhammad Ali Munir +1Test-Time AdaptationOn-Device Inference

  13. Development and Feasibility Evaluation of an Edge AI as Medical Device System for Breast Cancer Multidisciplinary Team Meetings

    Aug 22, 2026Aarzoo Dhiman, Farzana Haque, Iqtedar Muazzam +3Breast CancerClinical Decision Support

  14. BoltNet: An Ultra-Lightweight Convolutional Network for On-Device Plant Species Identification

    Aug 12, 2026Daniel Rossi, Guido Borghi, Roberto VezzaniFine-Grained Image ClassificationLightweight CNNs

  15. MiCoPro: End-to-End Mixed Precision HW/SW Co-design with HW-aware Proxy Model

    Aug 7, 2026Zijun Jiang, Yangdi LyuMixed-Precision QuantizationEfficient Neural Network Inference

  16. LiteKD-Net: Lightweight Knowledge-Distilled Network for Mobile Image Denoising

    Aug 6, 2026Zhou ZhiyiLightweight CNNsOn-Device Inference

  17. Bimanual Manipulation Within an 8 GB Budget: Zero-Copy Sensing and Quantized ACT on an Entry-Level Jetson

    Aug 4, 2026Ekansh Singh, Eva Samuel, Alessandra Reneau +2Bimanual Robotic ManipulationRobot Imitation Learning

  18. PhyAI: Real-Time Physical AI at the Edge, Scalable Rollouts in the Cloud

    Aug 4, 2026Chenghua Wang, Daliang Xu, Dongqi Cai +21Efficient VLA Model InferenceOn-Device Inference

  19. XiDepth: a Lightweight and Efficient Network for Self-supervised Monocular Depth Estimation

    Aug 4, 2026Elena Izzo, Riccardo Toniolo, Lamberto BallanEnergy-Efficient MLMonocular Depth Estimation

  20. An Embedded RISC-V Evaluation of Kolmogorov--Arnold Networks in Hard-Constrained Recurrent Physics-Informed Models

    Aug 1, 2026Enzo Nicolas Spotorno, Josafat Leal FilhoEfficient Neural Network InferenceKolmogorov-Arnold Networks

  21. Towards Autonomous Aircraft Surveillance from Nanosatellites through On-Board Inference and Generative Data Augmentation

    Jul 30, 2026Antonio Delgado-Rosa, David Muñoz-Valero, Enrique Adrian Villarrubia-Martin +1Synthetic Data AugmentationRemote Sensing

  22. Device-First Feedback: Toward Mobile-Native LLM-Driven Neural Architecture Search

    Jul 29, 2026Saif U Din, Muhammad Ahsan Hussain, Radu Timofte +1Large Language Model-Guided NASHardware-Aware NAS

  23. VibeVoice-ASR-BitNet Technical Report

    Jul 23, 2026Songchen Xu, Ting Song, Shaohan Huang +10Efficient Neural Network InferenceAutomatic Speech Recognition

  24. Taming the Security-Energy Paradox: A Green AI Approach to Optimized Android Malware Detection

    Jul 22, 2026Shrinidhi Sridhar, Vikas K. MalviyaEnergy-Efficient MLAndroid Malware Detection