Power-Efficient Inference

Ask about this topic

Latest papers

CardsList

17 papers3 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

  1. Energy-Aware Open-Vocabulary Detection Scheduling for Low-Power Robotic Autonomy

    Nov 5, 2026Abdul Basit, Muhammad ShafiquePower-Efficient InferenceOpen-Vocabulary Object Detection

    eBRAIN Lab, New York University Abu Dhabi, Abu Dhabi, UAE

  2. Quantized Edge Inference of a Self-Supervised SAR-Optical Encoder on Commodity x86 Hardware

    Oct 27, 2026Christian Sanchez-Leon, Dongming ChenEfficient Transformer InferenceEdge Inference

    Software College, Northeastern University, Shenyang 110819, China

  3. Thermal-Headroom Routing for Efficient Robot Perception in Extreme Heat

    Oct 26, 2026Sparsh Roy, Kevin Zhou, Arhaan Shah +4Power-Efficient InferenceAdaptive Inference

    Massachusetts Institute of Technology, Cambridge, MA, USA · Hopewell Valley Central High School, Pennington, NJ, USA · Paradise Valley High School, Phoenix, AZ, USA

  4. ActTune: Action-Aware Precision and GPU Operating-Point Adaptation for Energy-Efficient Vision-Language-Action Inference

    Oct 6, 2026Zou Qingyun, Bin Gao, Wenju Zhao +3Energy-Efficient MLVLM Quantization

    National University of Singapore · Huazhong University of Science and Technology

  5. Sparse by Command: Task-Conditional Compute Skipping for Multi-Task Inference Accelerators

    Jul 24, 2026Afzal Ahmad, Gaoyu Mao, Shoubo Hu +4Structured SparsityFPGA-Based Neural Network Acceleration

    The Hong Kong University of Science and Technology · Huawei Noah’s Ark Lab · The Hong Kong University of Science and Technology (Guangzhou)

  6. Mitigating Compiler Fusion-Induced Power Bursts in Mobile NPU Inference as the Battery Depletes

    Jul 17, 2026Ryoga Yuzawa, Masayoshi TomizukaEnergy-Efficient MLPower-Efficient Inference

    UC Berkeley · Sony · Visiting researcher at University of California, Berkeley.

  7. EnerInfer: Energy-Aware On-Device LLM Inference

    Jun 22, 2026Bohua Zou, Nian Liu, Binqi Sun +6On-Device Language Model InferenceLLM Inference Acceleration

    Technical University of Munich · Shanghai Jiao Tong University · Huawei Hilbert Research Center (Dresden) +1

  8. Does Mixture-of-Experts Actually Help Inference on Consumer and Edge Hardware? An Empirical Study

    Jun 19, 2026Alfarizy Alfarizy, Hung Truong Thanh Nguyen, René Richard +2LLM Inference EfficiencyOn-Device Language Model Inference

    Analytics Everywhere Lab, University of New Brunswick, Fredericton, NB, Canada · TSAI Lab, University of New Brunswick, Fredericton, NB, Canada

  9. TFZ-Tree: An Ultra-Lightweight Waveform Classification Framework for Resource-Constrained Devices

    May 15, 2026Hao Wang, Kuang Zhang, Yonggang Chi +3Efficient InferenceInternet of Things

  10. Token Arena: A Continuous Benchmark Unifying Energy and Cognition in AI Inference

    May 1, 2026Yuxuan Gao, Megan Wang, Yi Ling YuLLM EvaluationEnergy-Efficient ML

    University of Pennsylvania · OpenMesh AI · Columbia University

  11. LLM-Guided Runtime Parameter Optimization for Energy-Efficient Model Inference

    Apr 29, 2026Katelyn Crumpacker, Dimitrios NikolopoulosLLM Inference EfficiencyEnergy-Efficient ML

    Virginia Polytechnic and State University

  12. KAIROS: Stateful, Context-Aware Power-Efficient Agentic Inference Serving

    Apr 17, 2026Yichao Yuan, Mosharaf Chowdhury, Nishil TalatiEfficient InferenceLLM Inference Serving

    University of Illinois, Urbana Champaign Urbana, IL, USA · University of Michigan Ann Arbor, MI, USA

  13. CADENCE: Context-Adaptive Depth Estimation for Navigation and Computational Efficiency

    Apr 8, 2026Timothy K Johnsen, Marco LevoratoPower-Efficient InferenceAdaptive Computation

    Computational Science joint program with San Diego State University and The University of California, Irvine in CA, USA · Computer Science department at the University of California, Irvine in CA, USA

  14. Energy Efficient Software Hardware CoDesign for Machine Learning: From TinyML to Large Language Models

    Mar 24, 2026Mohammad Saleh Vahdatpour, Yanqing ZhangPower-Efficient InferenceEnergy-Efficient ML

    Department of Computer Science Georgia State University Atlanta, GA, USA

  15. Covariance-Guided Resource Adaptive Learning for Efficient Edge Inference

    Mar 15, 2026Ahmad N. L. Nabhaan, Zaki Sukma, Rakandhiya D. Rachmanto +4Power-Efficient InferenceInference-Time Optimization

    Universitas Amikom Yogyakarta, Department of Informatics · University of Georgia, School of Computing · Universitas Gadjah Mada, Department of Computer Science and Electronics +1

  16. Hardware Efficient Approximate Convolution with Tunable Error Tolerance for CNNs

    Mar 10, 2026Vishal Shashidhar, Anupam Kumari, Roy P PailyEfficient Neural Network InferenceNeural Network Hardware Acceleration

    Department of Electronics and Electrical Engineering, Indian Institute of Technology Guwahati

  17. Inference Energy and Latency in AI-Mediated Education: A Learning-per-Watt Analysis of Edge and Cloud Models

    Mar 4, 2026Kushal KhemaniPower-Efficient InferenceOn-Device Language Model Inference

    Billabong High International School, Hadapsar, Pune, 411028, Maharashtra, India.