cs.LGNov 8, 2026

Jointly Optimizing Memory, Computing and Offloading for Energy-Efficient DNN Inference

Authors: Yunchu Han, Zhaojun Nan, Sheng Zhou, Zhisheng Niu

Organizations: Beijing National Research Center for Information Science and Technology, Department of Electronic Engineering, Tsinghua University, Beijing 100084, China · School of Electronics and Internet of Things, Chongqing Polytechnic University of Electronic Technology, Chongqing 401331, China

Abstract

In edge intelligence systems, computation offloading and dynamic voltage and frequency scaling (DVFS) are widely used to improve energy efficiency. However, as applications like deep neural network (DNN) inference evolve in complexity, their demands for memory resources have progressively increased, establishing memory as a critical bottleneck that impacts both latency and energy consumption. In this paper, we propose a joint optimization scheme integrating memory, computing and offloading for energy-efficient DNN inference. We formulate the energy minimization problem under deadline constraints as a mixed-integer nonlinear programming (MINLP) problem, where the main challenge arises from the coupling between offloading and resource optimization. To address this issue, we decompose the original problem into two subproblems under a fixed offloading policy. The local subproblem is transformed into an equivalent geometric programming (GP) problem to derive the optimal memory frequency and computing frequency, while the edge subproblem is solved via convex optimization. An efficient coordinate descent (CD) algorithm is further developed to jointly optimize all variables. Simulation results demonstrate that our proposed algorithm achieves near-optimal performance with the gap from the optimal policy being at most 9.3%, and reduces the energy consumption of devices by up to 16.1% compared with benchmarks without memory frequency optimization.

Figures & tables

Explore similar work

CardsList
  1. Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference

    Aug 14, 2026Yunchu Han, Zhaojun Nan, Sheng Zhou +1Efficient Neural Network InferenceEnergy-Efficient ML

  2. SparseDVFS: Sparse-Aware DVFS for Energy-Efficient Edge Inference

    Mar 23, 2026Ziyang Zhang, Zheshun Wu, Jie Liu +1Efficient Neural Network InferenceEnergy-Efficient ML

  3. Safe Multi-Agent Deep Reinforcement Learning for Privacy-Aware Edge-Device Collaborative DNN Inference

    Feb 23, 2026Hong Wang, Xuwei Fan, Zhipeng Cheng +4Safe MARLHierarchical MARL