ReLMXEL: Adaptive RL-Based Memory Controller with Explainable Energy and Latency Optimization
Organizations: Department of Mathematics and Computer Science, Sri Sathya Sai Institute of Higher Learning · Department of Computer Science and Engineering, Indian Institute of Technology Ropar · AI Performance Engineer, Red Hat
Abstract
Reducing latency and energy consumption is critical to improving the efficiency of memory systems in modern computing. This work introduces ReLMXEL (Reinforcement Learning for Memory Controller with Explainable Energy and Latency Optimization), a explainable multi-agent online reinforcement learning framework that dynamically optimizes memory controller parameters using reward decomposition. ReLMXEL operates within the memory controller, leveraging detailed memory behavior metrics to guide decision-making. Experimental evaluations across diverse workloads demonstrate consistent performance gains over baseline configurations, with refinements driven by workload-specific memory access behaviour. By incorporating explainability into the learning process, ReLMXEL not only enhances performance but also increases the transparency of control decisions, paving the way for more accountable and adaptive memory system designs.
Figures & tables
| Workload | Time Steps | Threshold | Baseline Reward | ReLMXEL Reward | Average Energy (%) | Average Bandwidth (%) | Average Latency (%) |
| STREAM | 20170 | 16000 | 15555.06 | 17597.07 | 3.84 | 8.39 | 0.23 |
| GEMM | 19468 | 17000 | 6572.88 | 7121.46 | 3.83 | 4.95 | 0.01 |
| BFS | 17995 | 14000 | 9673.14 | 10842.41 | 7.66 | 7.22 | -0.03 |
| fotonik_3d | 20770 | 17000 | 4870.89 | 9165.52 | 7.66 | 2.90 | 0.07 |
| xalancbmk | 16494 | 14000 | 3092.9 | 3320.38 | 7.68 | 107.03 | -0.02 |
| gcc | 17863 | 14000 | 9154.29 | 9556.25 | 7.66 | 1.70 | -0.24 |
RL Control
Reinforcement learning control uses reward-driven learning to make decisions in dynamic systems, from robots and vehicles to energy and infrastructure.
See all 272 papers