State-Augmented Learning for Post-Deployment Adaptation of Coexisting O-RAN Applications
Organizations: Department of AI-Semiconductor, Hanyang University, Seoul, Korea · Department of Electronic Engineering, Hanyang University, Seoul, Korea
Abstract
Fixed control policies in Open RAN can require retraining when service requirements, traffic loads, or interacting applications change. We propose ATTUNE, a state-augmented learning method for an energy saving application that coexists with a learned mobility load balancing application under a service constraint. ATTUNE conditions the energy saving policy on a Lagrange multiplier and updates this scalar during operation using measured service degradation, while keeping both applications' network parameters fixed. To train a single policy across service requirements, ATTUNE samples target service levels uniformly and maps them to multipliers through an adaptive table. This procedure accounts for policy-dependent multiplier responses and improves energy savings compared with training over a widened fixed multiplier range. We characterize the induced distribution of service levels and the convergence and fluctuations of the online update. An exact finite-window identity establishes convergence of average measured degradation to the target when the projection corrections vanish on average. Simulations show that a single ATTUNE policy achieves energy savings comparable to policies trained separately for each service requirement. It adapts to changes in the target, load, and partner application without retraining, increases energy savings at light load, and maintains target tracking for separately trained application pairs. No statistically significant increase in cell switching is detected in the evaluated comparisons.
Figures & tables
| Method | Policy input | Training conditions | Deployment update |
|---|---|---|---|
| ACCORD [ 5 ] | Observation | Multiplier updated for fixed | None; fixed policy |
| Calvo-Fullana et al. [ 6 ] | State, multipliers | Sampled multipliers; distribution not prescribed | Online dual update |
| NaderiAlizadeh et al. [ 7 ] | State, dual variables | Fixed multiplier sampling distribution | Periodic dual update |
| CCPO [ 12 ] | State, threshold | Selected training thresholds | None; prescribed threshold input |
| ATTUNE | Observation, multiplier (ES only) | Uniform service targets mapped to multipliers via an adaptive table | Measurement-based multiplier update; fixed network parameters |
| ( ) | ( ) | ( ) | ||||
|---|---|---|---|---|---|---|
| Training distribution | Difference | Seeds | Difference | Seeds | Difference | Seeds |
| Fixed range | 2/5 | 4/5 | 1/5 | |||
| Widened range | 4/5 | 4/5 | 5/5 | |||
| Adaptive range | 5/5 | 5/5 | 5/5 | |||
| Target-uniform (ATTUNE) | 5/5 | 5/5 | 5/5 | |||
| Specialized ACCORD | 21.1 | 5/5 | 25.4 | 5/5 | 32.0 | 5/5 |
| ( ) | ( ) | ( ) | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Method | Off | Rev. | Share [%] | Off | Rev. | Share [%] | Off | Rev. | Share [%] |
| Rule-based pair [ 5 ] | 6.66 | 4.47 | 67 [52, 72] | 11.41 | 9.08 | 80 [76, 82] | 17.68 | 15.78 | 89 [88, 90] |
| Specialized ACCORD | 7.88 | 2.82 | 36 [33, 39] | 8.42 | 2.71 | 32 [28, 36] | 9.02 | 2.63 | 29 [28, 31] |
| ATTUNE, fixed | 9.46 | 3.83 | 41 [38, 44] | 8.86 | 3.04 | 34 [32, 37] | 6.84 | 1.56 | 23 [20, 25] |
| ATTUNE, online update | 9.30 | 3.84 | 41 [39, 44] | 8.71 | 2.90 | 33 [30, 36] | 7.02 | 1.75 | 25 [21, 29] |
| Condition | Metric | Multiplier input | Threshold input | ||
|---|---|---|---|---|---|
| Closed (ATTUNE) | Open | Open (CCPO-style) | Closed | ||
| Same pairs | Within | 15/15 | 6/15 | 8/15 | 14/15 |
| ( ) | 14/15 | 11/15 | 9/15 | 8/15 | |
| Above / below | 0/0 | 2/7 | 3/4 | 0/1 | |
| Saving [%] | 26.2 | 25.4 | 25.5 | 25.8 | |
| Load | Within | 9/15 | 3/15 | 3/15 | 7/15 |
| Closed loop (ATTUNE) | Open loop | |||||
|---|---|---|---|---|---|---|
| Pair (training load) | Saving | Rev. share | ||||
| Same load (100/100) | 20/20 | 0.049 | 25.2% | 34% | 6/20 | 0.051 |
| ES 100, MLB 75 | 18/20 | 0.052 | 22.6% | 40% | 0/20 | 0.077 |
| ES 75, MLB 100 | 12/20 | 0.055 | 22.4% | 51% | 0/20 | 0.135 |
Open Radio Access Network
Open Radio Access Network (O-RAN) research studies disaggregated, programmable wireless networks and the intelligence that manages them.
See all 35 papers