Dynamical low-rank equilibrium computation for stochastic games between advanced persistent threats and moving target defense
Organizations: College of Control Science and Engineering, Zhejiang University, PC 310027, China · Alibaba Group, Hangzhou, China
Abstract
Moving target defense (MTD) against advanced persistent threats (APTs) in industrial control systems (ICS) has well-established game-theoretic formulations, but their practical value hinges on equilibrium computation, which faces two gaps: full-rank value iteration is prohibitively expensive at industrial scale, and the resulting defense strategies admit no certified robustness against adversarial perturbations. We first reveal that the attack and defense influence matrices of ICS dynamics are intrinsically low-rank: APTs infiltrate through a handful of entry points and MTD reconfigures only a few components per cycle. Our theory makes four contributions. First, an augmented gradient matrix certifies that the low-rank structure propagates through the non-smooth Bellman operator of the zero-sum stochastic game, so that every Bellman target lies near a low-dimensional subspace and low-rank truncation incurs an explicit error bound (Lemma 1, Theorem 1). Second, we propose the Dynamical Low-Rank Nash Equilibrium algorithm, named DLR-NE, which augments the rank-r search space each iteration, regularizes the core matrix spectrum, and retracts via truncated SVD, and prove that it converges geometrically to a neighborhood whose error decomposes into five physically interpretable sources (Theorem 2). Third, its per-step cost is O(nr^2), a Theta(n/r^2) speedup over full-rank value iteration (Theorem 3). Fourth, a single weight trades accuracy against a certified sensitivity bound of the induced defense strategy under core-matrix perturbations (Corollary 1). Six experiments on a nonlinear power-system testbed confirm each prediction, with 94% parameter compression at 2.3% utility loss. All experimental data and code are publicly available.
Figures & tables
| Exp. | Theoretical prediction | Measured result |
|---|---|---|
| 1 | Thm. 1 : truncation error bounded by the EYM certificate; ICS coupling is low-rank | error for , orders below the certificate; spectrum cliffs at |
| 2 | Thm. 2 : geometric decay then a plateau set by five error sources | two phases on all configurations; dominates the plateau ( ); a priori bound vs. measured plateau (conservative) |
| 3 | Thm. 3 : per-step , speedup | log–log slopes consistent with vs. ; FLOPs speedup at |
| 4 | Cor. 1 : linear sensitivity with a -tunable constant | per-network linear, , ; : as |
| 5 | Thms. 1 + 3 : convex compression–accuracy frontier | : parameter cut at utility loss |
| 6 | Lem. 1 + Assump. 4 (c): both mechanisms necessary | Fixed-Basis stagnates; No-Retraction destabilizes late; full algorithm stable at a low plateau |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Category | Parameter | Value |
| System | State dimension | (default ) |
| Hidden width | ||
| Attacker coupling rank | ||
| Defender coupling rank | ||
| Reward coupling rank | ||
| Discount factor |