AT-SKM-Net: An Accelerated Trainable Sampling Kaczmarz-Motzkin Framework for Linear Hard-Constraint Feasibility on Dynamic Graphs
Organizations: Zhejiang University
Abstract
Graph-structured optimization with linear constraints is fundamental to critical infrastructure but faces scalability limits due to massive strict hard constraints and high dimensionality. While recent projection-based methods such as Trainable Sampling Kaczmarz-Motzkin Net (T-SKM-Net) guarantee feasibility, they face high computational costs in dynamic environments by processing the entire constraint set and requiring expensive matrix factorizations. To bridge this gap, we propose the Accelerated Trainable-SKM (AT-SKM) Net framework. To concentrate computation on the active constraints and eliminate redundant calculations, we introduce a hybrid sampling strategy guided by a topology-aware heterogeneous GNN model. To efficiently handle topological shifts in graph-based constraints, we employ a Cholesky Update mechanism that theoretically reduces the equality projection complexity from O(N^3) to O(N^2) under low-rank perturbations. Experiments on random geometric graphs, N-1 Security-Constrained DC-OPF, and minimum-cost gas transport problem demonstrate that AT-SKM reduces iteration counts by up to 85% and achieves 2.95x-7.29x SKM layer speedups, while maintaining zero constraint violations.
Figures & tables
| Method | Tot. Time (ms) | Iter. Num. | SKM Time | SKM Speedup | Opt. Gap (%) | Max Eq. Vio. | Max Ineq. Vio. |
|---|---|---|---|---|---|---|---|
| IEEE 57-Bus System: , , | |||||||
| PyPower | 14.785 | - | - | - | 0 / 0 | 0 / 0 | 0 / 0 |
| NN | 0.048 | - | - | - | 0.173 / 5.379 | 24.77 / 53.07 | 0.101 / 192.71 |
| HGNN | 4.735 | - | - | - | 0.071 / 0.061 | 17.52 / 5.163 | 0.061 / 0.041 |
| DC3 | 6.278 | - | - | - | 0.013 / 0.013 | 0 / 0 | 0.067 / 0.051 |
| T-SKM-Net | 5.831 | 6.93 (148) | 1.096 | 1 | 0.008 / 0.008 | 0 / 0 | 0 / 0 |
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
| Small-Scale ( ) | Large-Scale ( ) | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SVD (ms) | Chol. (ms) | Speedup | SVD (ms) | Chol. (ms) | Speedup | ||||
| 100 | 10 | 0.874 | 0.119 | 7.36 | 1500 | 38 | 307.441 | 8.187 | 37.55 |
| 200 | 14 | 2.906 | 0.290 | 10.02 | 2000 | 44 | 995.480 | 14.754 | 67.47 |
| 400 | 20 | 11.106 | 0.575 | 19.33 | 2500 | 50 | 2276.658 | 23.450 | 97.09 |
| 800 | 28 | 49.833 | 2.257 | 22.08 | 3000 | 54 | 4595.625 | 40.505 | 113.46 |
| 1000 | 31 | 83.666 | 3.583 | 23.35 | 5000 | 70 | 20596.582 | 122.586 | 168.02 |
| System | Contingency | # Scenarios | FP32 Failures | FP64 Failures | ||
|---|---|---|---|---|---|---|
| Original | Adaptive | Original | Adaptive | |||
| 57-bus | -1 | 79 | 68 (86.1%) | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) |
| 57-bus | -2 | 3024 | 2973 (98.3%) | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) |
| 57-bus | -3 | 6048 | - | 0 (0.0%) | - | 0 (0.0%) |
| 118-bus | -1 | 177 | 174 (98.3%) | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) |
| 118-bus | -2 | 15502 | 15501 (99.9%) | 0 (0.0%) | 0 (0.0%) | 0 (0.0%) |
| Method | Forward Time (ms) | Max Eq. Viol. | Max Ineq. Viol. | Opt. Gap (%) |
|---|---|---|---|---|
| HGNN |
| Method | Eq. Proj. | Eq. Spd. | Ineq. Iter. | Ineq. Time | Ineq. Spd. | SKM Time | SKM Spd. | Opt. Gap (%) |
|---|---|---|---|---|---|---|---|---|
| T-SKM | ||||||||
| AT-SKM |
| Test System | Buses | Branches | Removable | Scenarios | ||
|---|---|---|---|---|---|---|
| IEEE 57-Bus | 57 | 80 | 79 | 80 | 10 | 0.8 |
| IEEE 118-Bus | 118 | 186 | 177 | 178 | 50 | 0.8 |
| IEEE 300-Bus | 300 | 411 | 322 | 323 | 60 | 0.8 |
| System | Method | Eq. Proj. Time | Eq. Proj. Spd. | Ineq. Iter. Time | Ineq. Iter. Spd. | Total SKM Spd. |
|---|---|---|---|---|---|---|
| 57-bus | T-SKM-Net | |||||
| 57-bus | AT-SKM-AC | |||||
| 118-bus | T-SKM-Net | |||||
| 118-bus | AT-SKM-AC | |||||
| 300-bus | T-SKM-Net | |||||
| 300-bus | AT-SKM-AC |
| System | Method | Eq. Proj. Time | Eq. Spd. | Ineq. Iter. | Ineq. Time | Ineq. Spd. | SKM Spd. | Mean Gap (%) |
|---|---|---|---|---|---|---|---|---|
| 57-bus | T-SKM-Net | |||||||
| 57-bus | AT-SKM-AC | |||||||
| 118-bus | T-SKM-Net | |||||||
| 118-bus | AT-SKM-AC | |||||||
| 300-bus | T-SKM-Net | |||||||
| 300-bus | AT-SKM-AC |
| System | Accuracy | Precision | Recall |
|---|---|---|---|
| IEEE 57-Bus | 0.9995 / 0.9995 | 0.9814 / 0.9802 | 0.9804 / 0.9815 |
| IEEE 118-Bus | 0.9995 / 0.9995 | 0.9988 / 0.9989 | 0.9948 / 0.9940 |
| IEEE 300-Bus | 0.9991 / 0.9991 | 0.9647 / 0.9649 | 0.9834 / 0.9834 |
| Add Ratio | Drop Ratio | ||||||
|---|---|---|---|---|---|---|---|
| 0.00 | 0.05 | 0.10 | 0.15 | 0.20 | 0.25 | 0.50 | |
| 0.0 | 15.68 | 18.04 | 20.02 | 22.71 | 24.41 | 24.71 | 29.61 |
| 0.5 | 15.85 | 20.64 | 29.60 | 33.44 | 39.12 | 39.71 | 42.53 |
| 1.0 | 16.37 | 21.41 | 29.04 | 35.27 | 37.91 | 42.79 | 64.02 |
| 1.5 | 17.04 | 21.34 | 27.89 | 35.81 | 39.81 | 41.90 | 63.72 |
| 2.0 | 17.64 | 22.10 | 30.32 | 36.28 | 41.06 | 42.42 | 63.08 |
| Add Ratio | Drop Ratio | ||||||
|---|---|---|---|---|---|---|---|
| 0.00 | 0.05 | 0.10 | 0.15 | 0.20 | 0.25 | 0.50 | |
| 0.0 | 3.69 | 4.15 | 7.68 | 8.88 | 10.99 | 13.96 | 19.24 |
| 0.5 | 3.69 | 4.51 | 9.65 | 10.39 | 14.43 | 16.55 | 23.97 |
| 1.0 | 3.72 | 4.78 | 11.53 | 12.50 | 17.17 | 23.93 | 33.14 |
| 1.5 | 3.77 | 5.25 | 12.03 | 13.27 | 20.15 | 24.80 | 39.51 |
| 2.0 | 3.80 | 4.79 | 13.36 | 15.24 | 23.41 | 28.90 | 43.07 |
| Transfer | Method | Eq. Proj. | Eq. Spd. | Ineq. Iter. | Ineq. Time | Ineq. Spd. | SKM Spd. | Gap (%) |
|---|---|---|---|---|---|---|---|---|
| T-SKM-Net | ||||||||
| AT-SKM-AC | ||||||||
| T-SKM-Net | ||||||||
| AT-SKM-AC |