Sample-Efficient Control of Magnetoconvective Flows via Differentiable Simulation
Organizations: TU Dortmund University & Lamarr Institute for Machine Learning and Artificial Intelligence · Institute of Thermodynamics and Fluid Mechanics, TU Ilmenau · Physics-based Simulation Group, TU Munich & Munich Center for Machine Learning · Scientific Machine Learning Group, Paderborn University
Abstract
Magnetohydrodynamic (MHD) fluid flows are central to demanding engineering applications, most prominently fusion blanket cooling, where flow control is a promising tool to optimize key properties such as heat transfer. While active flow control (AFC) has recently advanced through machine learning, its application to MHD flows remains largely unexplored. In this work, we present -PICT, a novel differentiable GPU-accelerated MHD solver targeted at AFC. We validate -PICT against MHD benchmarks and demonstrate its high computational efficiency. Integrated into FluidGym, -PICT enables sample-efficient gradient-based algorithms to improve heat transfer by % and allows optimizers to achieve higher accuracy in inverse design than black-box methods. -PICT is publicly available at https://github.com/upb-sciml/phiPICT.
Figures & tables
| SAC | BPTT | SHAC | |
|---|---|---|---|
Appendix figures & tables26 assets
Supplementary material from the paper’s appendix.
Appendix
| Environment | -PICT | |
|---|---|---|
| Airfoil2D-easy | 64 | |
| Airfoil2D-hard | 96 | |
| Airfoil2D-medium | 96 | |
| Airfoil3D-easy | 2 | |
| Airfoil3D-hard | 2 | |
| Airfoil3D-medium | 4 |
| Case | ||
|---|---|---|
| I | 20 | 9 |
| II | 100 | 10 |
| III | 1000 | 100 |
| 20 | 50 | 40 | 40 | 200 | 50 | 0.22 | 0.48 |
| 100 | 50 | 40 | 60 | 200 | 50 | 0.31 | 0.65 |
| 1000 | 50 | 50 | 50 | 200 | 50 | 7.98 | 10.97 |
| 1000 | 50 | 100 | 100 | 200 | 50 | 2.07 | 2.75 |
| 1000 | 100 | 150 | 150 | 200 | 50 | 0.75 | 0.94 |
| 20 | 50 | 40 | 40 | 200 | 50 | 0.15 | 0.28 |
| 100 | 50 | 40 | 60 | 200 | 50 | 0.11 | 0.31 |
| 1000 | 50 | 50 | 50 | 200 | 50 | 0.11 | 0.94 |
| 1000 | 50 | 100 | 100 | 200 | 50 | 0.03 | 0.22 |
| 1000 | 100 | 150 | 150 | 200 | 50 | 0.02 | 0.10 |
| (%) | |||
|---|---|---|---|
| 0 | 3.751 | 3.800 | 1.302 |
| 162 | 4.453 | 5.150 | 13.529 ∗ |
| 325 | 4.417 | 4.440 | 0.518 |
| 487 | 3.621 | 3.440 | 5.265 ∗ |
| 650 | 3.181 | 3.150 | 0.975 |
| 796 | 3.034 | 3.010 | 0.812 |
| (%) | |||
|---|---|---|---|
| No MHD | 3.359 | 3.331 | 0.838 |
| 0 | 3.241 | 3.245 | 0.139 |
| 0.01 | 3.040 | 3.046 | 0.183 |
| 0.1 | 2.276 | 2.277 | 0.050 |
| 1 | 1.537 | 1.527 | 0.681 |
| 50 | 1.387 | 1.390 | 0.184 |
| Hyperparameter | Value |
|---|---|
| Policy Network Type | MlpPolicy |
| Policy Network Layers | [256, 256] |
| Critic Network Layers | [256, 256] |
| Learning Rate | |
| Discount Factor ( ) | |
| Soft Update Coefficient ( ) |
| Hyperparameter | Value |
|---|---|
| Policy Network Layers | [128, 64, 32] |
| Hidden Layer Normalization | LayerNorm |
| Hidden Activation | ELU |
| Output Activation | Tanh |
| Optimizer | AdamW |
| Learning Rate |
| Hyperparameter | Value |
|---|---|
| Actor Network Layers | [256, 256] |
| Critic Network Layers | [256, 256] |
| Hidden Layer Normalization | LayerNorm |
| Hidden Activation | ELU |
| Initial Log-Std. ( ) | |
| Tanh Action Clamping | True |
| Hyperparameter | Value |
|---|---|
| Implementation | pycma |
| Parametrization | per patch |
| Initial Step Size ( ) | |
| Population Size | (default) |
| Bounds on | |
| Stopping Objective |
| Hyperparameter | Value |
|---|---|
| Implementation | scipy.optimize |
| Parametrization | per patch |
| Function Tolerance ( ftol ) | |
| Gradient Tolerance ( gtol ) | |
| Max. Iterations | |
| Max. Function Evaluations |
| SAC | BPTT | SHAC | |
|---|---|---|---|
| SAC | BPTT | SHAC | |
|---|---|---|---|