A Residual Learning Approach for Unsteady Aerodynamic Load Prediction
Organizations: University of Michigan, Ann Arbor, MI, 48109
Abstract
This paper investigates the feasibility of using residual learning to improve unsteady aerodynamic load prediction for aeroelastic applications. The machine learning technique selected for the study is the long short-term memory (LSTM) neural network, which is used for its suitability for sequential data with aerodynamic memory effects. The approach is investigated for the NLR 7301 airfoil benchmark using high-fidelity CFD lift data for prescribed pitch and plunge motions in the transonic flow regime in the presence of shock motion. An analytical unsteady aerodynamic model based on the Wagner function is used as a physics-based baseline, and the neural network is trained to learn the difference between the CFD lift coefficient and the Wagner prediction. The residual model is compared with a direct neural-network model trained to predict the CFD lift coefficient. The comparison includes feature and normalization studies, external benchmark cases, and leave-one-out and leave-family-out generalization tests across a range of sinusoidal and non-sinusoidal motions. The residual model performs best when its inputs align with the Wagner formulation variables, generally giving lower error and more consistent performance across training runs, though the direct model remains more accurate for some high-frequency cases. The residual model also generalizes better in the leave-one-out and leave-family-out tests, with a smaller increase in error than the direct model when entire motion families are withheld from training. Overall, the results indicate that residual learning shows promise as a modular approach for augmenting classical low-order aerodynamic theories, especially when the physics baseline removes a structured part of the aerodynamic response and leaves a lower-variance correction for the neural network to learn.
Figures & tables
| Family | Cases | Mach numbers | Frequency content |
|---|---|---|---|
| Single harmonic | 24 | 0.65, 0.70, 0.75 | |
| Amplitude-modulated harmonic | 6 | 0.65, 0.67, 0.69, 0.71, 0.73, 0.75 | Components about |
| Gaussian pulse | 6 | 0.65, 0.67, 0.69, 0.71, 0.73, 0.75 | Approx. |
| Noise-perturbed harmonic | 12 | 0.65, 0.67, 0.69, 0.71, 0.73, 0.75 | Approx. |
| Case | ||
|---|---|---|
| Pitch only | 0.705 | 3.01 |
| Plunge only | 0.720 | 2.00 |
| Coupled pitch–plunge | 0.750 | 0.30 |
| Case | Quasi- steady | Linear unsteady | Nonlinear unsteady | ||
|---|---|---|---|---|---|
| Pitch only | 0.705 | 3.01 | 0.964 | 0.658 | 0.655 |
| Plunge only | 0.720 | 2.00 | 0.377 | 0.240 | 0.260 |
| Coupled pitch–plunge | 0.750 | 0.30 | 0.160 | 0.114 | 0.116 |
| Mean | 0.500 | 0.337 | 0.344 |
| Parameter | Value | Note |
|---|---|---|
| Architecture | 1-layer LSTM | Consistent with the prior NLR 7301 LSTM setup [ 22 ] . |
| Hidden size | 250 | Larger hidden size did not improve the priority cases. |
| Optimizer | Adam | Learning rate . |
| Epoch handling | 1000, restore-best | Selected using validation reconstructed- RMSE. |
| Loss | MSE | Applied to the selected training target for each model. |
| Feature set | Normalization | Pitch-only | Plunge-only | Coupled | Mean |
|---|---|---|---|---|---|
| , , , | X-only | 0.124 | 0.035 | 0.091 | 0.083 |
| , , , , | X-only | 0.063 | 0.043 | 0.089 | 0.065 |
| , , , , , | X/Y | 0.078 | 0.028 | 0.075 | 0.060 |
| , , , , , | X-only | 0.058 | 0.036 | 0.039 | 0.044 |
| , , , , , , | X-only | 0.066 | 0.030 | 0.128 | 0.075 |
| Feature set | Pitch-only | Plunge-only | Coupled | Mean |
|---|---|---|---|---|
| , , , | 0.070 | 0.042 | 0.122 | 0.078 |
| , , , | 0.041 | 0.049 | 0.072 | 0.054 |
| , , , , | 0.063 | 0.021 | 0.106 | 0.063 |
| , , , , , | 0.123 | 0.026 | 0.164 | 0.104 |
| , , , , , , | 0.050 | 0.021 | 0.105 | 0.059 |
| Model | Pitch-only | Plunge-only | Coupled | Mean |
|---|---|---|---|---|
| Direct | ||||
| Residual |
| Motion family | Direct mean | Residual mean | Residual lower |
|---|---|---|---|
| Single harmonic | 0.057 | 0.045 | 19/24 |
| Amplitude-modulated harmonic | 0.028 | 0.022 | 3/5 |
| Gaussian pulse | 0.018 | 0.010 | 5/5 |
| Noise-perturbed harmonic | 0.027 | 0.015 | 10/10 |
| Motion family | Run | Direct mean | Residual mean | Residual lower |
|---|---|---|---|---|
| Single harmonic | Best | 0.091 | 0.046 | 19/24 |
| Worst | 0.085 | 0.046 | 19/24 | |
| Amplitude-modulated harmonic | Best | 0.045 | 0.032 | 6/6 |
| Worst | 0.040 | 0.032 | 6/6 | |
| Gaussian pulse | Best | 0.027 | 0.019 | 6/6 |
| Worst | 0.019 | 0.024 | 0/6 |
Residual Learning
Residual learning studies methods that learn incremental updates or error corrections, helping deep networks and hybrid models refine predictions.
See all 147 papers