Synthetic Data Augmentation for Fairness under Data Imbalance: Theory and Adaptive Allocation
Authors: Zhengchi Ma, Kaifeng Zhang, Anru R. Zhang
Organizations: Department of Electrical & Computer Engineering, Duke University · Department of Statistical Science, Duke University · Department of Biostatistics & Bioinformatics and Department of Computer Science, Duke University
Data imbalance across sensitive groups and class labels is common in classification problems and can contribute to substantial fairness disparities. We study how such imbalance affects Equal Opportunity and how synthetic data augmentation can mitigate the resulting unfairness. We first identify two mechanisms, prevalence imbalance and group-size imbalance, through which changes in the training distribution shift the learned decision boundary and induce disparities in group true positive rates. Motivated by this analysis, we study exact full-balance augmentation, which equalizes all group-label cells. We establish conditions under which full balancing strictly improves Equal Opportunity together with a prediction-error comparison under the oracle balanced distribution, and show that the Equal Opportunity gap of the synthetic-data classifier converges to that of the oracle balanced classifier as the sample size grows and the generator error vanishes. The finite-sample convergence rate agrees, up to logarithmic factors and generator-approximation error, with the information-theoretic lower-bound rate under the corresponding regularity regimes. Since exact balancing need not provide the best fairness-accuracy trade-off in practice, we further propose Accuracy-Constrained Adaptive Synthetic Augmentation (ACASA), which learns both where and how much to augment by minimizing estimated fairness disparity subject to a constraint on predictive accuracy. We provide a finite-sample guarantee comparing the selected augmentation allocation with the population-optimal accuracy-feasible allocation. Simulation studies and real data application support the theoretical findings and demonstrate that synthetic augmentation can substantially reduce fairness disparities while achieving favorable empirical fairness-accuracy trade-offs.
Figures & tables
Figure 1: Overview of the main ideas and structure of the paper.
Figure 2: Illustration of how data imbalance can induce fairness disparities. Left: prevalence imbalance, with a scarce B+ cell. Right: group-size imbalance, with group B underrepresented. Dotted contours represent the underlying true distributions, and the solid line represents the learned decision boundary.
Figure 3: Comparison of the raw distribution with two balanced reference distributions.
Figure 4: Comparison of the raw distribution with the full-balance reference distribution.
Figure 5: Predictive performance under prevalence imbalance, measured by (a) accuracy, (b) F1 score, and (c) Matthews correlation coefficient (MCC). The horizontal axis shows the positive-class odds difference ρA−ρB . Curves show means, and shading denotes pointwise 95% bootstrap confidence intervals.
Figure 6: Predictive performance under group-size imbalance, measured by (a) accuracy, (b) F1 score, and (c) Matthews correlation coefficient (MCC). The horizontal axis shows α−1/2 . Curves show means, and shading denotes pointwise 95% bootstrap confidence intervals.
Figure 7
Figure 9: Equal Opportunity gap across accepted ACASA iterations. Solid curves show mean ACASA trajectories, while dashed and dotted lines show full-balancing and raw-training benchmarks. Shading denotes pointwise 95% bootstrap confidence intervals. Runs that stop early retain their final values in subsequent plotted iterations.
Figure 10: Fairness–performance trade-offs measured by (a) accuracy, (b) F1 score, and (c) Matthews correlation coefficient (MCC). For each method, we select separate thresholds for groups A and B to minimize prediction error on the calibration set subject to an Equal Opportunity gap at most ϵ , and vary ϵ to obtain the curves.
Figure 11: Equal Opportunity gap on the COMPAS data before post-processing. Both panels report the test-set EO gap at the common classification threshold of 0.5 . Solid curves show mean ACASA trajectories for reweighting, SMOTE, and diffusion model, while dashed lines show raw training and the corresponding full-balancing methods. Results are averaged over 100 runs, and error bars give pointwise 95% bootstrap confidence intervals based on 5,000 resamples. Runs that stop early retain their final accepted allocation.
Figure 12: Predictive performance on the COMPAS data after group-specific threshold post-processing. The left panel reports test-set accuracy under accuracy-constrained ACASA, and the right panel reports test-set MCC under MCC-constrained ACASA. Solid curves show the final ACASA allocations, while dashed curves show raw training and full balancing. Results are averaged over 100 runs, and error bars give pointwise 95% bootstrap confidence intervals based on 5,000 resamples. The value ϵ=1 corresponds to unconstrained threshold selection, not to the absence of post-processing.
Department of Electrical & Computer Engineering, Duke University · Department of Biostatistics & Bioinformatics, Duke University · Department of Biostatistics & Bioinformatics and Department of Computer Science, Duke University
Department of Biostatistics & Bioinformatics, Duke University · Department of Electrical & Computer Engineering, Duke University · Department of Statistics, Rutgers University +1