On the (In)Compatibility between Group Fairness and Individual Fairness
Organizations: Department of Mathematics, University of California Davis, Davis, CA 95616-5270, USA · Department of Mathematics, Center of Data Science and Artificial Intelligence Research, University of California Davis, Davis, CA 95616-5270, USA
Abstract
We study the compatibility between utility-optimized statistical parity and individual fairness. While individual fairness seeks to treat similar individuals similarly, optimal statistical parity aims to provide similar treatment to individuals who share relative similarity within their respective sensitive groups. Although both fairness perspectives are desirable, they often conflict in practical applications. Our goal in this work is to analyze the existence of this conflict and its potential solution. In particular, we establish sufficient (sharp) conditions for the compatibility between the optimal (post-processing) statistical parity learning and the (-Lipschitz or ) individual fairness requirements. When a conflict arises, we first relax the optimal statistical parity solution to the Pareto frontier, representing the optimal trade-off between error and statistical disparity, and then examine its compatibility with individual fairness. Our analysis identifies regions along the Pareto frontier that satisfy individual fairness constraints. Additionally, we provide individual fairness guarantees for the composition of a trained model with the optimal post-processing step, enabling practitioners to assess the compatibility of post-processed models. This provides practitioners with a principled approach to achieving Pareto-optimal statistical parity while maintaining individual fairness constraints.
Figures & tables
| Data Set | Methods | Data Size | dim( ) | dim( ) |
|---|---|---|---|---|
| LSAC | Linear Regression, ANN | 20,454 | 9 | 1 |
| CRIME | Linear Regression, ANN | 1,994 | 97 | 1 |
| CRIME | Linear Regression, ANN | 1,994 | 87 | 11 |
Algorithmic Fairness
Algorithmic fairness studies how automated decisions distribute errors, opportunities, and harms across groups, and how to measure and reduce disparities.
See all 451 papers