cs.LGNov 19, 2026

Now You See Me Now You Don't: A Framework To Detect and Reduce Proxy Capacity

Authors: Nirek Sharma

Organizations: Upstart Network, Inc., USA

Abstract

In regulated domains such as lending, the two most salient fairness concepts are disparate impact and disparate treatment: disparate impact is generally defined by differential rates of adverse outcomes between demographic groups, while disparate treatment is generally defined by the use of demographic information or proxies to issue decisions. There already exist established methods to quantitatively detect and mitigate disparate impact; however, there has been less research on doing the same for disparate treatment. From a practitioner's perspective, the manner in which a conditional independence test is formulated and operationalized to identify proxies is nuanced and underexplored. As Machine Learning (ML) systems increase in scope and application in regulated domains, practitioners need a defensible framework to identify proxies at scale. Current disparate treatment frameworks typically rely upon some combination of quantitative and qualitative review of models' inputs to identify proxies. Features that are identified as proxies are then typically removed from the model in practice, and predictive performance degrades in favor of fairness through unawareness. Here, we propose a two-part framework that reduces the disparate treatment risk of a feature and keeps the predictive performance that removal of the feature loses. First, we propose a quantitative test for proxy capacity that identifies whether some of a feature's values reveal membership in a particular demographic group. Second, we propose a pre-processing methodology that adjusts those proxy features to reduce their proxy capacity. We show empirically on synthetic and public datasets that this framework identifies features that proxy for demographic information and reduces their proxy capacity while the adjusted feature retains task-relevant signal (i.e. improves predictive performance versus removal).

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Do Fair Models Reason Fairly? Counterfactual Explanation Consistency for Procedural Fairness in Credit Decisions

    May 12, 2026Gideon Popoola, John SheppardFeature AttributionCounterfactual Explanations

  2. Data Bias Mitigation under Coverage Constraints & The Price of Fairness

    Jun 18, 2026Bruno Scarone, Alfredo Viola, Renée J. MillerDebiased MLAlgorithmic Fairness

  3. Test-Time Collective Action: Proxy-Based Perturbations for Correcting Algorithmic Harms

    May 26, 2026Meghana Bhange, Ulrich Aïvodji, Elliot CreagerAlgorithmic FairnessGroup Fairness