cs.LGOct 30, 2026

KINDER: Kernel-based Independence for Fair Representation Learning via Prototype-space Erasure

Authors: Abtin Mogharabin, Alp Toykan Kaplan, Jiaee Cheong, Sinan Kalkan

Organizations: University of Tübingen · Zuse School ELIZA · Middle East Technical University · Harvard University · 

Abstract

Concept erasure is a prominent approach to achieving fairness in machine learning through the removal of sensitive attributes from learned representations. Prior concept erasure methods typically define debiasing indirectly through the failure of a chosen adversary, probe, or fairness penalty, which makes the target of erasure dependent on a particular decoder family or optimization setup. We introduce KINDER, which directly removes sensitive-attribute information from intermediate representations with respect to a chosen family of prototype functionals, and is compatible with any deep model containing an intermediate feature space, independent of the architecture, task type, or training paradigm. KINDER operates in a random Fourier feature space, where it estimates a sensitive subspace from protected group prototypes and projects representations onto its orthogonal complement. Thus, it forms an explicit representation cleaning mechanism distinct from prior fairness control studies. We conduct extensive experiments across diverse settings and show the effectiveness of KINDER on (i) supervised and self-supervised settings, (ii) classification, regression, and image segmentation tasks, and (iii) diverse data modalities, including visual, textual, and tabular data. Code and trained models are available at: https://github.com/abtinmU/KINDER

Figures & tables

Appendix figures & tables15 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Principled Nonlinear Concept Erasure and Steering

    Oct 23, 2026Idan Simai, Shauli Ravfogel, Uri ShahamConcept ErasurePrivacy-Preserving Representation Learning

  2. Deep Fair Learning: Task-Aware Fair Representations via Joint Distance-Covariance Regularization

    Apr 8, 2025Enze Shi, Yiqun Xiao, Linglong Kong +1Representation LearningAlgorithmic Fairness