cs.LGApr 13, 2026

Fairness is Not Flat: Geometric Phase Transitions Against Shortcut Learning

Authors: Nicolas Rodriguez-Alvarez

Organizations: Instituto de Educacion Secundaria Parquesol, Valladolid, Spain · Instituto de Educación Secundaria Parquesol Valladolid, Castile and León, Spain

Abstract

Deep Neural Networks are highly susceptible to shortcut learning, frequently memorizing low-dimensional spurious correlations instead of underlying causal mechanisms. This phenomenon not only degrades out-of-distribution robustness but also induces severe demographic biases in sensitive applications. In this paper, we propose a geometric a priori methodology to mitigate shortcut learning. By deploying a zero-hidden-layer (N=1N=1) Topological Auditor, we mathematically isolate features that monopolize the gradient without human intervention. We empirically demonstrate a Capacity Phase Transition: once linear shortcuts are pruned, networks are forced to utilize higher geometric capacity (N≥16N \geq 16) to curve the decision boundary and learn ethical representations. Our approach outperforms L1 Regularization -- which collapses into demographic bias -- and operates at a fraction of the computational cost of post-hoc methods like Just Train Twice (JTT), successfully reducing counterfactual gender vulnerability from 21.18% to 7.66%.

Figures & tables

Explore similar work

CardsList
  1. Prevalence calibration as shortcut mitigation

    Sep 7, 2026Mohamed Amine Kina, Eike PetersenPost-Hoc CalibrationMedical Image Classification

  2. Fairness Pruning: Locating Demographic Bias in GLU-MLP Layers via Differential Activations

    Jul 30, 2026Pere Martra, Eugenio Martínez Cámara, Alfonso Ureña LópezLLM PruningLLM Interpretability

  3. Shortcut Mitigation via Spurious-Positive Samples

    May 13, 2026Phuong Quynh Le, Jörg Schlötterer, Sari Sadiya +2Neural Network RobustnessSpurious Correlation Robustness