cs.LGNov 11, 2026

Characterizing Predictive Multiplicity in Ranking and Its Fairness Implications

Authors: Ainhize Barrainkua, Mikel Malagón

Organizations: University of the Basque Country (EHU)

Abstract

Prediction problems often admit competing models that achieve comparable performance yet produce conflicting outputs, a phenomenon known as predictive multiplicity. While this challenge has been extensively studied in classification tasks, its implications remain largely unexplored in ranking frameworks, which are critical for high-stakes societal decisions such as the allocation of welfare resources and social assistance. This paper investigates the phenomenon of predictive multiplicity in score-based ranking problems. We introduce formal definitions to capture multiplicity in ranking settings, supported by foundational theoretical guarantees. Furthermore, we examine the dual relationship between predictive multiplicity and algorithmic fairness in ranking problems: we analyze how model multiplicity can act as a potential source of unfairness, while demonstrating how exploring this decision space provides a principled avenue for discovering less discriminatory rankings. Finally, we complement our theoretical contributions with insightful empirical evaluations on both synthetic and real-world datasets, validating our analytical findings and illustrating their practical implications. Taken together, this work highlights the real-world relevance of predictive multiplicity in ranking and sheds light on the potential of leveraging this effect to achieve fairer outcomes.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Trustworthy Calibration or Vulnerability? Unveiling the Over-Calibration Paradox and Attack Surface in Rashomon Sets

    Mar 12, 2026Mustafa CavusPost-Hoc CalibrationAlgorithmic Fairness

  2. A fairness-aware extension of Stochastic Multicriteria Acceptability Analysis for ranking

    Jun 16, 2026Guilherme Dean Pelegrina, Renata PelissariMulti-Criteria Decision AnalysisGroup Fairness