Causal Humility: Governing the Authority of Fairness Claims Under Causal Uncertainty
Organizations: Rice University, Houston, Texas, USA · University of California, Irvine, Irvine, California, USA
Abstract
AI systems increasingly shape consequential decisions in employment, lending, healthcare, and public services, making fairness an important problem for auditing and governance. Fairness assessment often requires more than identifying disparities in outcomes; it also requires understanding how those disparities arise. Causal approaches to algorithmic fairness address this explanatory problem by representing pathways through which protected attributes and other factors may influence outcomes. Yet causal reasoning in sociotechnical systems remains uncertain: relevant confounders may be unobserved, causal directions contested, and conclusions sensitive to modeling assumptions and representational choices. We introduce causal humility as a governance framework for managing the relationship between epistemic uncertainty and causal authority. Drawing on causal fairness research, epistemology, political philosophy, and science and technology studies, causal humility has four requirements: making consequential assumptions and omissions visible; preserving contestability across defensible causal accounts; recognizing indeterminacy as a legitimate analytical outcome; and maintaining proportionality between evidentiary support and institutional authority or action. We operationalize these requirements through Causal Cards, a documentation artifact for recording the causal basis, assumptions, omissions, model dependence, and governance implications of fairness claims. Using the UCI Adult dataset as a worked epistemic demonstration, we show how different causal discovery procedures applied to the same observational data render fairness-relevant pathways visible, absent, or unresolved. Causal humility treats such disagreement as information about the limits of what can responsibly be claimed and the authority those claims should carry.
Figures & tables
| Component | Information recorded |
|---|---|
| Decision context and fairness claim | The decision setting, outcome of interest, fairness-relevant attributes, population, intended use of the analysis, and the specific causal fairness claim being evaluated. |
| Causal representation | The causal model or model set considered, including whether the structure is expert-specified, learned from data, partially identified, or constructed through multiple methods. Relevant substantive constraints on the model set should also be stated. |
| Consequential assumptions and omissions | Assumptions about causal structure, variable roles, confounding, measurement, directionality, and pathway permissibility that materially affect the fairness interpretation. Known omissions, suspected unobserved mechanisms, and relevant proxies should also be recorded. |
| Stability and contestability | Whether the fairness-relevant finding persists across plausible alternative models, sensitivity assumptions, variable interpretations, or pathway classifications, and which choices drive material disagreement. |
| Epistemic status | A characterization of the resulting claim as comparatively stable , assumption-sensitive , or unresolved under the alternatives considered. These categories describe evidentiary status rather than universal numerical thresholds. |
| Governance response | The action taken or recommended in light of the finding, its uncertainty, and the stakes of the decision, including where relevant additional review, mitigation, conditional authorization, monitoring, restricted use, or refusal to issue a categorical fairness determination. |
| Field | Illustrative entry |
|---|---|
| Decision context / claim | Illustrative assessment of whether fairness-relevant attributes have identifiable causal pathways to an income-threshold outcome in the UCI Adult data. The example is not used to justify real-world deployment or certification. |
| Outcome | Salary , represented as an income-threshold indicator. |
| Fairness-relevant attributes | Race , Sex , Age , and Marital Status . |
| Causal representations considered | Structures learned from the same observed feature set using PC, GES, and FCI. The outputs are treated as alternative representations for comparison, not as equally valid ground-truth causal models. |
| Key assumptions / analysis protocol | Causal structure is inferred from observational data. Candidate pathways are traced from fairness-relevant attributes to Salary . Only fully directed paths are interpreted as directed causal pathways; partially oriented FCI relationships are treated as unresolved. |
| Consequential omissions | The observed data do not directly represent mechanisms including discrimination, labor-market segmentation, inherited wealth, institutional exclusion, historical disadvantage, or differential access to educational and occupational opportunities. |
Algorithmic Fairness
Algorithmic fairness studies how automated decisions distribute errors, opportunities, and harms across groups, and how to measure and reduce disparities.
See all 424 papers