stat.MLNov 9, 2026

MediPFN: Amortized In-Context Nuisance Learning and Inference for Causal Mediation Analysis

Authors: Shi Bo, Jiaming Hu

Organizations: Department of Mathematics and Statistics, Boston University

Abstract

Causal mediation analysis decomposes a treatment effect into indirect pathways through mediators and direct pathways through other processes. Tabular foundation models perform classification and regression through in-context learning, providing estimates of conditional means and propensity scores used in causal mediation analysis. Constructing confidence intervals from these estimates requires accounting for uncertainty introduced by fitting and combining several nuisance functions. We introduce MediPFN, an amortized inference framework that adapts a pretrained tabular foundation model to nuisance prediction and combines its predictions through a cross-fitted influence-function estimator. A separate head learns quantiles of the estimator's standardized error from simulated tables with known indirect effects. Supervised fine-tuning, symmetrization, and independent calibration then produce a confidence interval. We establish coverage bounds for the resulting intervals under standard assumptions. Across experiments, MediPFN attains coverage closer to the nominal level than several comparators. It also reduces the computational cost of uncertainty quantification, running 59.1 times faster than bootstrap in matched comparisons.

Figures & tables

Appendix figures & tables13 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Does Predictive Performance Translate to Causal Performance? Evaluating tabular foundation models as nuisance learners for causal effect estimation

    Nov 8, 2026Andrew R Weckstein, Issa J Dahabreh, Marinka Zitnik +2Causal Effect EstimationTabular Foundation Models

  2. Frequentist Consistency of Prior-Data Fitted Networks for Causal Inference

    Mar 12, 2026Valentyn Melnychuk, Vahid Balazadeh, Stefan Feuerriegel +1Causal Effect EstimationPrior-Data Fitted Networks

  3. Representation Learning for Semiparametric Causal Mediation Analysis under No Essential Heterogeneity

    Jul 12, 2026Roberto Faleh, Sofia Morelli, Holger BrandtSemiparametric InferenceParameter Estimation