stat.MLMay 11, 2026

Amortizing Causal Sensitivity Analysis via Prior Data-Fitted Networks

Authors: Emil Javurek, Dennis Frauen, Marie Brockschmidt, Jonas Schweisthal, Stefan Feuerriegel

Organizations: 1LMU Munich · 2Munich Center for Machine Learning (MCML)

Abstract

Causal sensitivity analysis aims to provide bounds for causal effect estimates in the presence of unobserved confounding. However, existing methods for causal sensitivity analysis are per-instance procedures, meaning that changes to the dataset, causal query, sensitivity level, or treatment require new computation. Here, we instead present an in-context learning approach. Specifically, we propose an amortized approach to causal sensitivity analysis based on prior-data fitted networks. A key challenge is that the sensitivity bounds are not directly available when sampling training data. To address this, we develop a general prior-data construction that is applicable across the class of generalized treatment sensitivity models. Our construction involves a Lagrangian scalarization of the objective to generate training labels for the bounds through a tradeoff between causal effect min/max-imization and sensitivity model violation, which avoids model-specific analytical derivations. We further show that, under standard convexity and linearity conditions, our objective recovers the full Pareto frontier of solutions. Empirically, we demonstrate our amortized approach across various datasets, causal queries, and sensitivity levels, where our approach achieves a test-time computation that is orders of magnitude faster than per-instance methods. To the best of our knowledge, ours is the first foundation model for in-context learning for causal sensitivity analysis.

Explore similar work

CardsList
May 8, 2026cs.LG

Bayesian Sensitivity of Causal Inference Estimators under Evidence-Based Priors

Causal inference, especially in observational studies, relies on untestable assumptions about the true data-generating process. Sensitivity analysis helps us determine how robust our conclusions are when we alter these underlying assumptions. Existing frameworks for sensitivity analysis are concerned with worst-case changes in assumptions. In this work, we argue that using such pessimistic criteria can often become uninformative or lead to conclusions contradicting our prior knowledge about the world. To demonstrate this claim, we generalize the recent s-value framework (Gupta & Rothenhäusler, 2023) to estimate the sensitivity of three different common assumptions in causal inference. Empirically, we find that, indeed, worst-case conclusions about sensitivity can rely on unrealistic changes in the data-generating process. To overcome this, we extend the s-value framework with a new sensitivity analysis criterion: Bayesian Sensitivity Value (BSV), which computes the expected sensitivity of an estimate to assumption violations under priors constructed from real-world evidence. We use Monte Carlo approximations to estimate this quantity and illustrate its applicability in an observational study on the effect of diabetes treatments on weight loss.
Nikita Dhawan, Daniel Shen, Leonardo Cotta +1
Causal InferencesModel SensitivityBayesianPrior KnowledgeWorst-CaseAssumptions
AskPDF
Jul 28, 2026cs.AI

From Training to Deployment: Post-Hoc Causal Feature Identification via Sensitivity Ratios

Given a model that is already trained, which features does it rely on causally versus spuriously? Existing methods require access to the training procedure and cannot answer this post-hoc. We introduce the \textbf{Normalised Sensitivity Ratio~(NSR)}, a post-hoc, model-agnostic diagnostic for this question under a structured-shift regime: environments differ primarily in the mean of spurious features while the causal mechanism and causal marginals remain stable, as in multi-site clinical data or multi-batch genomics. Within this regime, causal features induce constant model sensitivity across environments while spurious features track shift. NSR formalises this as the squared coefficient of variation of per-environment sensitivity. Under a linear structural causal model (SCM) with K≥3K\ge3 non-degenerate environments, NSR achieves exact identification (Theorem~1). We fully characterise failure: weak shifts (O(ε4)O(\varepsilon^4) collapse), degenerate geometry, and proxy attenuation (O((1−α)4)O((1-α)^4)), giving practitioners quantitative criteria for assessing whether the regime holds. Finite-sample rates are Op(n−1)O_p(n^{-1}) under the null and Op(n−1/2)O_p(n^{-1/2}) under the alternative. Experiments confirm all theoretical predictions on synthetic data (area under the ROC curve [AUROC] =1.000= 1.000 under conditions satisfying the regime), show consistent rankings across five model families (Kendall τ≥0.529τ\ge0.529), and recover six of eight causal features on bike-sharing data (Precision@7 =0.75= 0.75) without modifying any trained model.
Athanasios Vlontzos, Giorgos Papanastasiou, Bernhard Kainz +1
Model SensitivityCausal ReasoningPost-HocSignal-To-Noise Ratio
AskPDF
May 14, 2026cs.LG

Causal Foundation Models with Continuous Treatments

Causal inference, estimating causal effects from observational data, is a fundamental tool in many disciplines. Of particular importance across a variety of domains is the continuous treatment setting, where the variable of intervention has a continuous range. This setting is far less explored and represents a substantial shift from the binary treatment setting, with models needing to represent effects across a continuum of treatment values. In this paper, we present the first causal foundation model for the continuous treatment setting. Our model meta-learns the ability to predict causal effects across a wide variety of unseen tasks without additional training or fine-tuning. First, we design a novel prior over data-generating processes with continuous treatment variables in order to generate a rich causal training corpus. We then train a transformer to reconstruct individual treatment-response curves given only observational data, leveraging in-context learning to amortize expensive Bayesian posterior inference. Our model achieves state-of-the-art performance on individual treatment-response curve reconstruction tasks compared to causal models which are trained specifically for those tasks. Inference code (including trained model weights) can be found at https://github.com/layer6ai-labs/CCPFN-inference .
Christopher Stith, Medha Barath, Vahid Balazadeh +2
Causal InferencesCausal Foundation ModelsTabular Prior-Data Fitted NetworkTreatmentFoundation ModelText Corpora
AskPDF