Causal Foundation Models
Overview
Causal foundation models aim to reuse knowledge from pretraining to discover cause-and-effect structure or estimate causal effects on new datasets, often without fine-tuning. Common approaches train transformers or prior-data fitted networks on synthetic structural causal models, sometimes adding graph encoders, temporal data, or observational and interventional examples. They are being tested on tasks including tabular graph discovery, time-series analysis, and treatment-effect estimation, with evaluations spanning synthetic, semantic, and real-world data. A key open challenge is whether performance transfers across domains and observational regimes: results vary with benchmark design, causal assumptions, and overlap between pretraining and evaluation data.
Latest papers
22 papers6 papers in the last four weeks, up 100% on the four weeks before. 0.0% of all new papers.