Prior-Data Fitted Networks

Also known as PFN

Overview

PFNs are models, often transformers, trained on many synthetic datasets so they can make predictions for a new dataset from its examples, without task-specific optimization. Their synthetic priors encode possible data-generating processes, and researchers adapt them for tabular prediction, time-series forecasting, survival analysis, causal inference, graph learning, and Bayesian optimization. Common approaches include amortizing Bayesian posterior prediction, designing structured or hybrid priors, and adapting pretrained representations or inference procedures to new tasks. A central challenge is that performance and uncertainty depend on how well the training prior matches deployment data: models can be fast and effective in familiar settings yet retain errors on rare or misspecified cases.

Latest papers

CardsList

55 papers10 papers in the last four weeks, down 17% on the four weeks before. 0.1% of all new papers.

  1. Does Predictive Performance Translate to Causal Performance? Evaluating tabular foundation models as nuisance learners for causal effect estimation

    Nov 8, 2026Andrew R Weckstein, Issa J Dahabreh, Marinka Zitnik +2Causal Effect EstimationTabular Foundation Models

  2. Molecular Prior Networks

    Nov 3, 2026Pawel Gomoluch, Anthony BradleyProtein-Ligand Binding Affinity PredictionMolecular Foundation Models

  3. Missingness-Aware Prior-Data Fitted Network for Irregular Clinical Time-Series

    Nov 1, 2026Hadi Mehdizavareh, Gabriele Santangelo, Giovanna Nicora +5Informative MissingnessIrregular Time-Series Modeling

  4. Learning a Prior-Data Fitted Network for Graph Foundation Models via Structural Causal Model Priors

    Oct 28, 2026Ziwei Zhang, Tianyin Liao, Chunyu Hu +7Graph Foundation ModelsPrior-Data Fitted Networks

  5. GAS-PFN: Graph-Aware Spatiotemporal Prior-Data Fitted Networks for Zero-Shot Traffic Forecasting

    Oct 27, 2026Joseph Natter, Long Vu, Yifan Zhang +3Traffic ForecastingSpatiotemporal Forecasting

  6. Anisotropic Trust Region Warping for Prior-Data Fitted Networks in Bayesian Optimisation

    Oct 27, 2026Samuel Younger, Tinkle Chugh, George De AthBayesian OptimizationPrior-Data Fitted Networks

  7. Prior-Data Fitted Networks for In-Context Off-Policy Evaluation

    Oct 25, 2026Shuguang Yu, Ting Li, Fan ZhouOff-Policy EvaluationPrior-Data Fitted Networks

  8. Debiased Prior-Data Fitted Networks for Amortized Bayesian Semi-Parametric Inference

    Oct 20, 2026Valentyn Melnychuk, Emil Javurek, Stefan FeuerriegelPrior-Data Fitted NetworksAmortized Inference

  9. Characterizing the Separability Gap in Prior-Data Fitted Networks

    Oct 10, 2026Julius Kobialka, Manuel Hülskamp, Thomas Nagler +1Prior-Data Fitted NetworksBayesian Inference

  10. How Well Do Prior-Data Fitted Networks Amortize Bayesian Inference?

    Oct 9, 2026Manuel Hülskamp, Julius Kobialka, Emanuel Sommer +2Bayesian Model AveragingPrior-Data Fitted Networks

  11. PDE-PFN: Prior-Data Fitted Neural PDE Solver

    Oct 9, 2026Jaehyeon Park, Mingu Kang, Dongseok Lee +5Neural PDE SolversPDE Solving

  12. Amortized Off-Policy Evaluation for LLMs

    Oct 7, 2026Younwoo Choi, Leo Feng, Vincent Liu +1Off-Policy EvaluationLLM Evaluation

  13. Continual Learning without Continual Training

    Oct 7, 2026Nikita Narayanan, Ritham Majumdarr, Sonali ParbhooContinual LearningClass-Incremental Learning

  14. ProximalFM: Amortized Proximal Causal Inference under Hidden Confounding

    Oct 6, 2026Christophe Muller, Ayub Kharel, Alex Luedtke +6Causal InferenceAmortized Inference

  15. Adaptive Mean Estimation by In-Context Learning: A Gradient-Flow Analysis

    Oct 6, 2026Martin Eppert, Krishna Balasubramanian, Subhro Ghosh +2In-Context LearningPrior-Data Fitted Networks

  16. Adapting prior-data fitted networks for tabular anomaly detection

    Oct 5, 2026Maximilian Bershtman, Niv CohenTabular Anomaly DetectionUnsupervised Anomaly Detection

  17. LinearPFN: Amortized Variable Selection for Linear Models with Interactions

    Oct 5, 2026Louis Schiekiera, Max Zimmer, Christophe Roux +3Model SelectionPrior-Data Fitted Networks

  18. IQS-BO: In-Context Query Selection for Bayesian Optimisation

    Oct 1, 2026Luca Geminiani, Nadja KleinBayesian OptimizationPrior-Data Fitted Networks

  19. When and Why LLM Causal Priors Help: Closed-Loop Prior Selection for Amortized Causal Inference

    Sep 7, 2026Haohao ZhouCausal InferenceCausal Effect Estimation

  20. RecPFN: Prior-Fitted Networks for In-Context-Based Recommendations

    Aug 20, 2026En Zhi Tan, Jia Xiang Lim, Bryan Lijie Chew +2Recommender SystemsSequential Recommendation

  21. Curriculum Matters: Data-Efficient Relational PFN Pretraining with Synthetic Data

    Jul 31, 2026Mohammad Sadeq Abolhasani, Viswanath GanapathySynthetic Data PretrainingSynthetic Data Generation

  22. PerturbPFN: Probing the Limits of Synthetic Priors in Drug Perturbation Modelling

    Jul 26, 2026Yuche Gao, José Miguel Hernández-Lobato, Siyuan GuoSynthetic Data PretrainingStructural Causal Models

  23. TabPFN beyond Tabular Data: Calibration and Accuracy on Multimodal Embeddings

    Jul 13, 2026Jingxiang Zhang, Lujia Zhong, Zijie Zhu +2Multimodal EmbeddingMultimodal Classification

  24. A Fair Evaluation of Graph Foundation Models for Node Property Prediction

    Jun 23, 2026Oleg Platonov, Gleb Bazhenov, Dmitry Eremeev +1Graph Neural NetworksGraph Foundation Models

  25. A Causal DAG Prior for Synthetic Time-Series Classification Datasets

    Jun 19, 2026Franco Martino O'Rourke, Ana Trisovic, Dimitris BertsimasStructural Causal ModelsMultivariate Time Series Classification

  26. DCD-PFN: A Decoupling-Aware Foundation Model for Causal Discovery

    Jun 19, 2026Zhengkang Guan, Yikang Chen, Yi He +5Causal Foundation ModelsStructural Causal Models