Overview

Tabular foundation models aim to make predictions on new tables with little or no task-specific training, often by conditioning on labeled examples in context. Many use transformers or related architectures pretrained on synthetic tasks generated from causal or statistical priors; other approaches learn from real tables, retrieve relevant examples, or adapt frozen models with lightweight heads. Benchmarks such as TabArena and TALENT show strong results on many small- and medium-sized, in-distribution tasks, while gradient-boosted trees and specialized methods remain competitive, especially on large or high-dimensional data. Open challenges include robustness to distribution shift, calibrated uncertainty and fairness, and reducing the memory and inference costs of processing large contexts.

Latest papers

CardsList

209 papers25 papers in the last four weeks, down 46% on the four weeks before. 0.2% of all new papers.

  1. TabPATE: Differentially Private Tabular In-Context Learning Without Public Data

    Jun 30, 2026Dariush Wahdany, Matthew Jagielski, Jesse C. Cresswell +2Tabular Foundation ModelsDifferential Privacy

  2. Probing Memorization of Tabular In-Context Learning

    Jun 30, 2026Francesco Capano, Jonas BöhlerTabular Foundation ModelsMembership Inference Attacks

  3. Can Tabular In-Context Learners Generalize to Biomolecular Property Prediction?

    Jun 30, 2026Davy Guan, Lu Zhang, Asiri Wijesinghe +7Tabular Foundation ModelsProtein Fitness Prediction

  4. Beyond IID: How General Are Tabular Foundation Models, Really?

    Jun 29, 2026Lennart Purucker, Andrej Tschalzev, Nick Erickson +7Tabular Foundation ModelsOOD Generalization

  5. KnowsTFM: Knowledge-Informed Fine-Tuning of Small Tabular Foundation Models

    Jun 29, 2026Boshko Koloski, Xiangjian Jiang, Senja Pollak +3Tabular Foundation ModelsFine-Tuning

  6. Towards Evaluating Data Priors for Tabular Foundation Models

    Jun 28, 2026Zeynep Türkmen, Kürşat Kaya, Alexander Pfefferle +1Tabular Foundation ModelsSynthetic Data Evaluation

  7. Embedding Foundation Model Predictions in Discrete-Choice Models with Structural Guarantees

    Jun 24, 2026Yingshuo Wang, Xian Sun, Yanhang Li +2Tabular Foundation ModelsMonotonicity Constraints

  8. Are Tabular Foundation Models Robust to Realistic Query Distribution Shifts in Microbiome Data?

    Jun 23, 2026Giulia Perciballi, Ahmad Fall, Federica Granese +2Distribution Shift RobustnessTabular Foundation Models

  9. Universal Encoders for Modular Relational Deep Learning

    Jun 19, 2026Jakub Peleška, Gustav ŠírRelational Foundation ModelsTabular Foundation Models

  10. Bounded Context Management for Tabular Foundation Models on Stream Learning

    Jun 17, 2026Jinmo Lee, Doyun Choi, Moongi Choi +1In-Context Example SelectionTabular Foundation Models

  11. Where Computation Lives Inside TabPFN: Causal Localisation of Attention Head Function

    Jun 11, 2026Atharva Gupta, Dhruv Kumar, Murari Mandal +1Attention Head SpecializationAttention Head Analysis

  12. Tabular Foundation Models for Clinical Survival Analysis via Survival-Aware Adaptation

    Jun 10, 2026Minh-Khoi Pham, Luca Cotugno, Alina Sirbu +3Tabular Foundation ModelsSurvival Analysis

  13. TabSwift: An Efficient Tabular Foundation Model with Row-Wise Attention

    Jun 5, 2026Si-Yang Liu, Han-Jia YeTabular Foundation ModelsEfficient Inference

  14. Towards Unified and Data-Efficient Prognostics and Health Management with Tabular Foundation Models

    Jun 3, 2026Raffael Theiler, Lev Telyatnikov, Leandro Von Krannichfeldt +1Tabular Foundation ModelsRUL Estimation

  15. GOTabPFN: From Feature Ordering to Compact Tokenization for Tabular Foundation Models on High-Dimensional Data

    Jun 3, 2026Al Zadid Sultan Bin Habib, Md Younus Ahamed, Prashnna Kumar Gyawali +2Tabular Foundation ModelsTabular Prediction

  16. Towards Pretraining Text Encoders for TabPFN

    Jun 3, 2026Mustafa Tajjar, Alexander Pfefferle, Lennart Purucker +1Tabular Foundation ModelsFine-Tuning

  17. SurvPFN: Towards Foundation Models for Survival Predictions

    Jun 3, 2026Samuel Böhm, Lennart Purucker, Frank Hutter +1Tabular Foundation ModelsSurvival Analysis

  18. OpenRFM: Dissecting Relational In-Context Learning

    Jun 3, 2026Zhikai Chen, Junyu Yin, Jialiang Gu +5Relational Foundation ModelsSynthetic Data Pretraining

  19. Speedrunning Tabular Foundation Model Pretraining

    Jun 2, 2026Salih Bora Ozturk, Alexander Pfefferle, Frank HutterTabular Foundation ModelsTabular Prediction

  20. Segment-driven Structural Induction and Semantic Alignment for Heterogeneous Tabular Representation

    Jun 1, 2026Woojun Jung, Susik YoonTabular Foundation ModelsSelf-Supervised Pre-Training

  21. On the Uncertainty Quantification Ability of Tabular Foundation Models

    May 31, 2026Tyler R. Johnson, Kian Ben-Jacob, Nima Negarandeh +2Tabular Foundation ModelsUncertainty Quantification

  22. High Performance, Low Reliability: Uncertainty Benchmarking for Tabular Foundation Models

    May 27, 2026José Lucas De Melo Costa, Fabrice Popineau, Arpad Rimmel +1Tabular Foundation ModelsUncertainty Quantification

  23. Explaining Tabular Foundation Model Differences Through Meta-Features

    May 27, 2026Markus Herre, Andrej Tschalzev, Sascha Marton +1Tabular Foundation ModelsTabular ML