Overview

Tabular foundation models aim to make predictions on new tables with little or no task-specific training, often by conditioning on labeled examples in context. Many use transformers or related architectures pretrained on synthetic tasks generated from causal or statistical priors; other approaches learn from real tables, retrieve relevant examples, or adapt frozen models with lightweight heads. Benchmarks such as TabArena and TALENT show strong results on many small- and medium-sized, in-distribution tasks, while gradient-boosted trees and specialized methods remain competitive, especially on large or high-dimensional data. Open challenges include robustness to distribution shift, calibrated uncertainty and fairness, and reducing the memory and inference costs of processing large contexts.

Latest papers

CardsList

209 papers23 papers in the last four weeks, down 45% on the four weeks before. 0.2% of all new papers.

  1. Probing Memorization of Tabular In-Context Learning

    Jun 30, 2026Francesco Capano, Jonas BöhlerTabular Foundation ModelsMembership Inference Attacks

  2. Can Tabular In-Context Learners Generalize to Biomolecular Property Prediction?

    Jun 30, 2026Davy Guan, Lu Zhang, Asiri Wijesinghe +7Tabular Foundation ModelsProtein Fitness Prediction

  3. Beyond IID: How General Are Tabular Foundation Models, Really?

    Jun 29, 2026Lennart Purucker, Andrej Tschalzev, Nick Erickson +7Tabular Foundation ModelsOOD Generalization

  4. KnowsTFM: Knowledge-Informed Fine-Tuning of Small Tabular Foundation Models

    Jun 29, 2026Boshko Koloski, Xiangjian Jiang, Senja Pollak +3Tabular Foundation ModelsFine-Tuning

  5. Towards Evaluating Data Priors for Tabular Foundation Models

    Jun 28, 2026Zeynep Türkmen, Kürşat Kaya, Alexander Pfefferle +1Tabular Foundation ModelsSynthetic Data Evaluation

  6. Embedding Foundation Model Predictions in Discrete-Choice Models with Structural Guarantees

    Jun 24, 2026Yingshuo Wang, Xian Sun, Yanhang Li +2Tabular Foundation ModelsMonotonicity Constraints

  7. Are Tabular Foundation Models Robust to Realistic Query Distribution Shifts in Microbiome Data?

    Jun 23, 2026Giulia Perciballi, Ahmad Fall, Federica Granese +2Distribution Shift RobustnessTabular Foundation Models

  8. Universal Encoders for Modular Relational Deep Learning

    Jun 19, 2026Jakub Peleška, Gustav ŠírRelational Foundation ModelsTabular Foundation Models

  9. Bounded Context Management for Tabular Foundation Models on Stream Learning

    Jun 17, 2026Jinmo Lee, Doyun Choi, Moongi Choi +1In-Context Example SelectionTabular Foundation Models

  10. Where Computation Lives Inside TabPFN: Causal Localisation of Attention Head Function

    Jun 11, 2026Atharva Gupta, Dhruv Kumar, Murari Mandal +1Attention Head SpecializationAttention Head Analysis

  11. Tabular Foundation Models for Clinical Survival Analysis via Survival-Aware Adaptation

    Jun 10, 2026Minh-Khoi Pham, Luca Cotugno, Alina Sirbu +3Tabular Foundation ModelsSurvival Analysis

  12. TabSwift: An Efficient Tabular Foundation Model with Row-Wise Attention

    Jun 5, 2026Si-Yang Liu, Han-Jia YeTabular Foundation ModelsEfficient Inference

  13. Towards Unified and Data-Efficient Prognostics and Health Management with Tabular Foundation Models

    Jun 3, 2026Raffael Theiler, Lev Telyatnikov, Leandro Von Krannichfeldt +1Tabular Foundation ModelsRUL Estimation

  14. GOTabPFN: From Feature Ordering to Compact Tokenization for Tabular Foundation Models on High-Dimensional Data

    Jun 3, 2026Al Zadid Sultan Bin Habib, Md Younus Ahamed, Prashnna Kumar Gyawali +2Tabular Foundation ModelsTabular Prediction

  15. Towards Pretraining Text Encoders for TabPFN

    Jun 3, 2026Mustafa Tajjar, Alexander Pfefferle, Lennart Purucker +1Tabular Foundation ModelsFine-Tuning

  16. SurvPFN: Towards Foundation Models for Survival Predictions

    Jun 3, 2026Samuel Böhm, Lennart Purucker, Frank Hutter +1Tabular Foundation ModelsSurvival Analysis

  17. OpenRFM: Dissecting Relational In-Context Learning

    Jun 3, 2026Zhikai Chen, Junyu Yin, Jialiang Gu +5Relational Foundation ModelsSynthetic Data Pretraining

  18. Speedrunning Tabular Foundation Model Pretraining

    Jun 2, 2026Salih Bora Ozturk, Alexander Pfefferle, Frank HutterTabular Foundation ModelsTabular Prediction

  19. Segment-driven Structural Induction and Semantic Alignment for Heterogeneous Tabular Representation

    Jun 1, 2026Woojun Jung, Susik YoonTabular Foundation ModelsSelf-Supervised Pre-Training

  20. On the Uncertainty Quantification Ability of Tabular Foundation Models

    May 31, 2026Tyler R. Johnson, Kian Ben-Jacob, Nima Negarandeh +2Tabular Foundation ModelsUncertainty Quantification

  21. High Performance, Low Reliability: Uncertainty Benchmarking for Tabular Foundation Models

    May 27, 2026José Lucas De Melo Costa, Fabrice Popineau, Arpad Rimmel +1Tabular Foundation ModelsUncertainty Quantification

  22. Explaining Tabular Foundation Model Differences Through Meta-Features

    May 27, 2026Markus Herre, Andrej Tschalzev, Sascha Marton +1Tabular Foundation ModelsTabular ML

  23. LUCoS: Latent Unsupervised Context Selection for Tabular Foundation Models

    May 26, 2026Oroel Ipas, Guillermo Gomez-Trenado, Rocío Romero-Zaliz +1Tabular Foundation ModelsTabular ICL

  24. Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shift

    May 26, 2026Yusuf Brima, Marcellin Atemkeng, Lansana Hassim Kallon +4Tabular Foundation ModelsFew-Shot Learning

  25. Auditing and Fixing Economic Validity in Tabular Foundation Models for Discrete Choice

    May 26, 2026Yingshuo Wang, Xian Sun, Yanhang Li +2Tabular Foundation ModelsMonotonicity Constraints