Tabular Foundation Models

Follow this topic Ask about this topic

Recent momentum

-50%

5 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Tabular Foundation Models.

Period ending 2026-09-07

3 new papers

A weekly snapshot of new work published in Tabular Foundation Models.

87 papers

Latest in Tabular Foundation Models

Open your feed →

Attention Quantization for Tabular Foundation Models
Sep 14, 2026Jonas M. Kübler, Benjamin Jäger, Klemens Flöge +2Tabular Foundation Models
Target leakage, not model class, explains reported accuracy in survey-based cardiovascular screening: a leakage-tiered audit of glass-box and tabular foundation models
Sep 11, 2026Raad Bin Tareaf, Murad Al-Rajab, Samia Loucif +2Area Under The Receiver Operating Characteristic Curve Cardiometabolic Risk
Streaming Hierarchical Inference with Tabular Foundation Models
Sep 7, 2026Vitor Crista, Afonso Lourenço, Diogo Martinho +1Tabular Foundation Models Efficient Inference System
Xiaomi-TabLDM: A Tabular Foundation Model Technical Report
Sep 3, 2026Xiaomi-TabLDM Team, :, Penghui Wang +10Tabular Foundation Models Predictive Performance
Context Window Failures in Relational Foundation Models
Aug 31, 2026Denis Oliveira Correa, Francisco Galuppo AzevedoRelational Tabular Foundation Models
TSPFN: A Temporal Tabular Foundation Model for Physiological Time Series Classification
Aug 31, 2026Jérémie Stym-Popper, Clément Rambour, Federica Granese +2Physiological Signals Electronic Health Record Foundation Models
Balanced Adaptive Prototype Selection for Scalable TabPFN Inference on Large-Scale Tabular Data
Aug 13, 2026Mahboobe Jadid, Melika Rezaye Garkani, Ali MousaviTabular Foundation Models Tabular Data
TACTICL: Task-Aware Compression of Tabular ICL Models
Aug 11, 2026Mykhailo Koshil, Matthias Feurer, Katharina EggenspergerTabular Foundation Models Tabular Learning
Bootstrap-Conditioned Action Selection with Tabular Foundation Models
Aug 6, 2026Devansh Gupta, Shiv Tavker, Dmitry Efimov +3In-Context Learning Action Selection
SkillTFM: Gated Skill Evolution for Training-Free Adaptation of Tabular Foundation Models
Aug 6, 2026Yi He, Zhengkang Guan, Anpeng Wu +3Tabular Foundation Models Tabular Learning
Do Tabular Foundation Models Agree with Themselves?
Aug 6, 2026Christian Klötergens, Vijaya Krishna Yalavarthi, Lars Schmidt-Thieme +1Tabular Foundation Models Posterior
TabDPT-Turbo: Efficient In-Context Learning for Tabular Prediction
Aug 2, 2026Rasa Hosseinzadeh, Alex Labach, Zexin Xue +3Tabular Foundation Models In-Context Learning
From field-scale to large-scale spectral libraries: Tabular foundation models in soil spectroscopy
Aug 1, 2026Viacheslav Barkov, Jonas Schmidinger, Robin Gebbers +1Spectra Tabular Foundation Models
Memory Efficient Tabular Foundation Models
Jul 30, 2026Shuting Luo, Monika Mikhail Kanaan, Cameron Gordon +2Tabular Foundation Models Tabular Learning
Empirical Evaluation of Out-Of-Distribution Performance of Tabular Foundation Models
Jul 28, 2026Malena Loza, David Chushig-Muzo, Eva Milara +3Tabular Foundation Models Out-Of-Distribution
In-Context Time Series Classification with Random Convolutional Features
Jul 21, 2026Joscha Cüppers, Jilles VreekenTime-Series Classification Tabular Foundation Models
Revisiting data-driven dynamic security assessment with a tabular foundation model
Jul 17, 2026Olayiwola Arowolo, Maosheng Yang, Jochen CremerPower Systems Tabular Foundation Models
Tabular Foundation Models for Discrete Choice Estimation
Jul 14, 2026Liu Liu, Dan ZhangDiscrete Choice Models Tabular Foundation Models
Surprisingly Simple and Effective Multi-Domain Graph Foundation Model through Graph-to-Table Alignment
Jul 13, 2026Chunyu Hu, Tianyin Liao, Ge Lan +4Multimodal Graph Foundation Learning Tabular Foundation Models
Parameter-Free Encoders Remain Viable for RDB Foundation Models
Jul 6, 2026Linjie Xu, David WipfTabular Foundation Models Text Encoders
Context-Constrained Transfer Learning for Tabular Foundation Models via Data Distillation
Jul 6, 2026Yijun Lin, Sai LiTabular Foundation Models Transfer Learning
When Does Small Data Work? Accuracy and Efficiency Trade-offs Between Tabular Foundation Models and Conventional Methods for Crowd-State Classification at Hajj and Umrah
Jul 4, 2026AlJawharh S. AlOtaibi, Mohamed Eltahir, Jude AlSubaieTabular Foundation Models Tabular Learning
Can Tabular In-Context Learners Generalize to Biomolecular Property Prediction?
Jun 30, 2026Davy Guan, Lu Zhang, Asiri Wijesinghe +7Molecular Property Prediction Tabular Foundation Models
Beyond IID: How General Are Tabular Foundation Models, Really?
Jun 29, 2026Lennart Purucker, Andrej Tschalzev, Nick Erickson +7Tabular Foundation Models Benchmark Datasets
KnowsTFM: Knowledge-Informed Fine-Tuning of Small Tabular Foundation Models
Jun 29, 2026Boshko Koloski, Xiangjian Jiang, Senja Pollak +3Tabular Foundation Models Foundation Model
Towards Evaluating Data Priors for Tabular Foundation Models
Jun 28, 2026Zeynep Türkmen, Kürşat Kaya, Alexander Pfefferle +1Tabular Foundation Models Priors
Statistically Indistinguishable, Operationally Distinct: A Formal Barrier for Tabular Foundation Models
Jun 27, 2026Tassilo Klein, Johannes HoffartTabular Foundation Models Counter Turing Test
Privacy Vulnerabilities of Attention Layers in Tabular Foundation Models and Protection of High-Risk Queries
Jun 24, 2026Tânia Carvalho, Maxime CordyTabular Foundation Models Membership Inference Attacks
Are Tabular Foundation Models Robust to Realistic Query Distribution Shifts in Microbiome Data?
Jun 23, 2026Giulia Perciballi, Ahmad Fall, Federica Granese +2Tabular Foundation Models Bacterial Colony Counting
Reinforcement Learning Foundation Models Should Already Be A Thing
Jun 17, 2026Abdelrahman Zighem, Jill-Jênn VieTabular Foundation Models Wireless Foundation Models
Bounded Context Management for Tabular Foundation Models on Stream Learning
Jun 17, 2026Jinmo Lee, Doyun Choi, Moongi Choi +1Tabular Learning Tabular Foundation Models
Where Computation Lives Inside TabPFN: Causal Localisation of Attention Head Function
Jun 11, 2026Atharva Gupta, Dhruv Kumar, Murari Mandal +1Tabular Foundation Models Linear Activation Steering
Tabular Foundation Models for Clinical Survival Analysis via Survival-Aware Adaptation
Jun 10, 2026Minh-Khoi Pham, Luca Cotugno, Alina Sirbu +3Survival Predictions Survival Analysis
TabSwift: An Efficient Tabular Foundation Model with Row-Wise Attention
Jun 5, 2026Si-Yang Liu, Han-Jia YeTabular Foundation Models Tabular Prior-Data Fitted Network
Towards Unified and Data-Efficient Prognostics and Health Management with Tabular Foundation Models
Jun 3, 2026Raffael Theiler, Lev Telyatnikov, Leandro Von Krannichfeldt +1Predictive Maintenance Prognostics
GOTabPFN: From Feature Ordering to Compact Tokenization for Tabular Foundation Models on High-Dimensional Data
Jun 3, 2026Al Zadid Sultan Bin Habib, Md Younus Ahamed, Prashnna Kumar Gyawali +2Tabular Foundation Models High-Dimensional
Data-efficient flood depth prediction through domain-aware coreset selection and tabular foundation models
Jun 3, 2026Lipai Huang, Adithi Srinath, Manas Singh +2Accurate Flood Prediction Surrogate Modeling
Towards Pretraining Text Encoders for TabPFN
Jun 3, 2026Mustafa Tajjar, Alexander Pfefferle, Lennart Purucker +1Tabular Foundation Models Patient-Specific Textual Embeddings
SurvPFN: Towards Foundation Models for Survival Predictions
Jun 3, 2026Samuel Böhm, Lennart Purucker, Frank Hutter +1Survival Predictions Survival Analysis
LimiX-2M: Mitigating Low-Rank Collapse and Attention Bottlenecks in Tabular Foundation Models
Jun 3, 2026Yuanrui Wang, Xingxuan Zhang, Han Yu +7Tabular Foundation Models Term Frequency-Inverse Document Frequency
OpenRFM: Dissecting Relational In-Context Learning
Jun 3, 2026Zhikai Chen, Junyu Yin, Jialiang Gu +5In-Context Learning Tabular Foundation Models
Staying Alive: Uncensored Survival Analysis with Tabular Foundation Models
Jun 2, 2026Mariana Vargas VieyraSurvival Analysis Time-To-Event Data
Speedrunning Tabular Foundation Model Pretraining
Jun 2, 2026Salih Bora Ozturk, Alexander Pfefferle, Frank HutterTabular Foundation Models Model Pretraining
When Tabular Foundation Models Transfer Across Modalities: A Systematic Evaluation Across 95 Datasets, 7 Modalities, and Two Regimes
Jun 1, 2026Julien LafranceTabular Foundation Models
On the Uncertainty Quantification Ability of Tabular Foundation Models
May 31, 2026Tyler R. Johnson, Kian Ben-Jacob, Nima Negarandeh +2Tabular Foundation Models Tabular Prior-Data Fitted Network
High Performance, Low Reliability: Uncertainty Benchmarking for Tabular Foundation Models
May 27, 2026José Lucas De Melo Costa, Fabrice Popineau, Arpad Rimmel +1Tabular Foundation Models Uncertainty Quantification
Explaining Tabular Foundation Model Differences Through Meta-Features
May 27, 2026Markus Herre, Andrej Tschalzev, Sascha Marton +1Tabular Foundation Models Model Evaluation
Few-shot Cross-country Generalization of Tabular Machine Learning and Foundation Models for Childhood Anemia Prediction under Distribution Shift
May 26, 2026Yusuf Brima, Marcellin Atemkeng, Lansana Hassim Kallon +4Tabular Foundation Models Tabular Learning
Auditing and Fixing Economic Validity in Tabular Foundation Models for Discrete Choice
May 26, 2026Yingshuo Wang, Xian Sun, Yanhang Li +2Discrete Choice Models Tabular Foundation Models
Is TabPFN the Silver Bullet for Insurance Pricing?
May 21, 2026Bruno Deprez, Wouter Verbeke, Tim VerdonckTabular Foundation Models Insurance
A Mechanistic Study of Tabular Foundation Models
May 20, 2026Marin Biloš, James T. Wilson, Anderson Schneider +1Tabular Foundation Models Inductive Bias
Tabular foundation models for robust calibration of near-infrared chemical sensing data
May 20, 2026Robin Reiter, Denis Cornet, Fabien Michel +2Tabular Foundation Models Infrared
Modular Multimodal Classification Without Fine-Tuning: A Simple Compositional Approach
May 20, 2026Herman Bergström, Aditya Mehrotra, Rahul G. KrishnanMultimodal Foundation Model Multimodal Learning
Machine-Learning-Enhanced Non-Invasive Testing for MASLD Fibrosis: Shallow-Deep Neural Networks Versus FIB-4, Tabular Foundation Models, and Large Language Models
May 19, 2026Athanasios Angelakis, Gabriele De Vito, Eleni-Myrto Trifylli +1Intrahepatic Cholangiocarcinoma Lung-Nodule Detector
When Tabular Foundation Models Meet Strategic Tabular Data: A Prior Alignment Approach
May 19, 2026Xinpeng Lv, Yunxin Mao, Renzhe Xu +13Tabular Foundation Models Tabular Prior-Data Fitted Network
TabQL: In-Context Q-Learning with Tabular Foundation Models
May 18, 2026Qisai Liu, Zhanhong Jiang, Timilehin Ayanlade +4Deep Q-Networks Q-Learning
Shaping the Prior: How Synthetic Task Distributions Determine Tabular Foundation Model Quality
May 18, 2026Mohamed Bouadi, Nassim Bouarour, Varun Kulkarni +3Tabular Foundation Models Priors
Distilling Tabular Foundation Models for Structured Health Data
May 18, 2026Aditya Tanna, Nassim Bouarour, Mohamed Bouadi +2Tabular Foundation Models Electronic Health Record Foundation Models
Ensembling Tabular Foundation Models - A Diversity Ceiling And A Calibration Trap
May 18, 2026Aditya Tanna, Yash Desai, Pratinav Seth +3Tabular Foundation Models Ensemble
Pocket Foundation Models: Distilling TFMs into CPU-Ready Gradient-Boosted Trees
May 18, 2026Aditya Tanna, Nassim Bouarour, Mohamed Bouadi +2Gradient Boosted Tree Tabular Foundation Models

Sep 14, 2026 · cs.LGJ/K move · Enter open · S save

Attention Quantization for Tabular Foundation Models

Jonas M. Kübler, Benjamin Jäger, Klemens Flöge, Noah Hollmann+1

With the recent rise and adoption of tabular foundation models, optimizing their inference performance becomes an emerging field for efficiency research. While the models are architecturally similar to transformer-based large language models (LLMs), the size and serving patterns differ significantly. We show that the focus should be on the attention calculation and less on weight or KV cache quantization, which are more popular in LLMs. We develop a quantization strategy for queries, keys, and values to FP8 and use explicit FP8 matrix multiplication instructions to speed up the attention calculation. We find that it is crucial to align the quantization error in the test rows with the quantization error in the training rows, as otherwise the accuracy drops drastically. Our Triton kernel achieves a speedup up to 1.7x over regular 16-bit kernels, and we show that on TabPFN-v3 and TabICLv2 there is no relevant accuracy loss across TabArena and BeyondArena.