Tabular Representation Learning

Follow this topic Ask about this topic

Momentum

4 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 27

All topics

Thinking in Depth: Retrospective Inference for Tabular Foundation Models
Oct 7, 2026Hao-Run Cai, Si-Yang Liu, Zi-Jian Cheng +8Tabular Foundation Models Tabular ICL
School of Artificial Intelligence, Nanjing University · National Key Laboratory for Novel Software Technology, Nanjing University
Adapting prior-data fitted networks for tabular anomaly detection
Oct 5, 2026Maximilian Bershtman, Niv CohenTabular Anomaly Detection Unsupervised Anomaly Detection
Faculty of Electrical and Computer Engineering Technion – Israel Institute of Technology Haifa, Israel
SwitchPFN: Shared Switching Dynamics for Frozen In-Context Time Series Classification
Sep 24, 2026Zhenyi Zhu, Jacqueline Pang, Peilin Shen +7Tabular Foundation Models Time Series Classification
The Chinese University of Hong Kong, Hong Kong · Cornell University, USA · Southeast University, China +7
What Do Tabular Foundation Models Compute In Context? In-Situ Representation Refinement through Attention-Gated Updates
Sep 23, 2026Tian Zhou, Beverly Jin, Linxiao Yang +6Tabular Foundation Models In-Context Learning
Ant Group · Independent Researcher
Discovery-Driven Integration of Disjoint Tables via Text
Sep 22, 2026Md Ataur Rahman, Dimitris Sacharidis, Oscar Romero +1Cross-Modal Retrieval Tabular Representation Learning
UPC, BarcelonaTech Barcelona, Spain · Université Libre de Bruxelles Brussels, Belgium
InRTL: Effective Intra-Inter Interaction Learning for Relational Tables
Sep 14, 2026Weichen Li, Ken Zhong, Zheng Wang +2Tabular Representation Learning Relational Deep Learning
Shanghai Jiao Tong University Shanghai, China
H2Table: Hierarchical Hypergraph-Enhanced Large Language Models for Complex Table Reasoning
Sep 1, 2026Jia Ling, Yangfan Wang, Chen Tang +4Table QA Hierarchical Representation Learning
Harbin Institute of Technology · AI Research Center, Midea Group (Shanghai) Co., Ltd. · Changchun University of Science and Technology +1
Unlocking the Power of Medical Tabular Data via Semantic-Aware Multimodal Pre-training
Aug 11, 2026Yingsheng Liu, Haiming Li, Jingmin Zhu +6Cross-Modal Representation Learning Multimodal Pretraining
Faculty of Information Technology, Monash University, Melbourne, Australia · Monash University, Melbourne, Victoria, Australia · The University of Queensland, Brisbane, Queensland, Australia
Self-Supervised Representations for Binary Program Clustering: From Empirical Study to Retrieval-Augmented Learning
Aug 3, 2026Martin Mocko, Daniela ChudáRepresentation Learning Self-Supervised Learning
Faculty of Information Technology, Brno University of Technology, Brno, Czech Republic · Kempelen Institute of Intelligent Technologies (KInIT), Bratislava, Slovakia · Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Bratislava, Slovakia
Human Preference aligned Tabular Similarity
Jul 27, 2026Frederik Hoppe, Astrid Franz, Marianne Michaelis +2Human Preference Evaluation Tabular Representation Learning
CONTACT Software GmbH, Bremen, Germany
TEmBed-T: A Multi-Dimensional Benchmark for Table-Level Embeddings
Jul 27, 2026Ayeen Poostforoushan, Liane Vogel, Carsten BinnigTabular Representation Learning Information Retrieval
Independent Researcher · Technical University of Darmstadt · Technical University of Darmstadt & DFKI & hessian.AI
The Importance of Encoder Choice:A Tabular-Image Study
Jul 8, 2026Ilia Koloiarov, Diego Coello de Portugal Mecke, Vijaya Krishna Yalavarthi +2Representation Learning Multimodal Embedding
ISMLL & VWFS DARC · University of Hildesheim · Hildesheim, Germany +1
FlexTab: A Flexible Encoder-Decoder Architecture for In-Context Learning Across Diverse Tabular Tasks
Jun 29, 2026Marek Polewczyk, Maximilian Schambach, Marco Spinaci +2Tabular Foundation Models Tabular Anomaly Detection
1SAP SE · 2SAP France
Hyperbolic Manifold Constrained Tabular Neural Network
Jun 23, 2026Tian Li, Huizhi Liang, Lucy Robinson +1Tabular Classification Tabular Representation Learning
Newcastle University Newcastle upon Tyne, UK
Universal Encoders for Modular Relational Deep Learning
Jun 19, 2026Jakub Peleška, Gustav ŠírRelational Foundation Models Tabular Foundation Models
Czech Technical University in Prague, Karlovo náměstí 13, Prague, 121 35, Czechia
A Universal Dense Football Event Representation Based on TabTransformer
Jun 8, 2026Weiran Yang, Daniel Memmert, Maximilian Klemp-WeinsRepresentation Learning Feature Interaction Modeling
Institute of Exercise Training and Sport Informatics, German Sport University Cologne, Cologne, Germany
TRL-Bench: Standardizing Cross-Paradigm Representation-Level Evaluation of Tabular Encoders
Jun 8, 2026Wei Pang, Xiangru Jian, Hehan Li +10Representation Learning Tabular Representation Learning
The Chinese University of Hong Kong, Shenzhen · University of Waterloo · The University of Hong Kong +2
LimiX-2M: Mitigating Low-Rank Collapse and Attention Bottlenecks in Tabular Foundation Models
Jun 3, 2026Yuanrui Wang, Xingxuan Zhang, Han Yu +7Tabular Foundation Models Tabular Representation Learning
Stable AI · Tsinghua University
Segment-driven Structural Induction and Semantic Alignment for Heterogeneous Tabular Representation
Jun 1, 2026Woojun Jung, Susik YoonTabular Foundation Models Self-Supervised Pre-Training
Department of Computer Science & Engineering, Korea University, Seoul, South Korea.
MaskTab: Scalable Masked Tabular Pretraining with Scaling Laws and Distillation for Industrial Classification
May 12, 2026Bo Zheng, Yudong Chen, Zihua Xiong +4Tabular Foundation Models Self-Supervised Pre-Training
Zhejiang University · MyBank, Ant Group
MulTaBench: Benchmarking Multimodal Tabular Learning with Text and Image
May 11, 2026Alan Arazi, Eilam Shapira, Shoham Grunblat +8Tabular Foundation Models Representation Learning
Technion – Israel Institute of Technology · Prior Labs · NVIDIA +4
Tabular Foundation Model for Generative Modelling
May 10, 2026Xiangjian Jiang, Mingxuan Liu, Nikola Simidjievski +2Tabular Foundation Models Synthetic Tabular Data Generation
Department of Computer Science and Technology, University of Cambridge, UK · SAP SE · Télécom Paris, Institut Polytechnique de Paris, France +1
TabEmbed: Benchmarking and Learning Generalist Embeddings for Tabular Understanding
May 6, 2026Minjie Qiang, Mingming Zhang, Xiaoyi Bao +5Tabular Foundation Models Tabular ML
Natural Language Processing Lab, Soochow University, Suzhou, China · Ant Group, Hangzhou, China · The Hong Kong Polytechnic University, Hong Kong, China
Evaluating Tabular Representation Learning for Network Intrusion Detection
May 4, 2026Muhammad Usman Butt, Andreas Hotho, Daniel SchlörRepresentation Learning Network Intrusion Detection
Julius-Maximilians-Universität Würzburg Würzburg, Germany · Data Science Chair Center for Artificial Intelligence and Data Science Julius-Maximilians-Universität Würzburg Würzburg, Germany
ZAYAN: Disentangled Contrastive Transformer for Tabular Remote Sensing Data
Apr 30, 2026Al Zadid Sultan Bin Habib, Tanpia Tasnim, Md. Ekramul Islam +1Contrastive Learning Disentangled Representation Learning
Lane Dept. of Computer Science and Electrical Engineering* and Dept. of Geology & Geography+, West Virginia University, Morgantown, WV 26506, USA · Department of Computer Science and Engineering, Green University of Bangladesh, Narayanganj-1461, Bangladesh · Department of Computer Science and Engineering, Stamford University Bangladesh, Dhaka-1217, Bangladesh
Towards Universal Tabular Embeddings: A Benchmark Across Data Tasks
Apr 23, 2026Liane Vogel, Kavitha Srinivas, Niharika D'Souza +3Tabular Foundation Models Representation Learning
Technical University of Darmstadt · IBM Research, USA
TabEmb: Joint Semantic-Structure Embedding for Table Annotation
Apr 21, 2026Ehsan Hoseinzade, Ke Wang, Anandharaju Durai RajuRepresentation Learning Tabular Representation Learning
School of Computing Science Simon Fraser University Burnaby, Canada

Oct 7, 2026, cs.LGJ/K move · Enter open · S save

Thinking in Depth: Retrospective Inference for Tabular Foundation Models

Hao-Run Cai, Si-Yang Liu, Zi-Jian Cheng, Kun-Yang Yu+7

School of Artificial Intelligence, Nanjing University · National Key Laboratory for Novel Software Technology, Nanjing University

Tabular Foundation Models Tabular ICL Tabular Representation Learning

Open paper AskPDF arXiv

Tabular foundation models (TFMs) are pretrained across diverse tabular tasks and make predictions on a new table at inference time using its labeled examples as context. Most recent TFMs perform such in-context prediction with stacked Transformer layers, repeatedly transforming how examples are represented and compared. By tracing individual queries through several strong TFMs, we find that predictive refinement is highly uneven across depth and is often concentrated in later layers. This uneven refinement motivates us to reconsider how intermediate representations are constructed and reused throughout the network. We introduce Retro, a tabular foundation model based on retrospective inference, where later stages can explicitly revisit and recombine intermediate information produced earlier in the network. Retro organizes this process around two complementary operations: which intermediate information to revisit, and how the resulting contextual update should be shaped for each query. Attention Residuals address the former by adaptively reweighting contributions from different depths, while query-conditioned Gated Attention addresses the latter by modulating the attention output element-wise across representation dimensions. Our analysis shows that Retro shifts predictive refinement earlier and more broadly across depth, with different stages revising different subsets of queries in a pattern suggestive of multi-view refinement. Across TabArena, TALENT, and RelArena, Retro ranks among the top three and lies on the Pareto frontier. These results indicate that directly reusing intermediate representations provides a practical way to better exploit depth in TFMs.

Momentum

Related topics

Latest papers 27