Tabular ICL

ICL: In-Context Learning

Ask about this topic

Momentum

9 papers in the last four weeks, up 125% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 68

All topics
CardsList

  1. Thinking in Depth: Retrospective Inference for Tabular Foundation Models

    Oct 7, 2026Hao-Run Cai, Si-Yang Liu, Zi-Jian Cheng +8Tabular Foundation ModelsTabular ICL

    School of Artificial Intelligence, Nanjing University · National Key Laboratory for Novel Software Technology, Nanjing University

  2. GeneICL: A Tabular Foundation Model for Bulk Transcriptomics

    Oct 6, 2026Michael Bohl, Alexander Theus, David Wissel +1Tabular Foundation ModelsClinical Outcome Prediction

    ETH Zurich · Max Planck Institute for Intelligent Systems · Swiss Institute of Bioinformatics +1

  3. The Standardization Trap: Certifying Joint Label Processing in Tabular Foundation Models

    Oct 6, 2026Duong Nguyen, Nicolas Chesneau, Milan BhanTabular Foundation ModelsTransformer Interpretability

    Ekimetrics

  4. TICDA: Tabular In-Context Data Attribution

    Oct 6, 2026Yacine Benihaddadene, Milan Bhan, Eliot Dugelay +4Tabular Foundation ModelsTabular ICL

    Ekimetrics · ETH Zurich

  5. TAFFY: A Task-Adaptive Tabular Foundation Model with In-Context Diversity

    Oct 6, 2026Zijian Li, Xiangchen Song, Gongxu Luo +7Synthetic Data PretrainingTabular Foundation Models

    Carnegie Mellon University · Mohamed bin Zayed University of Artificial Intelligence · Guangdong University of Technology +1

  6. Closing the Context Gap: Activation Alignment for Tabular In-Context Learning

    Oct 5, 2026Yoel ZeldesTabular Foundation ModelsTabular ICL

    Independent Researcher

  7. Rethinking Tabular Foundation Models On Data Streams

    Oct 4, 2026Nilesh Verma, Daniel Nowak-Assis, Afonso Lourenço +4Tabular Foundation ModelsTabular ICL

    AI Institute, University of Waikato, New Zealand · LIP6, CNRS, Sorbonne Universit´e, France · GECAD, Polytechnic of Porto, Portugal

  8. Distillation of Tabular Foundation Models into Efficient Predictors

    Oct 1, 2026Minho Jeong, Dooho Lee, Jinmo Lee +1Tabular Foundation ModelsEfficient Neural Network Inference

    Nums AI

  9. Molecular Property Prediction under Structural Shift with Tabular Foundation Models

    Sep 30, 2026Jinmo Lee, Dooho Lee, Minho Jeong +1Tabular Foundation ModelsMolecular Property Prediction

    Nums AI

  10. LoopICL: Looping a single transformer block to solve tabular tasks

    Sep 28, 2026Amir Rezaei Balef, Katharina EggenspergerTabular Foundation ModelsCost-Aware Inference

    TU Dortmund University, Dortmund, Germany · Lamarr Institute for Machine Learning and Artificial Intelligence, Dortmund, Germany · University of Tübingen, Tübingen, Germany

  11. Benchmarking Attention for Tabular Foundation Models

    Sep 25, 2026Maximilian Schambach, Clemens Biehl, Sam ThelinTabular Foundation ModelsEfficient Attention

    SAP SE, Germany

  12. SwitchPFN: Shared Switching Dynamics for Frozen In-Context Time Series Classification

    Sep 24, 2026Zhenyi Zhu, Jacqueline Pang, Peilin Shen +7Tabular Foundation ModelsTime Series Classification

    The Chinese University of Hong Kong, Hong Kong · Cornell University, USA · Southeast University, China +7

  13. Support-Compiled Feature Folding: More Evidence at Lower Memory Across Tabular Foundation Models

    Sep 23, 2026Tian Zhou, Beverly Jin, Xue Wang +6Tabular Foundation ModelsMemory-Efficient Inference

    Ant Group · Independent Researcher

  14. What Do Tabular Foundation Models Compute In Context? In-Situ Representation Refinement through Attention-Gated Updates

    Sep 23, 2026Tian Zhou, Beverly Jin, Linxiao Yang +6Tabular Foundation ModelsIn-Context Learning

    Ant Group · Independent Researcher

  15. TabPFN-3.5: Technical Report

    Sep 15, 2026Benjamin Jäger, Nick Erickson, Léo Grinsztajn +44Tabular Foundation ModelsInference-Time Optimization

  16. Xiaomi-TabLDM: A Tabular Foundation Model Technical Report

    Sep 3, 2026Xiaomi-TabLDM Team, :, Penghui Wang +10Synthetic Data PretrainingTabular Foundation Models

    Xiaomi

  17. Balanced Adaptive Prototype Selection for Scalable TabPFN Inference on Large-Scale Tabular Data

    Aug 13, 2026Mahboobe Jadid, Melika Rezaye Garkani, Ali MousaviTabular Foundation ModelsTabular ICL

    Department of Computer Engineering Ne. C., Islamic Azad University Neyshabur, Iran

  18. TACTICL: Task-Aware Compression of Tabular ICL Models

    Aug 11, 2026Mykhailo Koshil, Matthias Feurer, Katharina EggenspergerModel CompressionTabular Foundation Models

    TU Dortmund University, Germany · Lamarr Institute for Machine Learning and Artificial Intelligence, Germany

  19. In-Context Density Estimation for Tabular Data

    Aug 10, 2026Patryk Marszałek, Jacek Tabor, Marek ŚmiejaEnergy-Based ModelsUnsupervised Anomaly Detection

    Faculty of Mathematics and Computer Science, Jagiellonian University, Kraków, Poland

  20. Bootstrap-Conditioned Action Selection with Tabular Foundation Models

    Aug 6, 2026Devansh Gupta, Shiv Tavker, Dmitry Efimov +3Tabular Foundation ModelsRL Exploration

    Amazon Science

  21. EdgeLM: Edge Demonstrations for Language Models' Table Understanding

    Aug 5, 2026Soroush Omidvartehrani, Mohammadamin Habibollah, Mohammadreza Daviran +1In-Context Example SelectionIn-Context Learning

    University of Alberta, Canada

  22. Enhancing Tabular Learners with Context-Aware Semantic Embeddings

    Aug 4, 2026Günther Schindler, Maximilian Schambach, Johannes HöhneTabular Foundation ModelsRepresentation Learning

    SAP SE

  23. TabDPT-Turbo: Efficient In-Context Learning for Tabular Prediction

    Aug 2, 2026Rasa Hosseinzadeh, Alex Labach, Zexin Xue +3Tabular Foundation ModelsTabular ICL

    Layer 6 AI, Toronto, Canada · Cohere, Toronto, Canada

  24. Memory Efficient Tabular Foundation Models

    Jul 30, 2026Shuting Luo, Monika Mikhail Kanaan, Cameron Gordon +2Model CompressionTabular Foundation Models

    Commonwealth Bank of Australia, Australia · Australian Institute for Machine Learning, University of Adelaide, Adelaide, Australia

  25. Understanding Context Sampling in TabPFN on Small Tabular Datasets

    Jul 29, 2026Mohammed AbdullahTabular Foundation ModelsTabular Classification

    Department of AI & Data Science Anna University

  26. Entangled by Design: Spurious Intra-Variable Signal Routing in Tabular In-Context Learners

    Jul 28, 2026Athanasios Vlontzos, Giorgos Papanastasiou, Bernhard Kainz +1Spurious Correlation RobustnessTabular ICL

    Hologen AI London, UK · Mathematics Research Centre Academy of Athens Athens, GR · FAU Erlangen Nuremberg Imperial College London Erlangen, DE & London, UK +1

  27. In-Context Time Series Classification with Random Convolutional Features

    Jul 21, 2026Joscha Cüppers, Jilles VreekenTabular Foundation ModelsTime Series Classification

    CISPA Helmholtz Center for Information Security

  28. Topological Signatures of Context-Level Reliability in TabPFN

    Jul 20, 2026James Hu, Mahdi GhelichiTabular Foundation ModelsNeural Representation Geometry

    Model Development Innovation, Risk Management TD Bank, Toronto, Canada

  29. Tabular Foundation Models for Discrete Choice Estimation

    Jul 14, 2026Liu Liu, Dan ZhangTabular Foundation ModelsDiscrete Choice Modeling

    Leeds School of Business, University of Colorado Boulder

  30. Context-Constrained Transfer Learning for Tabular Foundation Models via Data Distillation

    Jul 6, 2026Yijun Lin, Sai LiTabular Foundation ModelsDataset Distillation

    Renmin University of China · Tsinghua University

  31. TabPATE: Differentially Private Tabular In-Context Learning Without Public Data

    Jun 30, 2026Dariush Wahdany, Matthew Jagielski, Jesse C. Cresswell +2Tabular Foundation ModelsDifferential Privacy

    CISPA · Anthropic · Layer 6 AI

  32. Probing Memorization of Tabular In-Context Learning

    Jun 30, 2026Francesco Capano, Jonas BöhlerTabular Foundation ModelsMembership Inference Attacks

    SAP SE, Walldorf, Germany.

  33. Can Tabular In-Context Learners Generalize to Biomolecular Property Prediction?

    Jun 30, 2026Davy Guan, Lu Zhang, Asiri Wijesinghe +7Tabular Foundation ModelsProtein Fitness Prediction

    Commonwealth Scientific and Industrial Research Organisation (CSIRO), Australia

  34. FlexTab: A Flexible Encoder-Decoder Architecture for In-Context Learning Across Diverse Tabular Tasks

    Jun 29, 2026Marek Polewczyk, Maximilian Schambach, Marco Spinaci +2Tabular Foundation ModelsTabular Anomaly Detection

    1SAP SE · 2SAP France

  35. Privacy Vulnerabilities of Attention Layers in Tabular Foundation Models and Protection of High-Risk Queries

    Jun 24, 2026Tânia Carvalho, Maxime CordyTabular Foundation ModelsMembership Inference Attacks

    SnT, University of Luxembourg · Luxembourg

  36. Are Tabular Foundation Models Robust to Realistic Query Distribution Shifts in Microbiome Data?

    Jun 23, 2026Giulia Perciballi, Ahmad Fall, Federica Granese +2Distribution Shift RobustnessTabular Foundation Models

    IRD, Sorbonne Université, Unité de Modélisation Mathématique et Informatique des Systèmes Complexes (UMMISCO), Paris, France · Inria, CNRS, I3S, Université Côte d’Azur, Valbonne, France · INSERM, Nutrition et Obésités; Approches Systémiques, NutriOmique, AP-HP, Hôpital Pitié-Salpêtrière, Paris, France

  37. Bounded Context Management for Tabular Foundation Models on Stream Learning

    Jun 17, 2026Jinmo Lee, Doyun Choi, Moongi Choi +1In-Context Example SelectionTabular Foundation Models

    Department of Computer Science and Engineering, Seoul National University, Seoul, Republic of Korea · The Kim Jaechul Graduate School of AI, KAIST, Daejeon, Republic of Korea.

  38. Where Computation Lives Inside TabPFN: Causal Localisation of Attention Head Function

    Jun 11, 2026Atharva Gupta, Dhruv Kumar, Murari Mandal +1Tabular Foundation ModelsAttention Head Analysis

    Department of Computer Science, Birla Institute of Technology and Science, Pilani, India · School of Computer Engineering, Kalinga Institute of Industrial Technology, Bhubaneswar, India · Birla AI Labs, Office of Ananya Birla, Aditya Birla Group, India

  39. CRUMB: Efficient Prior Fitted Network Inference via Distributionally Matched Context Batching

    Jun 9, 2026Jamie Heredge, Mattia J. Villani, Pranav Deshpande +2In-Context LearningPrior-Data Fitted Networks

    Global Technology Applied Research, JPMorganChase, New York, NY 10001, USA

  40. In-Context Learning for Latent Space Bayesian Optimization

    Jun 8, 2026Tuan A. Vu, Harri Lähdesmäki, Julien MartinelliSynthetic Data PretrainingMolecular Optimization

    Aalto University

  41. In-Context Learning for the Imputation of Public Opinion Data with Large Language Models

    Jun 8, 2026Tobias Holtdirk, Georg Ahnert, Joseph W Sakshaug +1Incomplete Data ImputationLearning with Missing Data

    LMU Munich · Munich Center for Machine Learning · University of Mannheim +2

  42. TabSwift: An Efficient Tabular Foundation Model with Row-Wise Attention

    Jun 5, 2026Si-Yang Liu, Han-Jia YeTabular Foundation ModelsEfficient Inference

    School of Artificial Intelligence, Nanjing University, China · National Key Laboratory for Novel Software Technology, Nanjing University, China.

  43. Towards Unified and Data-Efficient Prognostics and Health Management with Tabular Foundation Models

    Jun 3, 2026Raffael Theiler, Lev Telyatnikov, Leandro Von Krannichfeldt +1Tabular Foundation ModelsRUL Estimation

    IMOS Lab, EPFL, Lausanne, Switzerland

  44. OpenRFM: Dissecting Relational In-Context Learning

    Jun 3, 2026Zhikai Chen, Junyu Yin, Jialiang Gu +5Relational Foundation ModelsSynthetic Data Pretraining

    Michigan State University · George Mason University · Georgia Institute of Technology +1

  45. When Tabular Foundation Models Transfer Across Modalities: A Systematic Evaluation Across 95 Datasets, 7 Modalities, and Two Regimes

    Jun 1, 2026Julien LafranceCross-Modal LearningTabular Foundation Models

    Télécom Paris, Institut Polytechnique de Paris · Palaiseau, France

  46. Algorithmic Recourse of In-Context Learning for Tabular Data

    May 29, 2026Wenshuo Dong, Jiaming Zhang, Shaopeng Fu +3Tabular ICLAlgorithmic Recourse

    King Abdullah University of Science and Technology, Saudi Arabia · Mohamed bin Zayed University of Artificial Intelligence, United Arab Emirates · University of Copenhagen, Denmark +2

  47. LUCoS: Latent Unsupervised Context Selection for Tabular Foundation Models

    May 26, 2026Oroel Ipas, Guillermo Gomez-Trenado, Rocío Romero-Zaliz +1Tabular Foundation ModelsTabular ICL

    1Andalusian Research Institute in Data Science and Computational Intelligence (DaSCI) · Department of Computer Science and Artificial Intelligence (DECSAI) · 3Research Center in Information and Communication Technologies (CITIC) +1

  48. LLMTabBench: Evaluating LLMs on Binary Tabular Classification From Zero to Few Shots

    May 23, 2026Daria Grushina, Kseniia Kuvshinova, Alina Kostromina +3Zero-Shot LearningLLM Evaluation

    Sb AI Lab, HSE University, NES · NES · Russia +4

  49. Is TabPFN the Silver Bullet for Insurance Pricing?

    May 21, 2026Bruno Deprez, Wouter Verbeke, Tim VerdonckTabular Foundation ModelsTabular ICL

    KU Leuven · University of Antwerp-imec

  50. Learning Causal Orderings for In-Context Tabular Prediction

    May 21, 2026Sascha Xu, Sarah Mameche, Jilles VreekenIncomplete Data ImputationCausal Structure Learning

    CISPA Helmholtz Center

  51. A Mechanistic Study of Tabular Foundation Models

    May 20, 2026Marin Biloš, James T. Wilson, Anderson Schneider +1Tabular Foundation ModelsMechanistic Interpretability

    Machine Learning Research, Morgan Stanley

  52. When Tabular Foundation Models Meet Strategic Tabular Data: A Prior Alignment Approach

    May 19, 2026Xinpeng Lv, Yunxin Mao, Renzhe Xu +13Tabular Foundation ModelsStrategic Classification

    College of Computer, National University of Defense Technology, Changsha, China · Institute for Theoretical Computer Science, Shanghai University of Finance and Economics, Shanghai, China · State Key Lab of General AI, School of Intelligence Science and Technology, Peking University, Beijing, China +3

  53. TabQL: In-Context Q-Learning with Tabular Foundation Models

    May 18, 2026Qisai Liu, Zhanhong Jiang, Timilehin Ayanlade +4Deep Q-LearningQ-Learning

    Department of Mechanical Engineering Iowa State University Ames, IA 50011 · Translational AI Center Iowa State University Ames, IA 50011 · Department of Computer Science Iowa State University Ames, IA 50011 +1

  54. Pocket Foundation Models: Distilling TFMs into CPU-Ready Gradient-Boosted Trees

    May 18, 2026Aditya Tanna, Nassim Bouarour, Mohamed Bouadi +2Tabular Foundation ModelsGradient-Boosted Decision Trees

    Lexsi Labs

  55. Data Presentation Over Architecture: Resampling Strategies for Credit Risk Prediction with Tabular Foundation Models

    May 18, 2026Aditya Tanna, Mitul Solanki, Mohamed Bouadi +3Class-Imbalanced LearningTabular Foundation Models

    Lexsi Labs

  56. TabH2O: A Unified Foundation Model for Tabular Prediction

    May 18, 2026Pascal Pfeiffer, Dmitry Gordeev, Mathias Müller +6Tabular Foundation ModelsTabular Classification

  57. TabPFN-MT: A Natively Multitask In-Context Learner for Tabular Data

    May 16, 2026Cormac Cureton, Narges ArmanfardTabular Foundation ModelsEfficient Neural Network Inference

    McGill University · Mila - Quebec AI Institute · Montreal, QC, Canada

  58. TabPFN-3: Technical Report

    May 13, 2026Léo Grinsztajn, Klemens Flöge, Oscar Key +38Tabular Foundation ModelsEfficient Neural Network Inference

  59. VIP-COP: Context Optimization for Tabular Foundation Models

    May 13, 2026Yilong Chen, Xueying Ding, Leman AkogluIn-Context Example SelectionTabular Foundation Models

    Carnegie Mellon University

  60. PromptDx: Differentiable Prompt Tuning for Multimodal In-Context Alzheimer's Diagnosis

    May 9, 2026Lujia Zhong, Yihao Xia, Shuo Huang +2Multimodal ICLMedical Diagnosis

    Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California · Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California · Alfred E. Mann Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California