Tabular ICL

ICL: In-Context Learning

Overview

Tabular in-context learning studies models that infer a table’s prediction rule from labeled examples supplied at inference time, often using foundation models pretrained on synthetic or real tabular tasks. Common approaches include prior-fitted transformers, retrieval and context-selection methods, and test-time adaptation; performance is often compared on suites such as TabArena, TALENT, and OpenML. Work now extends beyond classification and regression to anomaly detection, imputation, generation, survival analysis, and streaming settings. A central tension is how to scale context and broaden task coverage while controlling inference cost and ensuring robustness to distribution shift, noisy examples, and privacy risks.

Latest papers

CardsList

117 papers12 papers in the last four weeks, down 59% on the four weeks before. 0.1% of all new papers.

  1. Tabular Foundation Models in Financial Predictions

    Nov 10, 2026Ed deHaan, Allen H. HuangTabular Foundation ModelsTabular Prediction

  2. An Evaluation of Tabular Foundation Models as Training-Free World Models

    Nov 9, 2026Xian Yeow Lee, Ryoichi Takase, Ahmed FarahatWorld Model LearningWorld Models for Robotics

  3. StreamTab: Training-Free Temporal Link Prediction with Tabular Foundation Models

    Nov 6, 2026Mingqi Yang, Renqi WuTemporal Link PredictionDynamic Graph Learning

  4. When, Where, How: Active In-Context Learning for Tabular Foundation Models

    Nov 5, 2026Christian M. M. FreyActive LearningIn-Context Learning

  5. SNAPPerf: Software-Aware Tabular Foundation Model for Retraining-Free Performance Prediction of Configurable Systems

    Oct 31, 2026Amine Lbath, Massih-Reza Amini, Vadim OkunTabular Foundation ModelsTabular ICL

  6. TabAbax: A Tabular Foundation Model Technical Report

    Oct 31, 2026Zhixiong Cheng, Xiaoyun Gao, Shiyuan Han +2Tabular Foundation ModelsTabular ICL

  7. TabCUQ: Context-Uncertainty Quantification for Tabular Foundation Models

    Oct 29, 2026Yuebei Shi, Molei Liu, Zijian GuoUncertainty QuantificationTabular Foundation Models

  8. Interpretable by Design Tabular Prediction via In-Context Local Linear Learning

    Oct 29, 2026Ran Eisenberg, Steven Berger, Ofir LindenbaumInterpretable MLTabular ICL

  9. Recall or Relearn? A Mixture of In-Context Experts for Recurring Concept Drift

    Oct 27, 2026Zhangkai Wu, Xu Zhang, Zhihong Cui +2Concept DriftOnline Continual Learning

  10. Beyond the Vote: When Do LLMs Add Value to Retrieval-Based Tabular Classification?

    Oct 21, 2026Ziquan Wang, Yuxuan Nie, Jian Ma +1Tabular ICLRetrieval-Augmented ICL

  11. On Data Scaling in Tabular ML: More Data, Better Generalization?

    Oct 19, 2026Ivan Rubachev, Nikita Lazarev, Artem BabenkoTabular MLTabular Foundation Models

  12. FTFM: Factorized Tabular Foundation Models

    Oct 18, 2026Josif GrabockaTabular Foundation ModelsTabular ICL

  13. When Does Depth Help? Understanding Layerwise Inference in Tabular Foundation Models

    Oct 14, 2026Wenwen Gong, Haotian Gu, Zhen Yang +6Tabular Foundation ModelsTransformer Inference

  14. TabGift: A Context-Efficient Foundation Model for Tabular Data Generation

    Oct 12, 2026Yu-Sheng Li, Jun-Peng Jiang, Han-Jia YeSynthetic Tabular Data GenerationGenerative Modeling

  15. When Repeated Measurements Hurt Tabular Foundation Models

    Oct 12, 2026Yixiang Liu, Ruizhe Deng, Bibhas Chakraborty +2Tabular Foundation ModelsTabular Prediction

  16. Relational Learning as World Modeling

    Oct 12, 2026Zheyu Zhang, Gjergji KasneciAction-Conditioned World ModelsWorld Model-Based Planning

  17. TabMosaic: Unified In-Context Diffusion for Tabular Generative Tasks

    Oct 11, 2026Jayoung Kim, Sanghyun Hong, Noseong ParkSynthetic Tabular Data GenerationTabular Diffusion Models

  18. Recurrent In-Context Learning for Tabular Foundation Models

    Oct 10, 2026Tejas Vaidhya, Gaurav Sahu, Irina RishTabular Foundation ModelsTabular ICL

  19. Tabular Foundation Models Are Effectively Shallow

    Oct 9, 2026Irene Cannistraci, Julia E. VogtTransformer PruningTabular Foundation Models

  20. Test-Time Compute for Tabular Foundation Models: Mechanisms, Gains, and Limits

    Oct 8, 2026Kanghui Ning, Marin Biloš, James T. Wilson +5Tabular Foundation ModelsInference-Time Scaling

  21. Thinking in Depth: Retrospective Inference for Tabular Foundation Models

    Oct 7, 2026Hao-Run Cai, Si-Yang Liu, Zi-Jian Cheng +8Tabular Foundation ModelsTabular ICL

  22. GeneICL: A Tabular Foundation Model for Bulk Transcriptomics

    Oct 6, 2026Michael Bohl, Alexander Theus, David Wissel +1Tabular Foundation ModelsClinical Outcome Prediction

  23. TICDA: Tabular In-Context Data Attribution

    Oct 6, 2026Yacine Benihaddadene, Milan Bhan, Eliot Dugelay +4Tabular Foundation ModelsTabular ICL

  24. TAFFY: A Task-Adaptive Tabular Foundation Model with In-Context Diversity

    Oct 6, 2026Zijian Li, Xiangchen Song, Gongxu Luo +7Synthetic Data PretrainingTabular Foundation Models