cs.LGNov 11, 2026

TabOmics: A Small, Open Tabular Foundation Model for Wide Omics Data

Authors: Andrea López-García, Luis Bote-Curiel, Francisco Javier Gimeno-Blanes, José Luis Rojo-Álvarez, Sergio Muñoz-Romero

Organizations: Department of Signal Theory and Communications, Telematics and Computing, Universidad Rey Juan Carlos, Fuenlabrada, Spain · Department of Signal Theory and Communications, Universidad Miguel Hernández, Elche, Spain

Abstract

Omics studies often produce tables with thousands to tens of thousands of molecular features and few samples. Tabular foundation models use diverse strategies to predict labels for such tables, with some relying on in-context learning, while approaches to wide tables may involve subsampling, grouping, or compressing features. We present TabOmics, a small, open family of tabular foundation models with 7.3M parameters, pretrained exclusively on synthetic tables. TabOmics processes all features retained after preprocessing jointly and derives predictions, attention-derived feature-importance scores, and test sample embeddings from the same forward pass. On 46 classification tasks from three benchmarks of high-dimensional, low-sample-size tables, TabOmics v2.5 with eight ensemble members achieves the highest mean area under the receiver operating characteristic curve (AUROC) among the evaluated models (0.943), outperforming TabPFN-3.5 with eight members on 32 tasks despite having about 30 times fewer parameters. With a single member, TabOmics v2.5 reaches a mean AUROC of 0.941, versus 0.942 for TabPFN-3.5 with eight members, with no significant paired difference under the reported task-level analysis. On synthetic tables, its feature-importance scores achieve feature recovery similar to that of TabPFN-Wide, and its predictions remain above chance at 30,000 features. On breast cancer tasks, the top ranked genes include PAM50 genes, which define the subtype labels, indicating concordance with the label definition rather than independent biological validation. The code, model weights, training recipes, and experimental artifacts are publicly available.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. TabBench-Bio: A Living Benchmark for Machine Learning on High-Dimensional Biomedical Tables

    Sep 7, 2026Jules Kreuer, Sofiane Ouaari, Julia Hellmig +2Tabular Foundation ModelsTabular ML

  2. OmniTabBench: Mapping the Empirical Frontiers of GBDTs, Neural Networks, and Foundation Models for Tabular Data at Scale

    Apr 8, 2026Dihong Jiang, Ruoqi Cao, Zhiyuan Dang +8Tabular MLTabular Prediction

  3. Tabular foundation models for non-tabular tasks

    Aug 23, 2026Goran Nakerst, John Brennan, Wouter Beugeling +1Handwritten Digit RecognitionTabular Foundation Models