cs.LGNov 3, 2026

Rethinking GA2Ms: performance and out-of-distribution generalisation

Authors: George Dimitriadis, Damian Machlanski, Paul Clarke, Spyridon Samothrakis

Organizations: Computer Science and Electronic Engineering Department of the University of Essex · School of Engineering at the University of Edinburgh · Causality in Healthcare AI Hub (CHAI) · Institute for Social and Economic Research and the ESRC Research Centre on Micro-Social Change (MiSoC), Univesrity of Essex

Abstract

Generalised Additive Models (GAMs) are a cornerstone of interpretable machine learning, offering transparent predictions through structured additive decompositions. Despite advances from classical GAMs to modern neural and spline-based variants, two notable gaps remain. First, comprehensive benchmarking of spline-based GAMs on large-scale tabular learning tasks, the dominant modality in applied settings, is lacking. Second, their robustness under distribution shift, a setting where structured inductive biases should confer advantages, remains unexplored. We propose a multi-resolution, higher-order Composite Generalised Additive Model (CoGA2M) and evaluate it on the TALENT benchmark suite. CoGA2M ranks in the top third across all baselines (29 for regression, 32 for classification), establishing competitive performance with state-of-the-art tabular methods. We further extend TALENT with out-of-distribution (OOD) splits exhibiting train-test distributional shift and benchmark CoGA2M against LightGBM, a consistently top-performing model on TALENT. Under distribution shift, CoGA2M outperforms LightGBM, demonstrating a clear structural advantage. Our results position spline-based GAMs as strong contenders for tabular prediction and reveal a previously unrecognised benefit of additive structure in the OOD regime.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Empirical Evaluation of Out-Of-Distribution Performance of Tabular Foundation Models

    Jul 28, 2026Malena Loza, David Chushig-Muzo, Eva Milara +3Distribution Shift RobustnessTabular Foundation Models

  2. Selecting Feature Interactions for Generalized Additive Models by Distilling Foundation Models

    Apr 14, 2026Jingyun Jia, Chandan Singh, Rich Caruana +1Feature Interaction Modeling