cs.LGJul 18, 2025

Are Kolmogorov-Arnold Networks (KANs) Suitable for Imbalanced Data Classification?

Authors: Pankaj Yadav, Vivek Vijay

Abstract

Kolmogorov-Arnold Networks (KANs) parameterize each connection as a learnable univariate B-spline, offering native feature-level interpretability. Whether this locality helps or hinders under class imbalance, where minority sparsity may leave spline edges without enough local observations to update reliably, remains unexamined. We evaluate KANs against capacity-matched Multilayer Perceptrons (MLPs) and XGBoost across ten imbalanced tabular datasets under three conditions: native class distribution, Focal Loss, and SMOTE-Tomek resampling, within a parameter-parity, two-phase framework. Under the native distribution, KAN spline activations collapse in minority-sparse regions, showing stronger majority-class bias than the matched MLP. Focal Loss yields negligible improvement, as it reweights gradients without providing the localized observations needed for discriminative curvature. Conversely, SMOTE-Tomek resampling lets spline activations recover structured minority-class representations, achieving the best cohort-wide rank and a large, statistically significant gain over unmitigated KANs, though not over resampled baselines. KAN's native spline interpretability directly reveals these dynamics via learned activation profiles, proving representational change rather than threshold recalibration without post-hoc attribution. However, these interpretability gains incur substantially higher training overhead than a parameter-matched MLP across all conditions, with no strategy-dependent latency reduction. Thus, KANs are conditionally suitable for imbalanced tabular classification: effective and interpretable with data-level resampling, yet costly relative to simpler alternatives without it.

Figures & tables

Explore similar work

CardsList
  1. Kolmogorov-Arnold Networks vs. Multi-Layer Perceptrons: A Rigorous Statistical Benchmark on Clinical Tabular Data

    Nov 2, 2026Rafał Wodziński, Paweł SzczerbiakKolmogorov-Arnold NetworksTabular Classification

  2. Kolmogorov-Arnold Networks: Curse of Dimensionality and Structural Bias

    Oct 15, 2026Yunhao Ni, Yuxin Guo, Jie Luo +2Curse of DimensionalityKolmogorov-Arnold Networks

  3. Is the Statistical Advantage Worth the Cost? An Empirical Comparison of KANs and MLPs for Structured Data Classification

    Jul 15, 2026Matthew Steven P. Toledo, Justine Raphael H. Jacinto, Vivekjeet Singh Chambal +3Multilayer PerceptronsTabular Classification