cs.LGOct 13, 2026

A Controlled Evaluation of Curvature Inspired Scalar Feature Scaling for Domain Generalization

Authors: Sunny Gupta, Amit Sethi

Organizations: Indian Institute of Technology Bombay Mumbai, Maharashtra, India

Abstract

Domain-specific curvature is an appealing idea for domain generalization (DG), but curvature learning can denote substantially different computations. This paper evaluates one deliberately narrow implementation: the code calls it HyperDG, but it rescales Euclidean encoder features during training by learned positive scalars and uses an ordinary linear classifier on unscaled Euclidean features at inference. It does not implement a Lorentz or Poincaré representation, geodesic prediction, or a Sharpness-Aware Minimization inner loop. We audit the executed objective and evaluate six conditions on PACS, VLCS, Office Home, and TerraIncognita. The completed design contains 384 runs: six conditions, four held-out targets, and four run seeds per dataset. Checkpoints are selected using only the three source-validation environments. Inference first averages paired seed differences within each held-out target; targets, rather than 16 seed-by-target observations, are the per-dataset clusters. The full implementation's equal-dataset macro point estimate is 1.61 percentage points below native DomainBed ERM (95% clustered CI [-3.17, -0.04]). All four dataset point estimates favor ERM, but an exact four-dataset sign-flip test gives p = .125 and Holm-adjusted p = .250; we therefore claim no adjusted evidence of a difference. The cleaner domain-specificity contrast, separate learned source scales without their variance penalty versus one shared learned source scale, is -0.13 pp (95% CI [-0.53, 0.27]). Its 90% CI lies within a revision-stage ±1\pm 1 pp smallest effect of practical interest (TOST p = .003), supporting equivalence only for the source-selected suite macro, not every dataset, target, or final-step endpoint. The study thus supplies a bounded negative result for this scalar training package; it does not test or refute genuine hyperbolic representation learning.

Figures & tables

Explore similar work

CardsList
  1. Hierarchical Domain Generalization

    Jul 17, 2026Chenxiao Yang, Zhiyuan Li, Shai Ben-David +1Domain GeneralizationStatistical Learning Theory

  2. Chaos Is a LADDER: Domain Generalization Beyond Invariance via Reweighting

    Jul 29, 2026Yuhang Jiang, Fengchuan Zhang, Sanguo Zhang +1Causal Representation LearningDomain Adaptation

  3. Hyperbolic Graph Representation Learning: Embed in One Metric, Optimize with Another

    Oct 5, 2026Federico Larroca, Paola Bermolen, Marcelo Fiori +1Riemannian OptimizationHierarchical Representation Learning