cs.LGMar 11, 2026

Beyond the Class Subspace: Teacher-Guided Training for Reliable Out-of-Distribution Detection in Single-Domain Models

Authors: Hong Yang, Devroop Kar, Qi Yu, Travis Desell, Alex Ororbia

Organizations: Rochester Institute of Technology, Rochester, NY 14623, USA

Abstract

Out-of-distribution (OOD) detection methods perform well on multi-domain benchmarks, yet many practical systems are trained on single-domain data. We show that this regime induces a geometric failure mode, Domain-Sensitivity Collapse (DSC): supervised training compresses features into a low-rank class subspace and suppresses directions that carry domain-shift signal. We provide theory showing that, under DSC, distance- and logit-based OOD scores lose sensitivity to domain shift. We then introduce Teacher-Guided Training (TGT), which distills class-suppressed residual structure from a frozen multi-domain teacher (DINOv2) into the student during training. The teacher and auxiliary head are discarded after training, adding no inference overhead. Across eight single-domain benchmarks, TGT yields large far-OOD FPR@95 reductions for distance-based scorers: MDS improves by 11.61 pp, ViM by 10.78 pp, and kNN by 12.87 pp (ResNet-50 average), while maintaining or slightly improving in-domain OOD and classification accuracy.

Figures & tables

Appendix figures & tables49 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Geometry over Density: Few-Shot Cross-Domain OOD Detection

    May 5, 2026Shawn Li, You Qin, Jiate Li +4Diffusion-Based OOD DetectionDistribution Shift Detection

  2. Unified Multi-Layer Subspace Modeling for Cross-Domain OOD Detection

    Sep 6, 2026Gerhard Krumpl, Henning Avenhaus, Horst PosseggerOOD Detection

  3. Component-Based Out-of-Distribution Detection

    Apr 23, 2026Wenrui Liu, Hong Chang, Ruibing Hou +2Distribution Shift DetectionOOD Detection