Don't Replace, Complement: A Detector-Agnostic Subspace Signal for Near-OOD Detection
Organizations: Yonsei University, Republic of Korea
Abstract
Post-hoc out-of-distribution (OOD) detection is mature on far-OOD yet remains weak on near-OOD. These two settings differ in their use of class-characteristic feature directions: far-OOD inputs largely fail to activate those of their predicted class, whereas near-OOD inputs activate them much as in-distribution samples do. Because the axis separating far-OOD leaves near-OOD almost indistinguishable from ID, a score optimized for one setting is misaligned with the other; where a detector already saturates far-OOD, added near-OOD sensitivity is bought partly against it. This divergence motivates a targeted near-OOD signal designed to complement existing scores. We propose PLUS (Per-class Low-dimensional sUbspace Signal). For each class, PLUS selects the most class-active neurons from a sparse autoencoder, orthonormalizes the corresponding decoder directions to form a low-dimensional subspace, and scores an input by its per-class whitened squared Mahalanobis distance within the subspace of its predicted class. Designed as a dedicated complement rather than a standalone detector, the signal is fused additively with any calibrated base score at a single, fixed weight. This weight is a single global constant: no value is adjusted per backbone, per OOD dataset, or per deployment, and all calibration statistics are estimated from ID validation data alone. When applied to 18 existing detectors spanning diverse method families, consistently improves near-OOD AUROC in all 126 detector--backbone combinations. Far-OOD performance is broadly maintained or improved, with only marginal declines where the base score is near-optimal, making a robust, detector-agnostic complement across backbones.
Figures & tables
| Method | ViT-B/16 | ResNet-50 | Swin-T | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Near-OOD | Far-OOD | Overall | Near-OOD | Far-OOD | Overall | Near-OOD | Far-OOD | Overall | ||||||||||
| AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | |
| MSP | 73.52 | 81.85 | 86.04 | 51.69 | 81.03 | 63.75 | 76.02 | 65.68 | 85.23 | 51.45 | 81.55 | 57.14 | 76.75 | 71.06 | 86.30 | 49.16 | 82.48 | 57.92 |
| MSP + PLUS | 78.13 | 68.82 | 88.44 | 43.86 | 84.32 | 53.84 | 79.30 | 63.38 | 89.64 | 40.88 | 85.50 | 49.88 | 80.02 | 64.33 | 88.55 | 42.96 | 85.14 | 51.51 |
| MaxLogit | 68.30 | 92.25 | 83.54 | 79.23 | 77.45 | 84.44 | 76.46 | 67.85 | 89.58 | 38.20 | 84.33 | 50.06 | 75.66 | 80.76 | 84.80 | 67.81 | 81.14 | 72.99 |
| MaxLogit + PLUS | 75.65 | 84.39 | 87.44 | 56.73 | 82.73 | 67.80 | 80.86 | 63.19 | 92.98 | 29.22 | 88.13 | 42.81 | 79.79 | 72.02 | 87.79 | 51.50 | 84.59 | 59.70 |
| Backbone | Near-OOD | Far-OOD | |||
|---|---|---|---|---|---|
| SSB-hard | NINCO | iNaturalist | Textures | OpenImage-O | |
| ResNet-18 | 18 /0 | 18 /0 | 17/1 | 13/5 | 14/4 |
| Max | |||||
| Min | |||||
| ResNet-50 | 18 /0 | 18 /0 | 18 /0 | 13/5 | 18 /0 |
| Max | |||||
| Backbone | Near-OOD | Far-OOD | ||
|---|---|---|---|---|
| MDS++ + PLUS | Best baselines | MDS++ + PLUS | Best baselines | |
| ViT-B/16 | 81.09 | RMDS++ 80.07 , RMDS 79.99 | 92.26 | MDS++ 93.29 , ViM 92.93 |
| ResNet-50 | 78.23 | ASH 78.17 , NNGuide 77.53 | 95.45 | ASH 95.74 , MDS++ 95.13 |
| Swin-T | 80.86 | RMDS++ 79.70 , GEN 78.97 | 93.00 | MDS++ 93.67 , ViM 93.26 |
| Subspace | Metric | ViT-B/16 | ResNet-50 | Swin-T |
|---|---|---|---|---|
| SAE top-16 (ours) | per-class | 81.23 | 78.22 | 80.90 |
| tied | 80.61 | 74.79 | 80.35 | |
| isotropic | 80.33 | 75.46 | 80.04 | |
| Random orthonormal | per-class | 79.57 | 74.47 | 78.49 |
| tied | 79.01 | 74.20 | 77.88 | |
| isotropic | 79.00 | 74.20 | 77.88 |
| Mean near gain | PLUS | on top of | |||
|---|---|---|---|---|---|
| Backbone | MDS++ partner | pairs improved | near / far | ||
| ViT-B/16 | 15/17 | 102/102 | / | ||
| ResNet-50 | 17/17 | 102/102 | / | ||
| Swin-T | 14/17 | 102/102 | / | ||
| ResNet-18 | 16/17 | 102/102 | / | ||
| Wide-ResNet50-2 | 11/17 | 102/102 | / | ||
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| Backbone | Family | torchvision checkpoint | OpenOOD | |
|---|---|---|---|---|
| ResNet-18 | CNN, BasicBlock | ResNet18_Weights.IMAGENET1K_V1 | 512 | |
| ResNet-50 | CNN, Bottleneck | ResNet50_Weights.IMAGENET1K_V1 | 2048 | ✓ |
| Wide-ResNet50-2 | CNN, Bottleneck ( width) | Wide_ResNet50_2_Weights.IMAGENET1K_V1 | 2048 | |
| ConvNeXt-B | ConvNeXt | ConvNeXt_Base_Weights.IMAGENET1K_V1 | 1024 | |
| Swin-T | Swin Transformer | Swin_T_Weights.IMAGENET1K_V1 | 768 | ✓ |
| ViT-B/16 | ViT | ViT_B_16_Weights.IMAGENET1K_V1 | 768 | ✓ |
| Backbone | Near-opt ( ) | near standalone | near fused | Far-opt ( ) | |
|---|---|---|---|---|---|
| ResNet-18 | 512 | 24576 ( ) | 2048 ( ) | ||
| ResNet-50 | 2048 | 6144 ( ) | 4096 ( ) | ||
| Wide-ResNet50-2 | 2048 | 8192 ( ) | 4096 ( ) | ||
| ConvNeXt-B | 1024 | 4096 ( ) | 4096 ( ) | ||
| MaxViT-T | 512 | 1536 ( ) | 3072 ( ) | ||
| Swin-T | 768 | 9216 ( ) | 15360 ( ) |
| Method | SSB-hard | NINCO | Near-OOD Average | iNaturalist | Textures | OpenImage-O | Far-OOD Average | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | |
| MSP | 68.94 | 86.42 | 78.11 | 77.27 | 73.53 | 81.84 | 88.19 | 42.41 | 85.06 | 56.46 | 84.86 | 56.16 | 86.04 | 51.68 |
| MSP PLUS | 73.66 | 79.37 | 82.60 | 58.22 | 78.13 | 68.80 | 91.70 | 35.01 | 85.74 | 52.74 | 87.88 | 43.83 | 88.44 | 43.86 |
| MaxLogit | 64.20 | 91.52 | 72.40 | 92.94 | 68.30 | 92.23 | 85.29 | 72.94 | 83.74 | 78.94 | 81.60 | 85.82 | 83.54 | 79.23 |
| MaxLogit PLUS | 71.73 | 85.92 | 79.57 | 82.84 | 75.65 | 84.38 | 90.57 | 43.74 | 85.40 | 64.51 | 86.35 | 61.96 | 87.44 | 56.74 |
| Energy | 58.80 | 92.24 | 66.02 | 94.13 | 62.41 | 93.19 | 79.30 | 83.56 | 81.17 | 83.66 | 76.48 | 88.82 | 78.98 | 85.35 |
| Method | SSB-hard | NINCO | Near-OOD Average | iNaturalist | Textures | OpenImage-O | Far-OOD Average | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | |
| MSP | 72.09 | 74.48 | 79.95 | 56.76 | 76.02 | 65.62 | 88.41 | 43.34 | 82.43 | 60.88 | 84.86 | 50.13 | 85.23 | 51.45 |
| MSP PLUS | 75.98 | 71.61 | 82.61 | 55.04 | 79.30 | 63.33 | 92.69 | 33.58 | 87.62 | 46.06 | 88.62 | 43.01 | 89.64 | 40.88 |
| MaxLogit | 72.51 | 76.19 | 80.41 | 59.41 | 76.46 | 67.80 | 91.16 | 30.62 | 88.39 | 46.11 | 89.17 | 37.86 | 89.57 | 38.20 |
| MaxLogit PLUS | 77.97 | 71.35 | 83.75 | 55.00 | 80.86 | 63.17 | 95.24 | 21.10 | 91.74 | 34.08 | 91.95 | 32.43 | 92.98 | 29.20 |
| Energy | 72.08 | 76.54 | 79.70 | 60.57 | 75.89 | 68.56 | 90.63 | 31.34 | 88.70 | 45.76 | 89.06 | 38.08 | 89.46 | 38.39 |
| Method | SSB-hard | NINCO | Near-OOD Average | iNaturalist | Textures | OpenImage-O | Far-OOD Average | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | |
| MSP | 71.78 | 80.90 | 81.72 | 61.20 | 76.75 | 71.05 | 89.86 | 37.31 | 83.27 | 60.88 | 85.77 | 49.30 | 86.30 | 49.16 |
| MSP PLUS | 75.49 | 75.00 | 84.55 | 53.65 | 80.02 | 64.33 | 92.96 | 31.73 | 84.31 | 53.85 | 88.36 | 43.31 | 88.54 | 42.96 |
| MaxLogit | 70.44 | 86.52 | 80.89 | 74.94 | 75.66 | 80.73 | 88.99 | 49.20 | 81.68 | 79.82 | 83.72 | 74.43 | 84.80 | 67.82 |
| MaxLogit PLUS | 75.21 | 81.67 | 84.37 | 62.32 | 79.79 | 72.00 | 92.82 | 31.40 | 83.31 | 68.55 | 87.24 | 54.52 | 87.79 | 51.49 |
| Energy | 68.21 | 87.45 | 78.25 | 79.03 | 73.23 | 83.24 | 85.13 | 61.52 | 78.96 | 84.45 | 79.86 | 80.79 | 81.32 | 75.59 |
| Method | SSB-hard | NINCO | Near-OOD Average | iNaturalist | Textures | OpenImage-O | Far-OOD Average | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | |
| MSP | 67.37 | 78.86 | 77.49 | 60.89 | 72.43 | 69.88 | 87.07 | 45.88 | 80.45 | 63.02 | 81.47 | 56.50 | 83.00 | 55.13 |
| MSP PLUS | 70.67 | 79.18 | 79.12 | 61.87 | 74.90 | 70.53 | 90.38 | 41.16 | 84.93 | 53.25 | 84.20 | 53.87 | 86.50 | 49.43 |
| MaxLogit | 65.46 | 83.58 | 76.50 | 66.46 | 70.98 | 75.02 | 90.29 | 32.00 | 87.69 | 46.96 | 86.32 | 43.40 | 88.10 | 40.79 |
| MaxLogit PLUS | 70.65 | 81.00 | 78.59 | 64.38 | 74.62 | 72.69 | 93.03 | 28.80 | 90.15 | 39.36 | 88.10 | 41.69 | 90.43 | 36.62 |
| Energy | 64.82 | 83.94 | 75.60 | 67.34 | 70.21 | 75.64 | 89.84 | 32.35 | 88.38 | 46.90 | 86.37 | 43.60 | 88.20 | 40.95 |
| Method | SSB-hard | NINCO | Near-OOD Average | iNaturalist | Textures | OpenImage-O | Far-OOD Average | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | |
| MSP | 74.08 | 73.95 | 82.04 | 56.71 | 78.06 | 65.33 | 89.95 | 39.03 | 82.87 | 58.67 | 87.02 | 45.55 | 86.61 | 47.75 |
| MSP PLUS | 75.57 | 76.54 | 83.41 | 57.44 | 79.49 | 66.99 | 92.39 | 33.88 | 86.28 | 48.95 | 88.88 | 41.79 | 89.18 | 41.54 |
| MaxLogit | 74.97 | 76.27 | 82.41 | 59.49 | 78.69 | 67.88 | 91.27 | 31.10 | 86.04 | 54.77 | 89.75 | 37.74 | 89.02 | 41.20 |
| MaxLogit PLUS | 77.67 | 74.00 | 84.50 | 53.65 | 81.09 | 63.83 | 94.30 | 24.23 | 89.27 | 41.83 | 91.26 | 33.81 | 91.61 | 33.29 |
| Energy | 74.69 | 76.46 | 81.76 | 59.76 | 78.22 | 68.11 | 90.39 | 31.46 | 85.89 | 54.76 | 89.42 | 38.56 | 88.57 | 41.59 |
| Method | SSB-hard | NINCO | Near-OOD Average | iNaturalist | Textures | OpenImage-O | Far-OOD Average | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | |
| MSP | 75.47 | 76.75 | 81.08 | 71.43 | 78.28 | 74.09 | 89.54 | 43.46 | 74.36 | 96.46 | 83.10 | 74.66 | 82.33 | 71.53 |
| MSP PLUS | 79.39 | 68.19 | 85.81 | 52.05 | 82.60 | 60.12 | 93.89 | 28.11 | 81.08 | 82.38 | 88.66 | 45.27 | 87.88 | 51.92 |
| MaxLogit | 72.93 | 85.60 | 76.43 | 86.40 | 74.68 | 86.00 | 82.63 | 77.82 | 64.66 | 98.11 | 73.40 | 93.53 | 73.56 | 89.82 |
| MaxLogit PLUS | 78.49 | 75.97 | 83.96 | 66.65 | 81.22 | 71.31 | 91.67 | 40.36 | 74.91 | 95.74 | 83.87 | 75.39 | 83.48 | 70.50 |
| Energy | 65.59 | 90.04 | 64.05 | 92.18 | 64.82 | 91.11 | 55.75 | 92.24 | 49.48 | 98.27 | 52.68 | 96.42 | 52.64 | 95.64 |
| Method | SSB-hard | NINCO | Near-OOD Average | iNaturalist | Textures | OpenImage-O | Far-OOD Average | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | AUROC | FPR95 | |
| MSP | 70.99 | 84.39 | 80.86 | 64.09 | 75.92 | 74.24 | 88.76 | 40.06 | 85.51 | 54.02 | 85.85 | 49.84 | 86.71 | 47.97 |
| MSP PLUS | 74.81 | 79.02 | 84.19 | 52.96 | 79.50 | 65.99 | 92.37 | 31.75 | 87.12 | 49.41 | 88.69 | 40.66 | 89.39 | 40.61 |
| MaxLogit | 68.16 | 87.17 | 75.89 | 85.96 | 72.03 | 86.56 | 90.06 | 47.00 | 85.87 | 69.98 | 82.06 | 81.01 | 86.00 | 66.00 |
| MaxLogit PLUS | 73.21 | 83.52 | 81.57 | 74.80 | 77.39 | 79.16 | 93.51 | 31.39 | 87.62 | 61.35 | 86.59 | 64.50 | 89.24 | 52.41 |
| Energy | 63.88 | 88.85 | 68.31 | 91.32 | 66.09 | 90.08 | 88.16 | 55.86 | 83.65 | 76.52 | 75.68 | 88.92 | 82.50 | 73.77 |
| Subspace ( ) | ViT-B/16 | ResNet-50 | Swin-T | ResNet-18 | Wide-ResNet50-2 | ConvNeXt-B | MaxViT-T | Mean | Max gap |
|---|---|---|---|---|---|---|---|---|---|
| MDS++ alone (no ) | 79.87 | 74.71 | 78.92 | 70.94 | 77.81 | 81.49 | 80.96 | 77.81 | – |
| SAE top-active (ours) | 81.23 | 78.22 | 80.90 | 73.30 | 79.03 | 83.53 | 81.90 | 79.73 | 0.93 |
| Per-class PCA | 81.64 | 76.69 | 81.42 | 71.96 | 79.96 | 83.73 | 82.48 | 79.70 | 1.91 |
| Global PCA + per-class | 80.05 | 77.01 | 79.41 | 73.87 | 79.77 | 82.86 | 81.40 | 79.20 | 2.01 |
| Top-16 raw channels | 79.82 | 76.75 | 78.76 | 72.28 | 78.69 | 81.90 | 81.23 | 78.49 | 2.66 |
| Random SAE neurons † | 79.34 | 74.83 | 78.00 | 71.37 | 77.59 | 81.42 | 81.05 | 77.66 | 3.42 |
| Backbone | Random pair | Nearest class | Dogs (118) | Snakes (17) | Birds (18) |
|---|---|---|---|---|---|
| ResNet-50 | 0.032 | 0.296 ( ) | 0.087 ( ) | 0.154 ( ) | 0.091 ( ) |
| Swin-T | 0.011 | 0.277 ( ) | 0.029 ( ) | 0.160 ( ) | 0.126 ( ) |
| ViT-B/16 | 0.003 | 0.264 ( ) | 0.031 ( ) | 0.211 ( ) | 0.094 ( ) |
OOD Detection
Out-of-distribution (OOD) detection identifies inputs unlike a model’s training data so systems can flag uncertainty, reject inputs, or adapt safely.
See all 239 papers