Source Models Leak What They Shouldn't : Unlearning Zero-Shot Transfer in Domain Adaptation Through Adversarial Optimization
Organizations: Indian Institute of Technology, Hyderabad · University of Michigan · Carnegie Mellon University · Microsoft Research
Abstract
The increasing adaptation of vision models across domains, such as satellite imagery and medical scans, has raised an emerging privacy risk: models may inadvertently retain and leak sensitive source-domain specific information in the target domain. This creates a compelling use case for machine unlearning to protect the privacy of sensitive source-domain data. Among adaptation techniques, source-free domain adaptation (SFDA) calls for an urgent need for machine unlearning (MU), where the source data itself is protected, yet the source model exposed during adaptation encodes its influence. Our experiments reveal that existing SFDA methods exhibit strong zero-shot performance on source-exclusive classes in the target domain, indicating they inadvertently leak knowledge of these classes into the target domain, even when they are not represented in the target data. We identify and address this risk by proposing an MU setting called SCADA-UL: Unlearning Source-exclusive ClAsses in Domain Adaptation. Existing MU methods do not address this setting as they are not designed to handle data distribution shifts. We propose a new unlearning method, where an adversarially generated forget class sample is unlearned by the model during the domain adaptation process using a novel rescaled labeling strategy and adversarial optimization. We also extend our study to two variants: a continual version of this problem setting and to one where the specific source classes to be forgotten may be unknown. Alongside theoretical interpretations, our comprehensive empirical results show that our method consistently outperforms baselines in the proposed setting while achieving retraining-level unlearning performance on benchmark datasets. Our code is available at https://github.com/D-Arnav/SCADA
Figures & tables
| Existing Efforts | Unlearning | Adaptation | Forget Data-free |
|---|---|---|---|
| SFDA/PDA [ 34 , 28 , 5 ] | ✗ | ✓ | N/A |
| MU [ 21 , 15 ] | ✓ | ✗ | ✗ |
| Zero Glance MU [ 51 , 10 ] | ✓ | ✗ | ✓ |
| SCADA-UL | ✓ | ✓ | ✓ |
| OfficeHome | Office31 | DomainNet-126 | |||||||
| Method | Score | Score | Score | ||||||
| Original (SF(DA) 2 [ 28 ] ) | 75.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 58.1_{{\color[rgb]{0.5,0.5,0.5}\pm 2.2}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 76.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 90.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 0.40_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 67.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 38.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.9}} | 0.50_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Retrain | 76.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.76_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 77.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.77_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 66.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.66_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Finetune | \textbf{76.1}_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 49.2_{{\color[rgb]{0.5,0.5,0.5}\pm 2.2}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | \underline{76.7}_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 82.8_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | 0.42_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | \underline{66.5}_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 20.4_{{\color[rgb]{0.5,0.5,0.5}\pm 4.1}} | \underline{0.56}_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| UNSIR [ 51 ] | 35.0_{{\color[rgb]{0.5,0.5,0.5}\pm 5.6}} | \textbf{0.0}_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.35_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 59.7_{{\color[rgb]{0.5,0.5,0.5}\pm 5.0}} | \underline{16.3}_{{\color[rgb]{0.5,0.5,0.5}\pm 3.3}} | 0.53_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 14.6_{{\color[rgb]{0.5,0.5,0.5}\pm 3.6}} | \underline{0.4}_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 0.14_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| ZSMU [ 10 ] | 71.1_{{\color[rgb]{0.5,0.5,0.5}\pm 6.1}} | 39.8_{{\color[rgb]{0.5,0.5,0.5}\pm 10.}} | 0.50_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 77.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 84.2_{{\color[rgb]{0.5,0.5,0.5}\pm 3.3}} | 0.42_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 65.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 34.5_{{\color[rgb]{0.5,0.5,0.5}\pm 6.6}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Stage | Acc | Acc |
|---|---|---|
| Before Adaptation | 75.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 52.0_{{\color[rgb]{0.5,0.5,0.5}\pm 5.3}} |
| During Adaptation | 75.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| After Adaptation | 58.2_{{\color[rgb]{0.5,0.5,0.5}\pm 7.1}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Strategy | Acc | Acc |
|---|---|---|
| Rescaled | {75.1_{\color[rgb]{0.5,0.5,0.5}{\pm 1.3}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} |
| Uniform | {70.5_{\color[rgb]{0.5,0.5,0.5}{\pm 3.6}}} | {3.5_{\color[rgb]{0.5,0.5,0.5}{\pm 4.1}}} |
| Random | {1.5_{\color[rgb]{0.5,0.5,0.5}{\pm 0.4}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} |
| Compared Features | Before Adaptation | After Adaptation |
|---|---|---|
| Adversarial - Source Forget | 0.360 | 0.371 |
| Adversarial - Source Retain | 0.326 | 0.315 |
| Adversarial - Target Forget | 0.359 | 0.366 |
| Adversarial - Target Retain | 0.335 | 0.307 |
| Initialize | ||
|---|---|---|
| ✓ | {75.1_{\color[rgb]{0.5,0.5,0.5}{\pm 1.3}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} |
| ✗ | {75.0_{\color[rgb]{0.5,0.5,0.5}{\pm 1.2}}} | {15.2_{\color[rgb]{0.5,0.5,0.5}{\pm 4.1}}} |
| {75.0_{\color[rgb]{0.5,0.5,0.5}{\pm 1.2}}} | {15.2_{\color[rgb]{0.5,0.5,0.5}{\pm 4.1}}} | |
| {75.2_{\color[rgb]{0.5,0.5,0.5}{\pm 1.1}}} | {2.6_{\color[rgb]{0.5,0.5,0.5}{\pm 2.0}}} | |
| {75.1_{\color[rgb]{0.5,0.5,0.5}{\pm 1.3}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} | |
| {75.2_{\color[rgb]{0.5,0.5,0.5}{\pm 1.1}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} |
| {70.9_{\color[rgb]{0.5,0.5,0.5}{\pm 3.6}}} | {0.8_{\color[rgb]{0.5,0.5,0.5}{\pm 1.4}}} | |
| {72.9_{\color[rgb]{0.5,0.5,0.5}{\pm 3.7}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} | |
| {75.1_{\color[rgb]{0.5,0.5,0.5}{\pm 1.3}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} | |
| {75.2_{\color[rgb]{0.5,0.5,0.5}{\pm 1.2}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} | |
| {75.3_{\color[rgb]{0.5,0.5,0.5}{\pm 1.1}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} |
| Epochs | ||
|---|---|---|
| {75.6_{\color[rgb]{0.5,0.5,0.5}{\pm 1.4}}} | {18.2_{\color[rgb]{0.5,0.5,0.5}{\pm 8.1}}} | |
| {75.1_{\color[rgb]{0.5,0.5,0.5}{\pm 1.3}}} | {0.0_{\color[rgb]{0.5,0.5,0.5}{\pm 0.0}}} | |
| {74.9_{\color[rgb]{0.5,0.5,0.5}{\pm 1.2}}} | {0.4_{\color[rgb]{0.5,0.5,0.5}{\pm 0.3}}} |
| SFDA Loss | Method | Metric | s p | c s | p c | p r | r s | r c | r p | Average | % Improved |
|---|---|---|---|---|---|---|---|---|---|---|---|
| SHOT [ 34 ] | Original | 70.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 57.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 61.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 83.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 60.6_{{\color[rgb]{0.5,0.5,0.5}\pm 3.4}} | 69.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 75.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 68.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | ||
| 88.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 47.0_{{\color[rgb]{0.5,0.5,0.5}\pm 20.6}} | 57.8_{{\color[rgb]{0.5,0.5,0.5}\pm 2.5}} | 86.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 27.7_{{\color[rgb]{0.5,0.5,0.5}\pm 4.8}} | 41.8_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 43.1_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | 56.1_{{\color[rgb]{0.5,0.5,0.5}\pm 4.5}} | - | |||
| Score | 0.37_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.39_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.39_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.45_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.53_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.44_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |||
| Our Method | 56.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 36.6_{{\color[rgb]{0.5,0.5,0.5}\pm 4.0}} | 42.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 77.9_{{\color[rgb]{0.5,0.5,0.5}\pm 5.5}} | 27.1_{{\color[rgb]{0.5,0.5,0.5}\pm 5.3}} | 49.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 66.4_{{\color[rgb]{0.5,0.5,0.5}\pm 5.2}} | 50.9_{{\color[rgb]{0.5,0.5,0.5}\pm 3.2}} | |||
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | - | |||
| Score | \underline{0.56}_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.37_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | \underline{0.78}_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 0.27_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 0.50_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.66_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | A C | A P | A R | C A | C P | C R | P A | P C | P R | R A | R C | R P | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | 61.0_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | 82.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 82.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 76.9_{{\color[rgb]{0.5,0.5,0.5}\pm 2.1}} | 82.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 82.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 75.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.7}} | 58.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 84.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 78.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 58.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} | 87.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 75.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | |
| 28.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | 71.1_{{\color[rgb]{0.5,0.5,0.5}\pm 6.2}} | 86.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 57.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 69.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 76.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.8}} | 47.8_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | 22.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 72.8_{{\color[rgb]{0.5,0.5,0.5}\pm 6.9}} | 53.1_{{\color[rgb]{0.5,0.5,0.5}\pm 4.2}} | 35.5_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | 77.1_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | 58.1_{{\color[rgb]{0.5,0.5,0.5}\pm 2.8}} | ||
| Score | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.44_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | 60.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 83.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 82.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | 78.5_{{\color[rgb]{0.5,0.5,0.5}\pm 2.5}} | 82.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 83.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} | 76.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 59.7_{{\color[rgb]{0.5,0.5,0.5}\pm 3.1}} | 84.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | 77.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 59.9_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | 87.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 76.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | |
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| Score | 0.61_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.82_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.79_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.76_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.60_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.84_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.78_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.60_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.87_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.76_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | s p | c s | p c | p r | r s | r c | r p | Average |
|---|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | 71.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 66.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 61.7_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 78.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 55.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 65.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 75.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 67.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | |
| 67.6_{{\color[rgb]{0.5,0.5,0.5}\pm 7.0}} | 55.9_{{\color[rgb]{0.5,0.5,0.5}\pm 5.9}} | 42.9_{{\color[rgb]{0.5,0.5,0.5}\pm 2.7}} | 60.6_{{\color[rgb]{0.5,0.5,0.5}\pm 2.7}} | 6.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 14.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 22.8_{{\color[rgb]{0.5,0.5,0.5}\pm 3.8}} | 38.7_{{\color[rgb]{0.5,0.5,0.5}\pm 3.5}} | ||
| Score | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.53_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.57_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.61_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.50_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | 71.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 65.3_{{\color[rgb]{0.5,0.5,0.5}\pm 2.8}} | 58.6_{{\color[rgb]{0.5,0.5,0.5}\pm 2.9}} | 78.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 54.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 62.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 74.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 66.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | |
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| Score | 0.71_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.65_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.59_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.78_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.54_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.63_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.74_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.66_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | A D | A W | D A | D W | W A | W D | Average |
|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | 77.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 86.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 67.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 79.9_{{\color[rgb]{0.5,0.5,0.5}\pm 2.2}} | 72.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 78.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} | 76.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | |
| 84.8_{{\color[rgb]{0.5,0.5,0.5}\pm 2.8}} | 99.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 93.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 88.5_{{\color[rgb]{0.5,0.5,0.5}\pm 2.8}} | 97.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | 76.6_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | 90.1_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | ||
| Score | 0.42_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.35_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.42_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.36_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.44_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.40_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | 76.0_{{\color[rgb]{0.5,0.5,0.5}\pm 5.0}} | 87.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | 68.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 83.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 72.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 78.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 77.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} | |
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| Score | 0.76_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 0.87_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.68_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.72_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.78_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.77_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | A C | A P | A R | C A | C P | C R | P A | P C | P R | R A | R C | R P | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | 60.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 82.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 85.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} | 74.4_{{\color[rgb]{0.5,0.5,0.5}\pm 2.4}} | 83.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 85.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 72.1_{{\color[rgb]{0.5,0.5,0.5}\pm 3.3}} | 59.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 86.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | 75.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 60.0_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | 88.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 76.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | |
| 51.2_{{\color[rgb]{0.5,0.5,0.5}\pm 9.8}} | 88.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 89.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 42.3_{{\color[rgb]{0.5,0.5,0.5}\pm 7.5}} | 72.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.7}} | 85.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 54.5_{{\color[rgb]{0.5,0.5,0.5}\pm 8.6}} | 50.0_{{\color[rgb]{0.5,0.5,0.5}\pm 6.4}} | 88.6_{{\color[rgb]{0.5,0.5,0.5}\pm 2.9}} | 39.9_{{\color[rgb]{0.5,0.5,0.5}\pm 2.8}} | 80.4_{{\color[rgb]{0.5,0.5,0.5}\pm 3.6}} | 93.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 69.7_{{\color[rgb]{0.5,0.5,0.5}\pm 4.2}} | ||
| Score | 0.40_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.44_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.45_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.52_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.46_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.40_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.46_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.54_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.33_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.45_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.45_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | 62.1_{{\color[rgb]{0.5,0.5,0.5}\pm 2.4}} | 83.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 86.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 74.7_{{\color[rgb]{0.5,0.5,0.5}\pm 3.2}} | 82.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 86.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 72.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 60.0_{{\color[rgb]{0.5,0.5,0.5}\pm 3.1}} | 86.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 75.0_{{\color[rgb]{0.5,0.5,0.5}\pm 2.9}} | 61.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 88.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 76.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} | |
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| Score | 0.62_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.86_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.75_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.86_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.72_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.60_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.87_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.75_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.61_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.88_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.77_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | s p | c s | p c | p r | r s | r c | r p | Average |
|---|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | 71.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 65.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 62.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 78.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 55.9_{{\color[rgb]{0.5,0.5,0.5}\pm 2.6}} | 65.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 75.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 67.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | |
| 77.6_{{\color[rgb]{0.5,0.5,0.5}\pm 5.7}} | 36.9_{{\color[rgb]{0.5,0.5,0.5}\pm 6.9}} | 35.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 74.1_{{\color[rgb]{0.5,0.5,0.5}\pm 12.1}} | 3.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 17.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 6.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 35.9_{{\color[rgb]{0.5,0.5,0.5}\pm 4.0}} | ||
| Score | 0.40_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.46_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.45_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.54_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.55_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.71_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | 71.7_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 66.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 61.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 78.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 56.0_{{\color[rgb]{0.5,0.5,0.5}\pm 3.2}} | 65.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 74.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 67.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | |
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| Score | 0.72_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.67_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.61_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.78_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.56_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.65_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.74_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.68_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | A D | A W | D A | D W | W A | W D | Average |
|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | 78.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | 81.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 61.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 76.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 67.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 80.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 74.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | |
| 91.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | 100._{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 100._{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 100._{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 100._{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 90.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 97.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | ||
| Score | 0.41_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.41_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.31_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.38_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.34_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.42_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.38_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | 79.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 82.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 63.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 78.4_{{\color[rgb]{0.5,0.5,0.5}\pm 2.1}} | 67.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 78.1_{{\color[rgb]{0.5,0.5,0.5}\pm 2.8}} | 74.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | |
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| Score | 0.79_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.82_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.64_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.78_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.67_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.78_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.75_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | A C | A P | A R | C A | C P | C R | P A | P C | P R | R A | R C | R P | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | 61.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 82.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 82.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 76.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.7}} | 82.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 82.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 75.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 58.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 84.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 78.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 58.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 87.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 75.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | |
| 28.7_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 71.1_{{\color[rgb]{0.5,0.5,0.5}\pm 5.0}} | 86.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 57.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 69.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 76.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | 47.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 22.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 72.8_{{\color[rgb]{0.5,0.5,0.5}\pm 5.7}} | 53.1_{{\color[rgb]{0.5,0.5,0.5}\pm 3.4}} | 35.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 77.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.7}} | 58.1_{{\color[rgb]{0.5,0.5,0.5}\pm 2.2}} | ||
| Score | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.44_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | 60.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 83.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 82.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 78.5_{{\color[rgb]{0.5,0.5,0.5}\pm 2.1}} | 82.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 83.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 76.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 59.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.5}} | 84.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 77.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 59.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 87.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 76.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | |
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| Score | 0.61_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.82_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.79_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.76_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.60_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.84_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.78_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.60_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.87_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.76_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | s p | c s | p c | p r | r s | r c | r p | Average |
|---|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | 71.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 66.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 61.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 78.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 55.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 65.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 75.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 67.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | |
| 67.6_{{\color[rgb]{0.5,0.5,0.5}\pm 5.7}} | 55.9_{{\color[rgb]{0.5,0.5,0.5}\pm 4.8}} | 42.9_{{\color[rgb]{0.5,0.5,0.5}\pm 2.2}} | 60.6_{{\color[rgb]{0.5,0.5,0.5}\pm 2.2}} | 6.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 14.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 22.8_{{\color[rgb]{0.5,0.5,0.5}\pm 3.1}} | 38.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.9}} | ||
| Score | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.53_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.57_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.61_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.50_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | 71.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 65.3_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | 58.6_{{\color[rgb]{0.5,0.5,0.5}\pm 2.4}} | 78.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 54.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 62.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 74.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 66.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | |
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| Score | 0.71_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.65_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.59_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.78_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.54_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.63_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.74_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.66_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | A D | A W | D A | D W | W A | W D | Average |
|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | 67.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 79.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} | 77.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 86.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 78.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 72.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 76.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | |
| 93.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 88.5_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | 84.8_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | 99.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 76.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 97.7_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 90.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | ||
| Score | 0.35_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.42_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.42_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.44_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.36_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.40_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | 68.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 83.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 76.0_{{\color[rgb]{0.5,0.5,0.5}\pm 4.1}} | 87.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 78.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 72.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 77.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | |
| 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| Score | 0.68_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.83_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.76_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.87_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.78_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.72_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.77_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Task | Acc. | A C | A P | A R | C A | C P | C R | P A | P C | P R | R A | R C | R P | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | T1 | 63.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 80.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 86.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 78.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 81.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 87.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 76.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 62.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 89.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 81.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 63.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 87.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 78.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | |
| 43.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 61.4_{{\color[rgb]{0.5,0.5,0.5}\pm 2.4}} | 75.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 59.8_{{\color[rgb]{0.5,0.5,0.5}\pm 3.7}} | 55.7_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 66.9_{{\color[rgb]{0.5,0.5,0.5}\pm 3.2}} | 46.0_{{\color[rgb]{0.5,0.5,0.5}\pm 2.6}} | 26.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 62.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 58.4_{{\color[rgb]{0.5,0.5,0.5}\pm 4.8}} | 40.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 63.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 55.0_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | |||
| Score | 0.44_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.50_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.53_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.52_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.52_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.55_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.45_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.53_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.50_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| T2 | 63.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 80.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 86.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 78.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 81.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 87.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 76.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 62.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.3}} | 89.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 81.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 63.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 87.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 78.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | ||
| 44.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 62.2_{{\color[rgb]{0.5,0.5,0.5}\pm 2.4}} | 76.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 60.6_{{\color[rgb]{0.5,0.5,0.5}\pm 3.7}} | 56.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 67.5_{{\color[rgb]{0.5,0.5,0.5}\pm 3.2}} | 46.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.6}} | 26.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 62.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 59.2_{{\color[rgb]{0.5,0.5,0.5}\pm 4.9}} | 40.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 64.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 55.6_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} | |||
| Score | 0.44_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.50_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.52_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.52_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.52_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.49_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.55_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.45_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.53_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.50_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Task | Acc. | s p | c s | p c | p r | r s | r c | r p | Average |
|---|---|---|---|---|---|---|---|---|---|---|
| Original (SF(DA) 2 [ 28 ] ) | T1 | 71.8_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 64.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 62.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 78.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 55.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 65.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 75.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | 67.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | |
| 37.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 37.2_{{\color[rgb]{0.5,0.5,0.5}\pm 2.9}} | 37.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 63.2_{{\color[rgb]{0.5,0.5,0.5}\pm 3.6}} | 17.3_{{\color[rgb]{0.5,0.5,0.5}\pm 2.1}} | 10.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 25.5_{{\color[rgb]{0.5,0.5,0.5}\pm 3.5}} | 32.5_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | |||
| Score | 0.52_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.45_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.60_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.60_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | ||
| T2 | 71.8_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 64.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 62.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 78.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.1}} | 55.6_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 65.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 75.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | 67.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | ||
| 37.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 37.4_{{\color[rgb]{0.5,0.5,0.5}\pm 3.0}} | 37.7_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 63.3_{{\color[rgb]{0.5,0.5,0.5}\pm 3.6}} | 17.4_{{\color[rgb]{0.5,0.5,0.5}\pm 2.1}} | 10.1_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 25.7_{{\color[rgb]{0.5,0.5,0.5}\pm 3.5}} | 32.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.3}} | |||
| Score | 0.52_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.45_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.48_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.47_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.60_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.60_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.51_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} |
| Method | Metric | A C | A P | A R | C A | C P | C R | P A | P C | P R | R A | R C | R P | Average |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Original (SHOT [ 34 ] ) | OS Acc. | 54.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 69.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 75.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 70.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 72.5_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 76.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 67.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.6}} | 49.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} | 75.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 72.8_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 55.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 76.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 68.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} |
| OS* Acc. | 60.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 77.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} | 81.8_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 75.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 79.9_{{\color[rgb]{0.5,0.5,0.5}\pm 0.6}} | 83.0_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 72.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.8}} | 54.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.9}} | 81.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 78.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.7}} | 61.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 84.3_{{\color[rgb]{0.5,0.5,0.5}\pm 1.4}} | 74.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | |
| Forget Acc. | 43.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 85.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 86.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.7}} | 68.2_{{\color[rgb]{0.5,0.5,0.5}\pm 2.7}} | 78.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 79.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 65.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 36.5_{{\color[rgb]{0.5,0.5,0.5}\pm 4.0}} | 83.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 70.7_{{\color[rgb]{0.5,0.5,0.5}\pm 1.1}} | 45.0_{{\color[rgb]{0.5,0.5,0.5}\pm 3.3}} | 89.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | 69.4_{{\color[rgb]{0.5,0.5,0.5}\pm 1.6}} | |
| Score | 0.38_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.38_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.41_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.42_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.41_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.41_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.36_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.41_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.43_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.38_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.40_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | 0.40_{{\color[rgb]{0.5,0.5,0.5}\pm 0.0}} | |
| Retrain | OS Acc. | 51.7_{{\color[rgb]{0.5,0.5,0.5}\pm 5.5}} | 67.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 75.2_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 70.3_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 71.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 76.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.8}} | 70.7_{{\color[rgb]{0.5,0.5,0.5}\pm 2.8}} | 51.5_{{\color[rgb]{0.5,0.5,0.5}\pm 3.7}} | 77.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.4}} | 74.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 58.0_{{\color[rgb]{0.5,0.5,0.5}\pm 1.5}} | 77.4_{{\color[rgb]{0.5,0.5,0.5}\pm 2.4}} | 68.5_{{\color[rgb]{0.5,0.5,0.5}\pm 1.8}} |
| OS* Acc. | 57.2_{{\color[rgb]{0.5,0.5,0.5}\pm 6.1}} | 74.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 81.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.2}} | 75.6_{{\color[rgb]{0.5,0.5,0.5}\pm 1.0}} | 78.9_{{\color[rgb]{0.5,0.5,0.5}\pm 1.3}} | 82.4_{{\color[rgb]{0.5,0.5,0.5}\pm 0.9}} | 75.9_{{\color[rgb]{0.5,0.5,0.5}\pm 3.1}} | 56.9_{{\color[rgb]{0.5,0.5,0.5}\pm 4.1}} | 83.2_{{\color[rgb]{0.5,0.5,0.5}\pm 0.5}} | 79.7_{{\color[rgb]{0.5,0.5,0.5}\pm 0.2}} | 64.1_{{\color[rgb]{0.5,0.5,0.5}\pm 1.7}} | 85.4_{{\color[rgb]{0.5,0.5,0.5}\pm 2.7}} | 74.6_{{\color[rgb]{0.5,0.5,0.5}\pm 2.0}} |
Machine Unlearning
Machine unlearning removes the influence of selected data or concepts from trained models while preserving useful behavior and avoiding full retraining.
See all 351 papers