Mitigating Instance Entanglement in Instance-Dependent Partial Label Learning
Organizations: School of Computer Science and Technology, Xi’an Jiaotong University · Shaanxi Province Key Laboratory of Big Data Knowledge Engineering, Xi’an Jiaotong University · School of Distance Education, Xi’an Jiaotong University
Abstract
Partial label learning is a prominent weakly supervised classification task, where each training instance is ambiguously labeled with a set of candidate labels. In real-world scenarios, candidate labels are often influenced by instance features, leading to the emergence of instance-dependent PLL (ID-PLL), a setting that more accurately reflects this relationship. A significant challenge in ID-PLL is instance entanglement, where instances from similar classes share overlapping features and candidate labels, resulting in increased class confusion. To address this issue, we propose a novel Class-specific Augmentation based Disentanglement (CAD) framework, which tackles instance entanglement by both intra- and inter-class regulations. For intra-class regulation, CAD amplifies class-specific features to generate class-wise augmentations and aligns same-class augmentations across instances. For inter-class regulation, CAD introduces a weighted penalty loss function that applies stronger penalties to more ambiguous labels, encouraging larger inter-class distances. By jointly applying intra- and inter-class regulations, CAD improves the clarity of class boundaries and reduces class confusion caused by entanglement. Extensive experimental results demonstrate the effectiveness of CAD in mitigating the entanglement problem and enhancing ID-PLL performance. The code is available at https://github.com/RyanZhaoIc/CAD.git.
Figures & tables
| 0.90 | 0.95 | 0.99 | ||||
|---|---|---|---|---|---|---|
| #Pairs | #Instances | #Pairs | #Instances | #Pairs | #Instances | |
| Fashion-MNIST | 528,996 | 38,717 | 125,535 | 16,992 | 3,658 | 1,802 |
| CIFAR-10 | 54,531 | 22,455 | 3,101 | 2,399 | 2 | 4 |
| CIFAR-100 | 1,991 | 1,482 | 74 | 108 | 17 | 34 |
| Fashion-MNIST | CIFAR-10 | CIFAR-100 | Flower | Oxford-IIIT Pet | |
| POP | 81.91 ± 0.37 | 89.55 ± 0.36 | 64.57 ± 0.37 | 33.02 ± 2.62 | 53.83 ± 1.55 |
| VALEN | 82.91 ± 0.12 | 81.29 ± 0.39 | 60.19 ± 0.82 | 32.89 ± 0.88 | 50.74 ± 0.91 |
| IDGP | 85.14 ± 0.39 | 84.12 ± 0.99 | 62.27 ± 1.89 | 41.26 ± 1.33 | 59.74 ± 0.71 |
| CP-DPLL | 79.67 ± 6.95 | 80.29 ± 0.18 | 56.93 ± 1.47 | 42.42 ± 0.12 | 49.13 ± 2.49 |
| CAVL | 78.06 ± 3.10 | 79.89 ± 0.07 | 59.76 ± 0.49 | 40.69 ± 1.93 | 50.64 ± 0.11 |
| PICO | 85.92 ± 0.38 | 82.91 ± 1.43 | 58.56 ± 0.13 | 33.76 ± 1.30 | 62.64 ± 0.45 |
| 0.100% | 0.010% | 0.001% | |||||
|---|---|---|---|---|---|---|---|
| Acc | Distance | Acc | Distance | Acc | Distance | ||
| F-MNIST | RC | 83.38 | 0.4507 | 74.02 | 0.4036 | 68.75 | 0.3623 |
| ABLE | 87.75 | 0.0955 | 78.89 | 0.0798 | 72.32 | 0.0865 | |
| DIRK | 89.57 | 0.4890 | 80.91 | 0.4110 | 72.86 | 0.3447 | |
| CAD | 89.87 | 0.5099 | 81.39 | 0.4372 | 74.79 | 0.4186 | |
| CIFAR-10 | RC | 84.51 | 0.6161 | 79.17 | 0.6088 | 70.42 | 0.5588 |
| Metric | RC | ABLE | DIRK | CAD |
|---|---|---|---|---|
| Instance | 0.040 | 0.007 | 0.035 | 0.057 |
| Avg. Pairwise | 0.414 | 0.128 | 0.333 | 0.337 |
| Centroid | 1.009 | 0.340 | 0.936 | 1.103 |
| Dataset | CAD | w/o CA | w/o RL | w/o Both |
|---|---|---|---|---|
| Fashion-MNIST | 92.14 0.91 | 91.19 0.22 | 91.48 0.61 | 85.30 0.87 |
| CIFAR-10 | 93.57 0.24 | 93.32 0.13 | 91.21 0.52 | 87.81 1.13 |
| Method | Accuracy (%) |
|---|---|
| CAD-CAM | 74.56 ± 3.16 |
| CAD w/o cues | 69.46 ± 2.35 |
| CAD with fine-grained prompting | 76.23 ± 2.17 |
Appendix figures & tables16 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Train | Test | Dims | Classes | Labels |
|---|---|---|---|---|---|
| Fashion-MNIST | 60,000 | 10,000 | 10 | 7.40 | |
| CIFAR-10 | 50,000 | 10,000 | 10 | 5.89 | |
| CIFAR-100 | 50,000 | 10,000 | 100 | 9.40 | |
| Flower | 1,020 | 6,149 | 102 | 5.49 | |
| Oxford-IIIT Pet | 3,680 | 3,669 | 37 | 3.73 |
| Ratio | 0.100% | 0.010% | 0.001% | ||||||
|---|---|---|---|---|---|---|---|---|---|
| #Pairs | #instances | #Pairs | #instances | #Pairs | #instances | ||||
| Fashion-MNIST | 822,911 | 42,851 | 0.8774 | 82,291 | 13,345 | 0.9594 | 8,229 | 3,114 | 0.9859 |
| CIFAR-10 | 374,916 | 47,655 | 0.8352 | 37,491 | 17,513 | 0.9088 | 3,749 | 2,833 | 0.9478 |
| CIFAR-100 | 23,041 | 10,007 | 0.8303 | 2,304 | 1,644 | 0.8,971 | 230 | 270 | 0.9364 |
| Oxford-IIIT | 133 | 131 | 0.8972 | 13 | 22 | 0.9211 | 1 | 2 | 0.9407 |
| Flower | 5 | 8 | 0.7740 | 1 | 2 | 0.8137 | 1 | 2 | 0.8137 |
| Method | CIFAR-10 | CIFAR-100 |
|---|---|---|
| DIRK | 10.19 | 14.37 |
| ABLE | 13.89 | 19.15 |
| CAD-CAM | 18.50 | 25.23 |
| CAD | 24.66 | 35.54 |
| Fashion-MNIST | CIFAR-10 | CIFAR-100 | |
| RC-C | 66.66 ± 0.99 | 76.80 ± 0.27 | 59.63 ± 0.20 |
| RC | 84.87 ± 1.48 | 87.53 ± 0.94 | 65.26 ± 0.40 |
| ABLE-C | 78.41 ± 0.35 | 59.66 ± 1.04 | 58.03 ± 0.28 |
| ABLE | 89.81 ± 0.08 | 83.92 ± 0.67 | 63.92 ± 0.39 |
| DIRK-C | 79.05 ± 0.49 | 85.06 ± 0.15 | 62.66 ± 0.18 |
| DIRK | 91.48 ± 0.21 | 91.48 ± 0.21 | 68.77 ± 0.49 |
| Method | CIFAR-10 | CIFAR-100 |
|---|---|---|
| POP | 89.55 ± 0.36 | 64.57 ± 0.37 |
| POP+CAD | 91.56 ± 0.80 | 66.56 ± 2.86 |
| ABLE | 83.92 ± 0.67 | 63.92 ± 0.39 |
| ABLE+CAD | 85.21 ± 4.08 | 68.63 ± 1.13 |
| DIRK | 90.87 ± 0.25 | 68.77 ± 0.49 |
| DIRK+CAD | 92.86 ± 0.17 | 72.35 ± 0.53 |
| Method | Accuracy (%) |
|---|---|
| ABLE | 91.82 |
| DIRK | 92.91 |
| CAD (Ours) | 93.24 |
| 0.00 | 0.25 | 0.50 | 0.75 | 1.00 | 1.25 | 1.50 | 1.75 | 2.00 | |
|---|---|---|---|---|---|---|---|---|---|
| Accuracy | 89.19 | 92.53 | 92.95 | 92.94 | 93.85 | 94.10 | 93.97 | 93.88 | 92.87 |
| Method | AGNews Accuracy (%) |
|---|---|
| DIRK | 77.34 |
| ABLE | 93.92 |
| CAD (Ours) | 94.30 |
| F-MNIST | CIFAR-10 | CIFAR-100 | |
|---|---|---|---|
| 0.90 | 16.01 | 27.45 | 79.43 |
| 0.95 | 15.28 | 26.56 | 51.06 |
| 0.99 | 11.51 | 25.00 | 38.46 |
| Method | Fashion-MNIST | CIFAR-10 | CIFAR-100 | Flower | Oxford-IIIT Pet |
|---|---|---|---|---|---|
| Original ( ) | -0.0276 0.2364 | -0.0415 0.2151 | -0.0416 0.2176 | -0.0010 0.2185 | -0.0002 0.2282 |
| Diffusion ( ) | 0.0120 0.2555 | 0.0314 0.2566 | 0.0181 0.2453 | 0.0243 0.2784 | 0.0169 0.2705 |
Weakly Supervised Learning
Weakly supervised learning trains models from incomplete, noisy, coarse, or indirect labels instead of dense ground truth.
See all 156 papers