Incomplete Multi-View Multi-Label Classification via Shared Codebook and Fused-Teacher Self-Distillation
Organizations: College of Information Engineering, Shanghai Maritime University · School of Automation and Intelligent Sensing, Shanghai Jiao Tong University
Abstract
Although multi-view multi-label learning has been extensively studied, research on the dual-missing scenario, where both views and labels are incomplete, remains largely unexplored. Existing methods mainly rely on contrastive learning or information bottleneck theory to learn consistent representations under missing-view conditions, but loss-based alignment without explicit structural constraints limits the ability to capture stable and discriminative shared semantics. To address this issue, we introduce a more structured mechanism for consistent representation learning: we learn discrete consistent representations through a multi-view shared codebook and cross-view reconstruction, which naturally align different views within the limited shared codebook embeddings and reduce feature redundancy. At the decision level, we design a weight estimation method that evaluates the ability of each view to preserve label correlation structures, assigning weights accordingly to enhance the quality of the fused prediction. In addition, we introduce a fused-teacher self-distillation framework, where the fused prediction guides the training of view-specific classifiers and feeds the global knowledge back into the single-view branches, thereby enhancing the generalization ability of the model under missing-label conditions. The effectiveness of our proposed method is thoroughly demonstrated through extensive comparative experiments with advanced methods on five benchmark datasets. Code is available at https://github.com/xuy11/SCSD.
Figures & tables
| Dataset | ||||
|---|---|---|---|---|
| Corel5k | 260 | 3.396 | 4999 | 6 |
| Pascal07 | 20 | 1.465 | 9963 | 6 |
| Espgame | 268 | 4.686 | 20770 | 6 |
| Iaprtc12 | 291 | 5.719 | 19627 | 6 |
| Mirflickr | 38 | 4.716 | 25000 | 6 |
| Dataset | Metric | iMvWL | NAIM3L | DDINet | DICNet | MTD | SIP | RANK | DRLS | SCSD |
|---|---|---|---|---|---|---|---|---|---|---|
| Sources | IJCAI’18 | TPAMI’22 | TNNLS’23 | AAAI’23 | NeurIPS’23 | ICML’24 | TPAMI’25 | CVPR’25 | — | |
| Corel5k | AP | |||||||||
| 1-HL | ||||||||||
| 1-RL | ||||||||||
| AUC | ||||||||||
| 1-OE |
| Method | Corel5k | Pascal07 | ||||
|---|---|---|---|---|---|---|
| AP | 1-RL | AUC | AP | 1-RL | AUC | |
| SCSD w/o | ||||||
| SCSD w/o | ||||||
| SCSD w/o | ||||||
| SCSD | ||||||
| SCSD w/o VQ | ||||||
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Multi-Label Classification
Multi-label classification assigns several potentially related tags to each example, from medical findings and topics to objects and user interests.
See all 137 papers