contrastive knowledge distillation

Latest papers

CardsList

9 papers3 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

  1. Heterogeneous Asymmetric Contrastive Distillation

    Nov 7, 2026Qi Wang, Jinjia Zhoucontrastive knowledge distillationKnowledge Distillation

  2. Mental Imagery That Matters: Curing Latent Collapse in Multimodal Reasoning

    Nov 7, 2026Mi Luo, Rohan Dugad, Zihui Xue +2contrastive knowledge distillationMLLM Reasoning

  3. Condition-Contrastive Extrapolation for On-Policy Distillation of Language Models

    Oct 15, 2026Wenxuan Luo, Chenxi Li, Haoyue Liu +2contrastive knowledge distillationLanguage Model Distillation

  4. CV-OPD: Contrastive Vision On-policy Distillation

    Oct 9, 2026Haowei Wang, Hao Lin, Qi Zhu +4contrastive knowledge distillationVLM Distillation

  5. Multi-Teacher Contrastive Distillation for Edge-Efficient Pathology Foundation Models

    Jul 6, 2026Tim Lenz, Maurice Heide, Marco Gustav +2Computational PathologyPathology Foundation Models

  6. Lightweight SAR Ship Detection via Contrastive Distillation

    May 27, 2026Surendar Devasundaram, Banafsheh Saber Latibari, Abhijit MahalanobisKnowledge DistillationRelational Knowledge Distillation

  7. DARK: Diagonal-Anchored Repulsive Knowledge Distillation for Vision-Language Models under Extreme Compression

    Mar 5, 2026Numan Saeed, Asif Hanif, Fadillah Adamsyah Maani +2VLM Compressioncontrastive knowledge distillation

  8. Stabilizing the Modality Gap: Null-Space Projected Continual Learning for Vision-Language Models

    Jul 26, 2025Tiantian Peng, Yuyang Liu, Shuo Yang +2contrastive knowledge distillationContinual Learning for VLMs