Cross-Modal Knowledge Distillation

Ask about this topic

Momentum

11 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 83

All topics
CardsList

  1. RT-DETR-World: Transferring Rich LLM Semantics to Real-Time Open-Vocabulary Detection

    Oct 7, 2026Yupeng Zhang, Ziyi Zhao, Juntao Cheng +4Open-Vocabulary Object DetectionReal-Time Object Detection

    Tianjin University. · Shenzhen University of Advanced Technology. · Shanghai Jiaotong University. +1

  2. AutodidactWAM: Cross-Modal Self-Distillation from Generated Video to Robot Actions

    Oct 6, 2026Sergei Kurchev, Iaroslav Kolomiets, Miguel Altamirano Cabrera +2Cross-Modal Knowledge DistillationCross-Embodiment Robot Learning

    Skolkovo Institute of Science and Technology (Skoltech), Bolshoy Boulevard 30, bld. 1, Moscow 121205, Russia. · MWS R&D Center.

  3. Multimodal Knowledge Distillation for Gastric Adenocarcinoma Classification from Whole-Slide Images

    Oct 6, 2026Shrihari Dumbre, Bikash SantraCross-Modal Knowledge DistillationMultimodal Classification

    Indian Institute of Technology, Jodhpur

  4. Omni-Embed-Mini: Binding Modalities Without Forgetting via Dense Distillation

    Oct 1, 2026Mohammed Irfan Kurpath, Jaseel Muhammad Kaithakkodan, Sahal Shaji Mullappilly +2Cross-Modal Knowledge DistillationMultimodal Embedding

    Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)

  5. MCD: Causal Distillation of Multimodal In-Context Learning in Large Vision-Language Models

    Sep 30, 2026Yanshu Li, Jiaqian Li, Canran Xiao +3Cross-Modal Knowledge DistillationMultimodal ICL

    Brown University · University of Alabama at Birmingham · Hanyang University

  6. FedSocket: Recipient-Executable Knowledge Exchange for Heterogeneous Multimodal Federated Learning

    Sep 29, 2026Xinyuan ZhaoCross-Modal Knowledge DistillationFederated Knowledge Distillation

    Sun Yat-sen University

  7. Codebook-Guided Cross-Modal Knowledge Distillation for Structurally Heterogeneous Features

    Sep 29, 2026Dae Ung Jo, Jongin Lim, YoungJoon Yoo +1Cross-Modal Knowledge DistillationCross-Modal Alignment

    Kyungpook National University · AX/PI Center, Samsung Electronics · Chung-Ang University, SNUAILAB +1

  8. From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models

    Sep 28, 2026Bingqing Jiang, Li Luo, Zichao Yu +3Cross-Modal Knowledge DistillationVideo Diffusion Models

    The University of Hong Kong · Cornell University

  9. Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation

    Sep 15, 2026Meisen Wang, Zhiqiang Tian, Wei Bao +3Event-Based VisionCross-Modal Knowledge Distillation

    School of Software Engineering, Xi’an Jiaotong University, Xi’an 710049, China · National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an 710049, China · BNRist, THUIBCS, BLBCI, School of Software, Tsinghua University, Beijing 100084, China +2

  10. AlignUS: MRI-Guided Ultrasound Representation Learning for ALS Classification from Tongue Images

    Sep 14, 2026Kadija Abdel Ghader, Emani Babe, Lorenzo Pettinari +2Cross-Modal Knowledge DistillationUltrasound Imaging

    Unité de Recherche en Systèmes Intelligents Avancés (URSIA), Institut Supérieur du Numérique (SupNum), Nouakchott, Mauritanie · University of Basel, Basel, Switzerland

  11. Weakly Supervised Spatial Grounding for Discriminative Attention-Based Ultrasound-Histopathology Alignment in Prostate Cancer Grading

    Sep 14, 2026Obed Korshie Dzikunu, Emma Willis, Mohammad Mahdi Abootorabi +7Computational PathologyCross-Modal Knowledge Distillation

    Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, Canada · Vector Institute, Toronto, Canada · School of Computing, Queen’s University, Kingston, Canada +3

  12. Freezing of Gait Prediction Under Spatial Occlusion: An IMU-Supervised Cross-Modal Distillation Approach

    Sep 9, 2026Chandan Biswas, Aryan Singh, Anabik PalCross-Modal Knowledge DistillationGait Analysis

    NeuroAI Fusion Labs Kolkata, India · Indian Institute of Science Education and Research Berhampur, Odisha

  13. CASD: Chunk-Aligned Semantic Distillation for Multi-StageRobot Manipulation

    Sep 8, 2026Tinghe Ding, Jiahao Li, He WangCross-Modal Knowledge DistillationLanguage-Conditioned Robot Manipulation

    Ant Group, China

  14. Supervised Cross-Modal Feature Alignment for Zero-Wearable Freezing of Gait Detection in Parkinsonism

    Sep 8, 2026Aryan Singh, Chandan BiswasCross-Modal Knowledge DistillationCross-Modal Alignment

    NeuroAI Fusion Labs Kolkata, India

  15. Modality Disentangled Learning for Incomplete Multimodal Emotion Recognition: A Primitive Memory Distillation Perspective

    Aug 31, 2026Jiaqi Zhang, Zheng Pang, Mengting Li +9Missing-Modality LearningMemory-Augmented Neural Networks

    Jiangsu University · Griffith University · National University of Singapore +8

  16. Repurposing RGB-based Foundation Model for Depth Estimation on Thermal Images Using Hierarchical Supervision

    Aug 12, 2026Jie Hong, Tingtian Li, Xuesong Li +1Thermal ImagingCross-Modal Knowledge Distillation

    CI3 Lab, Department of Civil Engineering, The University of Hong Kong, Hong Kong SAR, China · Commonwealth Scientific and Industrial Research Organisation (CSIRO), Canberra, ACT, Australia

  17. Reading is not Reasoning: Bridging the Agentic Policy Gap in Vision-Text Compression

    Aug 9, 2026Cheng Fan, Junyi Zhou, Tingzhang Luo +5Cross-Modal Knowledge DistillationMultimodal Token Compression

    City University of Hong Kong · Huawei Technologies Ltd.

  18. Vid2WAM: Distilling Video Diffusion Priors into World Action Models

    Aug 9, 2026Chenhao Qiu, Ruixiang Wang, Runyi Zhao +7Cross-Modal Knowledge DistillationWorld Model Learning

    Fudan University · The Chinese University of Hong Kong, Shenzhen · Shanghai Innovation Institute

  19. BioKD: Selective Physiology-to-Video Knowledge Distillation via Reliability Gate for Emotion Recognition

    Aug 6, 2026Bojing Hou, Ruohao Li, Yitong Zhu +3Cross-Modal Knowledge DistillationSelective Knowledge Distillation

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · New York University, New York, NY, USA

  20. Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopy

    Aug 1, 2026Simiao Sun, Kenneth Ng, Lynn Lee +6Cross-Modal Knowledge DistillationVisual Representation Learning

    Department of Chemistry, University of Hong Kong, Hong Kong SAR · Museum Studies Program, University of Hong Kong, Hong Kong SAR · Department of History, City University, Hong Kong, Hong Kong SAR +3

  21. Theia: Large-Scale Multimodal Captioning and Automated Validation of the Incidents1M Dataset for Data-Free Distillation

    Jul 30, 2026Simone Giano, Lorenzo Severini, Alessandro Galdelli +1Cross-Modal Knowledge DistillationImage Captioning

    aDipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Via Brecce Bianche 12, Ancona, 60121, Marche, Italy

  22. Shared Semantic Codebook Distillation for Unpaired Cross-Modal Medical Classification

    Jul 29, 2026Dillan Imans, Phuoc-Nguyen Bui, Duc-Tai Le +1Cross-Modal Knowledge DistillationMedical Image Classification

    Department of Computer Science and Engineering, Sungkyunkwan University, Suwon, South Korea · Convergence Research Institute, Sungkyunkwan University, Suwon, South Korea · Department of AI Systems Engineering, Sungkyunkwan University, Suwon, South Korea +1

  23. MIRROR: Learning from the Other View for Multi-Modal Reasoning

    Jul 23, 2026Wen Ye, Yuxiao Qu, Aviral Kumar +1Cross-Modal Knowledge DistillationMultimodal Reasoning

    University of Southern California · Carnegie Mellon University

  24. X3^3-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment

    Jul 23, 2026Dongjie Fu, Di Cao, Xize Cheng +6Cross-Modal Knowledge DistillationAudio Reasoning

    1Tencent Hunyuan · 2Zhejiang University

  25. UnDA: Unpaired Domain Alignment for Cross-Modal Knowledge Transfer in Medical Imaging

    Jul 23, 2026Rafsan Jany, Shadab Tanjeed Ahmad, Ahsan Bulbul +3Cross-Modal Knowledge DistillationCross-Modality Medical Image Segmentation

    Korea Institute of Oriental Medicine, Daejeon, South Korea · Islamic University of Technology, Gazipur, Bangladesh

  26. OPOD: On-Policy Omni Distillation

    Jul 23, 2026Tong Zhao, Yuyang Hu, Yutao Zhu +5Cross-Modal Knowledge DistillationUnified Multimodal Models

    1Renmin University of China · 2Tencent

  27. IoU-PD: IoU-Aware Privileged Distillation for Visual Grounding with Multimodal Large Language Models

    Jul 17, 2026Xiuyuan Zhu, Ke Lu, Hao Wu +4Cross-Modal Knowledge DistillationMultimodal Large Language Models

    University of Chinese Academy of Sciences, Beijing, China · State Key Laboratory of Communication Content Cognition, Beijing, China · Peng Cheng Laboratory, Shenzhen, Guangdong, China +1

  28. TOLiD: Bridging the Architecture Gap in Vision Foundation Model to LiDAR Pretraining via Token Lifting for Distillation

    Jul 12, 2026Sutharsan Mahendran, Darshana Priyasad, Kaushik Roy +4Cross-Modal Knowledge DistillationSelf-Supervised Learning

    SAIVT Group, School of Electrical Engineering and Robotics, Queensland University of Technology, Australia. · CSIRO Robotics, CSIRO, Australia.

  29. Label-Free Target-Domain Adaptation for Unconstrained Event-Image Feature Matching via Dual-Stage Distillation

    Jul 11, 2026Zhonghua Yi, Hao Shi, Qi Jiang +3Event-Based VisionCross-Modal Knowledge Distillation

    Zhejiang University · Ant Group · National University of Defense Technology +1

  30. CarbonCLIP: Enhance Carbon Prediction from Satellite Imagery via Integrated Street-View Semantics and Temporal Context Training

    Jul 8, 2026Zeru Yang, Fang-Ying Gong, Steve H. L. Yim +1Cross-Modal Knowledge DistillationRemote Sensing

    Energy Research Institute at NTU, Interdisciplinary Graduate Programme, Nanyang Technological University, Singapore · School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore · School of Public Administration and Policy, Renmin University of China, Beijing, China +2