Cross-Modal Knowledge Distillation

Ask about this topic

Momentum

11 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 83

All topics
CardsList

  1. RT-DETR-World: Transferring Rich LLM Semantics to Real-Time Open-Vocabulary Detection

    Oct 7, 2026Yupeng Zhang, Ziyi Zhao, Juntao Cheng +4Open-Vocabulary Object DetectionReal-Time Object Detection

    Tianjin University. · Shenzhen University of Advanced Technology. · Shanghai Jiaotong University. +1

  2. AutodidactWAM: Cross-Modal Self-Distillation from Generated Video to Robot Actions

    Oct 6, 2026Sergei Kurchev, Iaroslav Kolomiets, Miguel Altamirano Cabrera +2Cross-Modal Knowledge DistillationCross-Embodiment Robot Learning

    Skolkovo Institute of Science and Technology (Skoltech), Bolshoy Boulevard 30, bld. 1, Moscow 121205, Russia. · MWS R&D Center.

  3. Multimodal Knowledge Distillation for Gastric Adenocarcinoma Classification from Whole-Slide Images

    Oct 6, 2026Shrihari Dumbre, Bikash SantraCross-Modal Knowledge DistillationMultimodal Classification

    Indian Institute of Technology, Jodhpur

  4. Omni-Embed-Mini: Binding Modalities Without Forgetting via Dense Distillation

    Oct 1, 2026Mohammed Irfan Kurpath, Jaseel Muhammad Kaithakkodan, Sahal Shaji Mullappilly +2Cross-Modal Knowledge DistillationMultimodal Embedding

    Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI)

  5. MCD: Causal Distillation of Multimodal In-Context Learning in Large Vision-Language Models

    Sep 30, 2026Yanshu Li, Jiaqian Li, Canran Xiao +3Cross-Modal Knowledge DistillationMultimodal ICL

    Brown University · University of Alabama at Birmingham · Hanyang University

  6. FedSocket: Recipient-Executable Knowledge Exchange for Heterogeneous Multimodal Federated Learning

    Sep 29, 2026Xinyuan ZhaoCross-Modal Knowledge DistillationFederated Knowledge Distillation

    Sun Yat-sen University

  7. Codebook-Guided Cross-Modal Knowledge Distillation for Structurally Heterogeneous Features

    Sep 29, 2026Dae Ung Jo, Jongin Lim, YoungJoon Yoo +1Cross-Modal Knowledge DistillationCross-Modal Alignment

    Kyungpook National University · AX/PI Center, Samsung Electronics · Chung-Ang University, SNUAILAB +1

  8. From Static to Dynamic: On-Policy Distillation from Image to Video Diffusion Models

    Sep 28, 2026Bingqing Jiang, Li Luo, Zichao Yu +3Cross-Modal Knowledge DistillationVideo Diffusion Models

    The University of Hong Kong · Cornell University

  9. Hyper-RED: Scalable Event Pre-training via Semantic Hypergraph Distillation

    Sep 15, 2026Meisen Wang, Zhiqiang Tian, Wei Bao +3Event-Based VisionCross-Modal Knowledge Distillation

    School of Software Engineering, Xi’an Jiaotong University, Xi’an 710049, China · National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center for Visual Information and Applications, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University, Xi’an 710049, China · BNRist, THUIBCS, BLBCI, School of Software, Tsinghua University, Beijing 100084, China +2

  10. AlignUS: MRI-Guided Ultrasound Representation Learning for ALS Classification from Tongue Images

    Sep 14, 2026Kadija Abdel Ghader, Emani Babe, Lorenzo Pettinari +2Cross-Modal Knowledge DistillationUltrasound Imaging

    Unité de Recherche en Systèmes Intelligents Avancés (URSIA), Institut Supérieur du Numérique (SupNum), Nouakchott, Mauritanie · University of Basel, Basel, Switzerland

  11. Weakly Supervised Spatial Grounding for Discriminative Attention-Based Ultrasound-Histopathology Alignment in Prostate Cancer Grading

    Sep 14, 2026Obed Korshie Dzikunu, Emma Willis, Mohammad Mahdi Abootorabi +7Computational PathologyCross-Modal Knowledge Distillation

    Department of Electrical and Computer Engineering, University of British Columbia, Vancouver, Canada · Vector Institute, Toronto, Canada · School of Computing, Queen’s University, Kingston, Canada +3

  12. Freezing of Gait Prediction Under Spatial Occlusion: An IMU-Supervised Cross-Modal Distillation Approach

    Sep 9, 2026Chandan Biswas, Aryan Singh, Anabik PalCross-Modal Knowledge DistillationGait Analysis

    NeuroAI Fusion Labs Kolkata, India · Indian Institute of Science Education and Research Berhampur, Odisha

  13. CASD: Chunk-Aligned Semantic Distillation for Multi-StageRobot Manipulation

    Sep 8, 2026Tinghe Ding, Jiahao Li, He WangCross-Modal Knowledge DistillationLanguage-Conditioned Robot Manipulation

    Ant Group, China

  14. Supervised Cross-Modal Feature Alignment for Zero-Wearable Freezing of Gait Detection in Parkinsonism

    Sep 8, 2026Aryan Singh, Chandan BiswasCross-Modal Knowledge DistillationCross-Modal Alignment

    NeuroAI Fusion Labs Kolkata, India

  15. Modality Disentangled Learning for Incomplete Multimodal Emotion Recognition: A Primitive Memory Distillation Perspective

    Aug 31, 2026Jiaqi Zhang, Zheng Pang, Mengting Li +9Missing-Modality LearningMemory-Augmented Neural Networks

    Jiangsu University · Griffith University · National University of Singapore +8

  16. Repurposing RGB-based Foundation Model for Depth Estimation on Thermal Images Using Hierarchical Supervision

    Aug 12, 2026Jie Hong, Tingtian Li, Xuesong Li +1Thermal ImagingCross-Modal Knowledge Distillation

    CI3 Lab, Department of Civil Engineering, The University of Hong Kong, Hong Kong SAR, China · Commonwealth Scientific and Industrial Research Organisation (CSIRO), Canberra, ACT, Australia

  17. Reading is not Reasoning: Bridging the Agentic Policy Gap in Vision-Text Compression

    Aug 9, 2026Cheng Fan, Junyi Zhou, Tingzhang Luo +5Cross-Modal Knowledge DistillationMultimodal Token Compression

    City University of Hong Kong · Huawei Technologies Ltd.

  18. Vid2WAM: Distilling Video Diffusion Priors into World Action Models

    Aug 9, 2026Chenhao Qiu, Ruixiang Wang, Runyi Zhao +7Cross-Modal Knowledge DistillationWorld Model Learning

    Fudan University · The Chinese University of Hong Kong, Shenzhen · Shanghai Innovation Institute

  19. BioKD: Selective Physiology-to-Video Knowledge Distillation via Reliability Gate for Emotion Recognition

    Aug 6, 2026Bojing Hou, Ruohao Li, Yitong Zhu +3Cross-Modal Knowledge DistillationSelective Knowledge Distillation

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · New York University, New York, NY, USA

  20. Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopy

    Aug 1, 2026Simiao Sun, Kenneth Ng, Lynn Lee +6Cross-Modal Knowledge DistillationVisual Representation Learning

    Department of Chemistry, University of Hong Kong, Hong Kong SAR · Museum Studies Program, University of Hong Kong, Hong Kong SAR · Department of History, City University, Hong Kong, Hong Kong SAR +3

  21. Theia: Large-Scale Multimodal Captioning and Automated Validation of the Incidents1M Dataset for Data-Free Distillation

    Jul 30, 2026Simone Giano, Lorenzo Severini, Alessandro Galdelli +1Cross-Modal Knowledge DistillationImage Captioning

    aDipartimento di Ingegneria dell’Informazione, Università Politecnica delle Marche, Via Brecce Bianche 12, Ancona, 60121, Marche, Italy

  22. Shared Semantic Codebook Distillation for Unpaired Cross-Modal Medical Classification

    Jul 29, 2026Dillan Imans, Phuoc-Nguyen Bui, Duc-Tai Le +1Cross-Modal Knowledge DistillationMedical Image Classification

    Department of Computer Science and Engineering, Sungkyunkwan University, Suwon, South Korea · Convergence Research Institute, Sungkyunkwan University, Suwon, South Korea · Department of AI Systems Engineering, Sungkyunkwan University, Suwon, South Korea +1

  23. MIRROR: Learning from the Other View for Multi-Modal Reasoning

    Jul 23, 2026Wen Ye, Yuxiao Qu, Aviral Kumar +1Cross-Modal Knowledge DistillationMultimodal Reasoning

    University of Southern California · Carnegie Mellon University

  24. X3^3-OPD: Distilling Reasoning into Large Audio-Language Models via On-Policy Alignment

    Jul 23, 2026Dongjie Fu, Di Cao, Xize Cheng +6Cross-Modal Knowledge DistillationAudio Reasoning

    1Tencent Hunyuan · 2Zhejiang University

  25. UnDA: Unpaired Domain Alignment for Cross-Modal Knowledge Transfer in Medical Imaging

    Jul 23, 2026Rafsan Jany, Shadab Tanjeed Ahmad, Ahsan Bulbul +3Cross-Modal Knowledge DistillationCross-Modality Medical Image Segmentation

    Korea Institute of Oriental Medicine, Daejeon, South Korea · Islamic University of Technology, Gazipur, Bangladesh

  26. OPOD: On-Policy Omni Distillation

    Jul 23, 2026Tong Zhao, Yuyang Hu, Yutao Zhu +5Cross-Modal Knowledge DistillationUnified Multimodal Models

    1Renmin University of China · 2Tencent

  27. IoU-PD: IoU-Aware Privileged Distillation for Visual Grounding with Multimodal Large Language Models

    Jul 17, 2026Xiuyuan Zhu, Ke Lu, Hao Wu +4Cross-Modal Knowledge DistillationMultimodal Large Language Models

    University of Chinese Academy of Sciences, Beijing, China · State Key Laboratory of Communication Content Cognition, Beijing, China · Peng Cheng Laboratory, Shenzhen, Guangdong, China +1

  28. TOLiD: Bridging the Architecture Gap in Vision Foundation Model to LiDAR Pretraining via Token Lifting for Distillation

    Jul 12, 2026Sutharsan Mahendran, Darshana Priyasad, Kaushik Roy +4Cross-Modal Knowledge DistillationSelf-Supervised Learning

    SAIVT Group, School of Electrical Engineering and Robotics, Queensland University of Technology, Australia. · CSIRO Robotics, CSIRO, Australia.

  29. Label-Free Target-Domain Adaptation for Unconstrained Event-Image Feature Matching via Dual-Stage Distillation

    Jul 11, 2026Zhonghua Yi, Hao Shi, Qi Jiang +3Event-Based VisionCross-Modal Knowledge Distillation

    Zhejiang University · Ant Group · National University of Defense Technology +1

  30. CarbonCLIP: Enhance Carbon Prediction from Satellite Imagery via Integrated Street-View Semantics and Temporal Context Training

    Jul 8, 2026Zeru Yang, Fang-Ying Gong, Steve H. L. Yim +1Cross-Modal Knowledge DistillationRemote Sensing

    Energy Research Institute at NTU, Interdisciplinary Graduate Programme, Nanyang Technological University, Singapore · School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore · School of Public Administration and Policy, Renmin University of China, Beijing, China +2

  31. Hierarchical Multi-to-Single-Modal Knowledge Distillation for Disruption Prediction in EAST

    Jul 5, 2026Qiang Chen, Xiao Wang, Hao Si +9Cross-Modal Knowledge DistillationEfficient Multimodal Inference

    School of Computer Science and Technology, Anhui University, Hefei 230031, China · Institute of Plasma Physics, Chinese Academy of Sciences, Hefei 230031, China · State Key Laboratory of Opto-Electronic Information Acquisition and Protection Technology, Anhui University, Hefei 230039, China

  32. Token-level Response-visual Attention Guidance for Multimodal LLMs Knowledge Distillation

    Jul 1, 2026Jaehyun Jang, Eunseop Yoon, Hee Suk Yoon +3Cross-Modal Knowledge DistillationVLM Distillation

    Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea · University of Illinois Urbana-Champaign, Champaign, USA

  33. H-OPD: Confidence Aware Heterogeneous Multi-Teacher Multimodal On-policy Distillation

    Jul 1, 2026Qixiang Yin, Huanjin Yao, Yuchen Cai +5Cross-Modal Knowledge DistillationVLM Distillation

    Beijing University of Posts and Telecommunications · Zhongguancun Academy, Beijing, China · ByteDance +3

  34. Cross4D-JEPA: Dense Cross-modal Correspondence Distillation for 4D Point Cloud Representation Learning

    Jul 1, 2026Trung Thanh Nguyen, Hai Nguyen-Truong, Tu Vo +2Cross-Modal Knowledge DistillationPoint Cloud Learning

    Nagoya University, Japan · Northeastern University, USA · KC Machine Learning Lab, Korea +2

  35. PGUDA: Pressure-Guided Unsupervised Domain Adaptation with Cross-Modal Knowledge Distillation for sEMG-Based Gesture Recognition

    Jun 30, 2026Yurui Liu, Xiao-Cong Zhong, Qisong Wang +3EMG-Based Gesture RecognitionCross-Modal Knowledge Distillation

    School of Instrumentation Science and Engineering, Harbin Institute of Technology, Harbin 150001, China

  36. Cross-Modal Iteration Distillation for Robust IHD Screening: The IDNet Framework and A New Benchmark

    Jun 29, 2026Yongchang Gao, Junjie Pang, Shuaiyu Yang +5Cross-Modal Knowledge DistillationMedical Imaging

    University of Chinese Academy of Sciences, Beijing, China · MGI Tech Co., Ltd., Shenzhen, China · Shenzhen University, Shenzhen, China

  37. RPM-Distill: Physiology-guided Adaptive Cross-modal Distillation for Robust Remote Physiological Measurement

    Jun 26, 2026Jiyao Wang, Qingyong Hu, Duoxun Tang +3Remote PhotoplethysmographyCross-Modal Knowledge Distillation

    McGill University, Montreal, Canada · Hong Kong University of Science and Technology, Hong Kong, China · Tsinghua University, Shenzhen, China +1

  38. Large Language Model Teaches Visual Students: Cross-Modality Transfer of Fine-Grained Conceptual Knowledge

    Jun 25, 2026Thomas Shih-Chao Liang, Zhuoran Yu, Yong Jae LeeCross-Modal Knowledge DistillationFine-Grained Image Classification

    University of Wisconsin-Madison

  39. Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation

    Jun 24, 2026Xiaopei Wu, Yuenan Hou, Junkai Xu +7Cross-Modal Knowledge Distillation3D Semantic Segmentation

    1Shanghai AI Laboratory · 2Zhejiang University · Hangzhou Dianzi University

  40. M^2C-EvDet: Multi-Domain Multi-Order Cross-Modal Knowledge Distillation for Event-based Object Detection

    Jun 23, 2026Wei Bao, Siqi Li, Shouan Pan +2Cross-Modal Knowledge DistillationEvent-Based Object Detection

    BNRist, THUIBCS, BLBCI, School of Software, Tsinghua University, Beijing 100084, China · School of Economics and Management, Beijing Forestry University, Beijing 100083, China

  41. UNIEGO: Proxies as Mediators for Unified Egocentric Video Representation Learning

    Jun 18, 2026Wenhao Chi, Arkaprava Sinha, Dominick Reilly +2Cross-Modal Knowledge DistillationMulti-View Learning

    University of North Carolina at Charlotte

  42. HilDA: Hierarchical Distillation with Diffusion for Advancing Self-Supervised LiDAR Pre-training

    Jun 18, 2026Maciej Wozniak, Jesper Ericsson, Hariprasath Govindarajan +4Cross-Modal Knowledge DistillationSelf-Supervised Pre-Training

    KTH Royal Institute of Technology, Sweden · TRATON AB, Sweden · Linköping University, Sweden +1

  43. Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning

    Jun 17, 2026Pengyu Li, Zhitao Gao, Lingling Zhang +5Cross-Modal Knowledge DistillationEfficient Multimodal Inference

    Xi’an Jiaotong University · Shaanxi Province Key Laboratory of Big Data Knowledge Engineering · MOE KLINNS Lab, Xi’an Jiaotong University +1

  44. Spatially Stratified Distillation for Heterogeneous Radar Place Recognition

    Jun 17, 2026Sagun Singh Shrestha, Samuel Harding, Abdelwahed Khamis +2Cross-Modal Knowledge DistillationKnowledge Distillation

    CSIRO Robotics, Brisbane, Australia · University of Queensland, Brisbane, Australia

  45. VL2Spike: Spike-driven Distillation from VLMs for Low-Power Visual Perception in Embodied AI

    Jun 14, 2026Zinan Liu, Eric Zheng, Soumyaratna Debnath +3Cross-Modal Knowledge DistillationSpiking Transformers

    School of EEE, Nanyang Technological University (NTU), Singapore · Department of Computer Science, University of Toronto and Advanced Micro Devices, Inc., Canada · State Key Laboratory of Extreme Photonics and Instrumentation, Zhejiang University, Hangzhou 310027, China +1

  46. VISA: VLM-Guided Instance Semantic Auditing for 3D Occupancy World Models

    Jun 11, 2026Ruiqi Xian, Yuehan Xian, Jing Liang +2Cross-Modal Knowledge DistillationWorld Model Learning

    University of Maryland College Park, USA · Independent Researcher, USA · Standford University, USA +1

  47. MOSAIC: Modality-Specific Adaptation for Incremental Continual Learning in Parkinson's Disease Gait Assessment

    Jun 11, 2026Minlin Zeng, Zhipeng Zhou, Yang Qiu +2Cross-Modal Knowledge DistillationContinual Learning

    Nanyang Technological University, Singapore · Pacific Parkinson’s Research Centre, University of British Columbia, Canada

  48. FreqKD: Frequency-Decoupled Cross-Modal Knowledge Distillation for Infrared Object Detection

    Jun 10, 2026Keval Thaker, Venkatraman Narayanan, Abdalmalek Aburaddaha +1Cross-Modal Knowledge DistillationMultispectral Object Detection

    University of Michigan-Dearborn 4901 Evergreen Rd Dearborn, MI 48128, USA

  49. Cross-Modal Knowledge Distillation without Paired Data: Theoretical Foundation and Algorithm

    Jun 9, 2026Trong Khiem Tran, Anh Duc Chu, Quang Hung Pham +2Cross-Modal Knowledge DistillationCross-Modal Alignment

    School of Electrical Engineering and Computer Science, Washington State University, Pullman, US · School of Information and Communications Technology, Hanoi University of Science and Technology, Hanoi, Vietnam

  50. Synesthesia via Direct Latent Augmentation:Bypassing the Decode-Encode Loop for Cross-Modal Distillation

    Jun 6, 2026Cristian Sbrolli, Nicolas Michel, Matteo Matteucci +1Cross-Modal Knowledge DistillationSynthetic Data Augmentation

    Politecnico di Milano, Milan, Italy · University of Tokyo, Tokyo, Japan

  51. Learning Visual Spatial Planning from Symbolic State via Modality-Gap-Aware Self-Distillation

    Jun 4, 2026Haocheng Luo, Jiahui Liu, Ruicheng Zhang +6Cross-Modal Knowledge DistillationVisual Spatial Reasoning

    1Tsinghua University · 2The Hong Kong University of Science and Technology

  52. PaCX-MAE: Physiology-Augmented Chest X-Ray Masked Autoencoder

    Jun 1, 2026Yancheng Liu, Kenichi Maeda, Manan PancholyCross-Modal Knowledge DistillationChest X-Ray Classification

    Department of Computer Science, Brown University, Providence, RI, USA.

  53. Single-Channel Tissue Segmentation via Cross-Modal Distillation from Foundation Models

    May 30, 2026Sakib Mohammad, Jarin Ritu, Md Sakhawat HossainCross-Modal Knowledge DistillationMedical Image Segmentation

    Department of Engineering Technology Fairmont State University Fairmont, WV, USA · Department of Electrical and Computer Engineering Texas A&M University College Station, TX, USA · Department of Mechanical Engineering Auburn University Auburn, AL, USA

  54. Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding

    May 30, 2026Hee Suk Yoon, Eunseop Yoon, Jaehyun Jang +6Cross-Modal Knowledge DistillationVLM Distillation

    Korea Advanced Institute of Science and Technology (KAIST) · University of Illinois Urbana-Champaign (UIUC) · Microsoft Research Asia (MSRA)

  55. xModel-KD: Cross-modal Knowledge Distillation for 3D Scene Perception using LiDAR

    May 28, 2026Thenukan Pathmanathan, Kanchan Keisham, Thangarajah AkilanCross-Modal Knowledge Distillation3D Point Cloud Segmentation

    Dept. of Computer Science Lakehead University Thunder Bay, Canada · School of Computer Science Engg. & Info. Systems Vellore Institute of Technology Tamil Nadu, India · Dept. of Software Engg. Lakehead University Thunder Bay, Canada

  56. VE2VF: Vision-Enabled to Vision-Free Distillation via Real-world Reinforcement Learning for Robust Contact-Rich Manipulation

    May 28, 2026Victor Kowalski, Chengxi Li, Dongheui LeeCross-Modal Knowledge DistillationRobot Skill Learning

    Autonomous Systems, Technische Universitaet Wien (TU Wien), Vienna, Austria · Institute of Robotics and Mechatronics (DLR), German Aerospace Center, Wessling, Germany

  57. OmniRetriever: Any-to-Any Audio-Video-Text Retrieval via Fusion-as-Teacher Distillation

    May 26, 2026Yunze Liu, Chi-Hao Wu, Enmin Zhou +1Cross-Modal LearningCross-Modal Knowledge Distillation

    Memories.ai Research

  58. STAMBRIDGE: Spectral-Temporal Amplitude-aware Mid-Feature Bridge for EEG Visual Decoding

    May 22, 2026Jiahe Meng, Weiming Zeng, Yueyang Li +5Cross-Modal Knowledge DistillationRepresentation Learning

    Lab of Digital Image and Intelligent Computation, Shanghai Maritime University, Shanghai 201306, China · Department of Language Science and Technology, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong SAR, China · Department of Neurology, Affiliated Lianyungang Hospital of Xuzhou Medical University, Lianyungang 222002, China +1

  59. TextTeacher: What Can Language Teach About Images?

    May 21, 2026Tobias Christian Nauen, Stanislav Frolov, Brian Bernhard Moser +3Cross-Modal Knowledge DistillationVisual Representation Learning

    RPTU University Kaiserslautern-Landau · German Research Center for Artificial Intelligence (DFKI)

  60. HEED: Density-Weighted Residual Alignment for Hybrid Vision-Language Model Distillation

    May 16, 2026Yihao Liang, Niraj K. JhaCross-Modal Knowledge DistillationEfficient VLM Inference

    Princeton University