Cross-Modal Learning

Ask about this topic

Recent momentum

-31%

36 papers in the last 28 days · 0.6% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Multimodal

Neighbouring directions

Multimodal LearningMulti-Modal Large Language ModelsMultimodal ReasoningMultimodal BenchmarksUnified Multimodal ModelsCross-Modal AttentionInput ModalityModality Gap

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

20 new papers

A weekly snapshot of new work published in Cross-Modal Learning.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Cross-Modal Learning.

Period ending 2026-09-07

6 new papers

A weekly snapshot of new work published in Cross-Modal Learning.

432 papers

Latest in Cross-Modal Learning

Browse all topics →
CardsList

  1. Hearing Like Humans? Sound Symbolism and Perceptual Alignment in Speech Language Models

    Jul 11, 2026Yun-Shao Tsai, Chun-Wei Chen, Chee-En Yu +2Cross-Modal Learning

  2. TextGaze: Prompting Gaze Target Estimation with Textual Scene Cues

    Jul 11, 2026Junhui She, Fei Wang, Kun Li +4Gaze Target EstimationGaze

  3. Label-Free Target-Domain Adaptation for Unconstrained Event-Image Feature Matching via Dual-Stage Distillation

    Jul 11, 2026Zhonghua Yi, Hao Shi, Qi Jiang +3Cross-Modal DistillationFeature Matching

  4. Robustifying Vision-Language Models via Test-Time Prompt Adaptation

    Jul 10, 2026Xingyu Zhu, Huanshen Wu, Shuo Wang +4Vision-Language Model AdaptationAdversarial Transferability

  5. Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models

    Jul 10, 2026Yijie Qian, Juncheng Wang, Chao Xu +6GenerativeCross-Modal Learning

  6. Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing

    Jul 9, 2026Dominick Reilly, Qiyu Wu, Hiromi Wakaki +2Multi-Modal Large Language ModelsCross-Modal Learning

  7. SHAP-Weighted Cross-Modal Expert Fusion for Emotion and Sentiment Recognition: Evidence and Limits

    Jul 9, 2026Adis Alihodzic, Selma Skopljakovic HubljarMultimodal FusionCross-Modal Fusion

  8. Dual-Correlation Hypergraph Network for Unaligned RGBT Video Object Detection and A Large-scale Benchmark

    Jul 9, 2026Qishun Wang, Yapeng Li, Zhengzheng Tu +2RgbtCross-Modal Learning

  9. Cross-Modal Generative Framework for Signal Translation from Fetal-Maternal Electrocardiograms to Fetal Doppler Waveforms

    Jul 9, 2026Tongli Su, Alireza Rafiei, Marly van Assen +4Congenital Heart DiseaseUltrasound

  10. Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks

    Jul 8, 2026Nobin Sarwar, Shubhashis Roy Dipta, Zheyuan Liu +1Large Language Model UnlearningCross-Modal Learning

  11. Two-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessment

    Jul 8, 2026Kanglei Zhou, Ruizhi Cai, Xinning Wang +4Multimodal FusionMultimodal Evaluation

  12. Ego-Human Motion Prediction with 3D-Aware LLM

    Jul 8, 2026Yujin Bae, Jaewoo Jeong, Hyeonseong Kim +1Human Motion PredictionEgocentric Vision

  13. Overview of the NLPCC 2026 Shared Task 1: Difficulty-Aware Multilingual and Multimodal Medical Instructional Video Understanding Evaluation

    Jul 7, 2026Shenxi Liu, Kan Li, Mingyang Zhao +2Medical Visual Question AnsweringCross-Modal Learning

  14. Music I Care About: Automated Multimodal Benchmarking of LLM Music Perception Skills on (Almost) Any Music

    Jul 7, 2026Tomáš Sourada, Katia Vendrame, Jan HajičMusic UnderstandingMultimodal Benchmarks

  15. Audio Sentiment Analysis via Distillation and Cross-Modal Integration of Generated Multilingual Transcripts

    Jul 7, 2026Andrei-George Durdun, Victor Constantinescu, Radu Tudor IonescuMultilingual Automatic Speech RecognitionSentiment Analysis

  16. Bumblebee: Interleaved Mixed-Layer Building Blocks for Large-Scale Recommendation Systems

    Jul 6, 2026David Bauer, Cancan Zhang, Wenshun Liu +13Multimodal RecommendationSequence Modeling

  17. UniSkip-Mamba: A Frequency-Aware State Space Model for Audio-Visual Temporal Forgery Localization

    Jul 5, 2026Cangjin Qiu, Quan Zhang, Dan Jiang +1Frequency-Aware Structural AggregationAudio Latent

  18. EVAS: Efficient Multimodal Temporal Forgery Localization via Audio-Visual Synergy and Steered Boundary Calibration

    Jul 5, 2026Shen Shen, Quan Zhang, Dan Jiang +1Face Forgery DetectionVideo Temporal Grounding

  19. One Framework for All: Cross-Modal Membership Inference for Generative Models

    Jul 5, 2026Dayong Ye, Tainqing Zhu, Kun Gao +6Membership InferenceMembership Inference Attacks

  20. C3C^3ASD: Multi-Level Consistency-Driven Representation Learning

    Jul 3, 2026Jin Hong, Jisoo Park, Junseok KwonDiscrete Speech RepresentationsAudio-Visual Consistency

  21. CoFEND: A Cross-Modal Fusion End-to-End Network for Cold-Start Drug-Drug Interaction Prediction

    Jul 3, 2026Di Wu, Hongyi Sun, Haichao Xu +3Drug-Drug InteractionsClinical Prediction

  22. Combating Textual Noise and Redundancy: Entropy-Aware Dense Visual Token Pruning

    Jul 2, 2026Xuehui Wang, Xuankun Yang, Wei ShenVisual Token PruningCross-Modal Learning

  23. Multimodal Knowledge Edit-Scoped Generalization for Online Recursive MLLM Editing

    Jul 2, 2026Siyuan Li, Youyuan Zhang, Ruitong Liu +2Multimodal Knowledge EditingCross-Modal Learning

  24. SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Models

    Jul 2, 2026Qi Lyu, Jiahua Dong, Baichen Liu +7Large Vision Language ModelsBinarization

  25. Cross4D-JEPA: Dense Cross-modal Correspondence Distillation for 4D Point Cloud Representation Learning

    Jul 1, 2026Trung Thanh Nguyen, Hai Nguyen-Truong, Tu Vo +2Cross-Modal DistillationRepresentation Learning

  26. HyFL-CLIP: Hyperbolic Fine-Tuning of CLIP for Robust Long-Context Understanding

    Jul 1, 2026Ji Ha Jang, Hayeon Kim, Chulwon Lee +2Few-Shot Contrastive Language-Image Pre-Training AdaptationEfficient Long-Context Inference

  27. Attribute-Prompted Kernel Hashing for Unsupervised Data-Efficient Cross-Modal Retrieval

    Jul 1, 2026Runhao Li, Xiaoxu Ma, Zhenyu Weng +5Cross-Modal LearningModality Alignment

  28. Learning When to Listen: Gated Affect Fusion for Human Motion Prediction

    Jul 1, 2026Jingni HuangHuman Motion PredictionFacial Expression Recognition

  29. Unsupervised Data-Efficient Cross-Modal Retrieval with Global-Neighborhood Alignment Hashing

    Jun 30, 2026Runhao Li, Xiaoxu Ma, Zhenyu Weng +5Contrastive AlignmentCross-Modal Learning

  30. MSNN-LINet: Cross-Modal Learning via Continuous Linear Integration

    Jun 30, 2026Gabriel ClingerCross-Modal LearningConvolutional

  31. Do Not Break the Vessels: Structure-Preserving Mean Flow for Vascular Image Translation

    Jun 30, 2026Changjin Sun, Zhuo Hu, Kaini Wang +6VesselsCross-Modal Learning

  32. Learning from Reliable Latent Prompts for Visual Recognition with Missing Modalities

    Jun 29, 2026Taixi Chen, Nancy GuoMissing ModalitiesCross-Modal Learning

  33. Semantic-Driven Scale and Spatial Selection for Efficient Cross-Modal Alignment in Referring Remote Sensing Image Segmentation

    Jun 29, 2026Kun Li, Shengxi Gui, Francesco Nex +1Remote Sensing Image SegmentationCross-Modal Alignment

  34. Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation

    Jun 29, 2026Shengqi Xu, Guojin Zhong, Yang Liu +7Tactile PerceptionContact-Rich Manipulation

  35. Same Concept, Different Directions: Cross-Modal Feature Heterogeneity in Sparse Autoencoders

    Jun 29, 2026Chungpa Lee, Jihoon Kwon, Kyle Min +1Cross-Modal LearningHeterogeneity

  36. Rank-Aware Hyperbolic Alignment for Vision-Language Dataset Distillation

    Jun 28, 2026Jongoh Jeong, Sun-Kyung Lee, Kuk-Jin YoonVision-Language AlignmentCross-Modal Learning

  37. ExACT: Exemplar-Driven Calibrated Refinement for Training-Free Visual Grounding in Remote Sensing Images

    Jun 27, 2026Zixiao Zhang, Lingling Li, Pei He +2Remote SensingExplicit Visual Grounding

  38. SIGNET: Motion-Level Knowledge Transfer for Cross-Language Sign Language Translation

    Jun 26, 2026Sobhan Asasi, Ozge Mercanoglu Sincan, Richard BowdenSign Language RecognitionCross-Lingual Transfer

  39. DeLux: Cross-Modal Local Artifact Restoration in Video Using Neuromorphic Data

    Jun 25, 2026Bartosz Stachowiak, Dariusz BrzezinskiPhotorealistic Video RestorationMetal Artifact Reduction

  40. See & Sniff: Learning Visuo-Olfactory Representations

    Jun 25, 2026Seongyu Kim, Seungwoo Lee, Hyeonggon Ryu +2Olfactory PerceptionCross-Modal Learning

  41. Modeling Local, Global, and Cross-Modal Context in Multimodal 3D MRI

    Jun 25, 2026Minh Duc Do, Tillmann Rheude, Noel Kronenberg +2Magnetic Resonance ImagingCross-Modal Learning

  42. Bridging Vision and Language Concepts through Optimal Transport Semantic Flow

    Jun 25, 2026Chenyang Zhang, Anqi Dong, Guangming Zhu +4Cross-Modal LearningConcept Bottleneck Models

  43. Multi-modality Image Fusion under Adverse Weather: Mask-Guided Feature Restoration and Interaction

    Jun 25, 2026Xilai Li, Xiaosong Li, Haishu Tan +3Visible Image FusionImage Restoration

  44. From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models

    Jun 24, 2026Haoxiang Sun, Tao Wang, Li Yuan +2Multi-Modal Large Language ModelsLarge Vision Language Models

  45. Steering Vision-Language Models with Joint Sparse Autoencoders

    Jun 24, 2026Huizhen Shu, Xuying Li, Hongxu Lin +2Improving Sparse AutoencodersCross-Modal Attention

  46. Does Translation-Enhanced Speech Encoder Pre-training Affect Speech LLMs?

    Jun 24, 2026Tomoya Mizumoto, Yusuke FujitaSpeech EncoderSpeech Translation

  47. MJEPA: A Simple and Scalable Joint-Embedding Predictive Architecture for Audio-Visual Learning

    Jun 23, 2026Revant Teotia, Adrien Bardes, Michael Rabbat +3Joint-Embedding Predictive ArchitecturesAudio-Visual Consistency

  48. SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoning

    Jun 22, 2026SingGuard TeamStreaming GuardrailsLarge Language Model Safety

  49. MultiMem: Measuring and Mitigating Memorization in Multi-Modal Contrastive Learning

    Jun 20, 2026Wenhao Wang, Franziska Boenisch, Michael Backes +1Multimodal Contrastive LearningMultimodal Memory

  50. Bridging the Age Gap: Towards Detecting Neural Audio Codec Synthesized Elderly Speech Deepfake

    Jun 19, 2026Orchid Chetia Phukan, Girish, Mohd Mujtaba Akhtar +1Audio Deepfake DetectionNeural Audio Codecs

  51. Cross-Modal Corroboration for Annotation-Free Wildlife Monitoring

    Jun 19, 2026Bharath Pillai, Varun Viswapriyan, Christopher Stewart +2Biodiversity MonitoringVision Sensors

  52. Synergistic Dual-Branch Adaptation for Multi-modal Generalized Category Discovery

    Jun 19, 2026Yuxun Qu, Minyu Zhou, Yongqiang Tang +2Generalized Category DiscoveryCross-Modal Learning

  53. EnTrust: Modeling Inter-Modal Conflict for Trustworthy Multimodal Medical Image Analysis

    Jun 19, 2026Dwarikanath Mahapatra, Abhijit Das, Behzad Bozorgtabar +5Multimodal FusionMedical Imaging

  54. CMDS-AD: Cross-Modal Dual-Stream Decoupling for Few-Shot Anomaly Detection

    Jun 18, 2026Junhao Cai, Junyu Chen, Deyu Zeng +4Zero-Shot Anomaly DetectionReal3D-Ad Datasets

  55. DREAM: Extending Vision-Language Models with Dual-Objective Encoding for Cross-Modal Retrieval

    Jun 17, 2026Kaleem Ullah, Altaf Hussain, Muhammad Munsif +1Multimodal RetrievalCross-Modal Learning

  56. The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reports

    Jun 16, 2026Samar AnsariRadiology Report GenerationClinical Notes

  57. Multimodal Evaluator Preference Collapse: Cross-Modal Coupling in Self-Evolving Agents

    Jun 15, 2026Zewen LiuSelf-AssessmentsPairwise Preferences

  58. Focus When Necessary: Adaptive Routing and Collaborative Grounding for Training-Free Visual Grounding

    Jun 15, 2026Yifan Wang, Peiming Li, Shiyu Li +5Explicit Visual GroundingCross-Modal Learning

  59. Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning

    Jun 13, 2026Zhengbo Zhang, Changtao Miao, Jinbo Su +10Multimodal Search AgentsVisual Reasoning

  60. MVEB: Massive Video Embedding Benchmark

    Jun 12, 2026Adnan El Assadi, Roman Solomatin, Isaac Chung +13VideosMulti-Modal Large Language Models