Cross-Modal Learning

Ask about this topic

Recent momentum

-31%

36 papers in the last 28 days · 0.6% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Multimodal

Neighbouring directions

Multimodal LearningMulti-Modal Large Language ModelsMultimodal ReasoningMultimodal BenchmarksUnified Multimodal ModelsCross-Modal AttentionInput ModalityModality Gap

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

20 new papers

A weekly snapshot of new work published in Cross-Modal Learning.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Cross-Modal Learning.

Period ending 2026-09-07

6 new papers

A weekly snapshot of new work published in Cross-Modal Learning.

432 papers

Latest in Cross-Modal Learning

Browse all topics →
CardsList

  1. C3^3PO: Evaluating Cross-Modal Composition and Counterfactual Performance in Omnimodal Models

    Aug 5, 2026Swapnanil Mukherjee, Agyeya Negi, Tanuja Ganu +1Cross-Modal LearningUnified Multimodal Models

  2. UG-UMRE: Uncertainty-Guided Modality Augmentation and Distributional Calibration for Unified Multimodal Relation Extraction

    Aug 5, 2026Bo Kong, Liruiz Jia, Yi Liang +5Cross-Modal Learning

  3. RegisterBridgeMM: A Register-Centric Framework for RGB-Infrared Object Detection

    Aug 5, 2026Zian Wang, Hangchuan Liang, Yuehua Chen +4InfraredCross-Modal Learning

  4. Does Forgetting Transfer Across Modalities? A Real-World Benchmark for Cross-Modal Knowledge Unlearning Evaluation

    Aug 4, 2026Chunlin Liu, Junnian Chen, Haitong Jiang +7Large Language Model UnlearningCross-Modal Learning

  5. Rethinking Modality Reliability in Multimodal Sentiment Analysis with Incomplete Observations

    Aug 4, 2026Chunlei Meng, Jacqueline J. Pang, Pengbin Feng +3Input ModalityCross-Modal Learning

  6. Modality Agreement- and Conflict-Aware Prototype Hypergraph Learning for Multimodal Intent Understanding

    Aug 4, 2026Mohnish Raj, Suraj Kumar, Soumi Chattopadhayay +2Robust Multimodal LearningInput Modality

  7. CRIL-U-Net: Compact Ratio-Interaction Learning for Focal Cortical Dysplasia Segmentation from T1w and FLAIR MRI

    Aug 4, 2026Soumen Ghosh, Amit Soni Arya, Tilottama Goswami +3U-NetMagnetic Resonance Imaging

  8. Learning Music Style for Piano Arrangement Through Cross-Modal Bootstrapping

    Aug 4, 2026Jingwei Zhao, Gus Xia, Ziyu Wang +1PianoLarge Audio Language Models

  9. ReMiX-MAE: Learning Missing-Channel Cross-Modal Representations from RGB-Only Clinical Facial Videos for Sympathetic-Mediated Pain Assessment

    Aug 3, 2026Nan Bi, Taoyue Wang, Lijun Yin +1Facial Expression RecognitionCross-Modal Learning

  10. EchoCache: Energy-Guided Cross-Modal Caching for Efficient Audio-Driven Video Generation

    Aug 3, 2026Jiayu Chen, Xiaoyu Wu, Rongshan Gao +6Joint Audio-Video GenerationAudio-Visual Consistency

  11. Syntax Meets Semantics: Understanding Scientific Formulae

    Aug 3, 2026Yuni Susanti, Moritz SchubotzSyntactic StructureCross-Modal Learning

  12. Implicit Neural Representations for Multimodal Longitudinal Image Imputation and Interpolation

    Aug 3, 2026Sina Wendrich, Lukas Förner, Zoe Reinke +5Magnetic Resonance ImagingInterpolation

  13. Two Sides of the Same Coin: Co-Evolving Search for Cross-Task Attacks on Vision-Language Models

    Aug 3, 2026Xuanhui Lin, Junhao Dong, Mingrong Gong +3Vision-LanguageAdversarial Transferability

  14. Linear Multi-Timescale Retention as a Memory-Efficient Vision-Language Bridge

    Aug 3, 2026Ashfak Yeafi, Mehedi Hasan, Md Khairul IslamLarge Vision Language ModelsCross-Modal Learning

  15. Towards Effective Federated Multimodal Graph Learning via Navigating Multifaceted Heterogeneity

    Aug 1, 2026Yinlin Zhu, Di Wu, Yi Zhang +5Federated Graph LearningCross-Modal Learning

  16. Through the LENS: Local Geometric Decomposition of Vision-Language Model Representations

    Aug 1, 2026Shalom Kachko, Raz Lapid, Margarita Vald +2Cross-Modal LearningInput Modality

  17. DoubleHelix: Structured Cross-Modal Fusion for Audio-Visual Speech Recognition with LLMs

    Jul 31, 2026Ziwei Cheng, Zhenhua Tan, Zhuomin ZhuCross-Modal FusionCross-Modal Learning

  18. HyperClaim: Fine-Grained Cross-Modal Hypergraph Reasoning for Video Misinformation Detection

    Jul 30, 2026Xiangbo Wang, Jiasheng Zhang, Xingtong Yu +2Misinformation DetectionAuthenticity

  19. Face and Voice Cross-modal Association with Learning Convex Feature Embedding

    Jul 30, 2026Taewan Kim, Jiwoo KangCross-Modal LearningAssociations

  20. Ripple: Real-Time Streaming Audio-Video Generation With Cross-Modal Recurrent Memory

    Jul 29, 2026Yanbo Ding, Zhizhi Guo, Quanyue Song +4Joint Audio-Video GenerationAudio Latent

  21. Where Detectors Fail: Closing the Tail-Domain Gap with Expert-Guided Mutual Distillation

    Jul 29, 2026Xuan Feng, Guihong Liu, Tianlong Gu +5Fake News DetectionCross-Modal Learning

  22. CHARM: A Multimodal Graph Foundation Model with Hierarchical Context Modeling for Zero-Shot Transfer

    Jul 28, 2026Ankang Yang, Jitao Zhao, Di Jin +2Graph Foundation ModelMultimodal Foundation Model

  23. Knowledge-Guided Multimodal Reasoning over Interacting Streams for Video-Level Ambivalence and Hesitancy Recognition

    Jul 28, 2026Podakanti Satyajith Chary, Barath Parthiban, Pranesh Velmurugan +2AffectiveMultimodal Reasoning

  24. Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs

    Jul 28, 2026Fanfu Wei, Thibault Ehrhart, Raphaël TroncyKnowledge GraphsKnowledge Gaps

  25. Salient Knowledge Pathways: Sparse Cross-Modal Routing for Efficient Knowledge-Intensive Multimodal Question Answering

    Jul 28, 2026Noor Islam S. Mohammad, Uluğ BayazıtMultimodal QueryCross-Modal Learning

  26. CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking

    Jul 28, 2026Xiangqun Zhang, Likai Wang, Zekun Qian +2Multi-Object TrackingCvpr

  27. Evolving Safety Landscape of Multi-modal Large Language Models: A Survey of Emerging Threats and Safeguards

    Jul 27, 2026Xi Li, Shu Zhao, Xiaohan Zou +6Large Language Model SafetyMulti-Modal Large Language Models

  28. Are Prompt Optimizers Blind? Cross-Modal Visual Feedback for Automatic Prompt Optimization

    Jul 27, 2026Haoyue Liu, Xiaoyu Ma, Ye Chen +2Automatic Prompt OptimizationCross-Modal Learning

  29. OmniVAE: An Audio-Video VAE with Cross-Modal Alignment for Joint Generation

    Jul 26, 2026Jun Zhan, Chen Yang, Yitian Gong +23Joint Audio-Video GenerationAudio Latent

  30. XMatchAD: A Cross-Modal Matching Perspective on Reconstruction-based Anomaly Detection

    Jul 26, 2026Mingxiu Cai, Zhe Zhang, Gaochang Wu +1Reconstruction-Based Anomaly DetectionAnomaly Detection

  31. HVM-GraphRAG: Holistic-View Multimodal Graph Retrieval-Augmented Generation on Complex Document

    Jul 26, 2026Xin He, Yili Wang, Wenqi Fan +4Graph-Based Retrieval Augmented GenerationGraph-Llm Joint

  32. Omni-Prune: Query-Aware Unified Token Pruning for Efficient Omnimodal Large Language Models

    Jul 26, 2026Yiming Zhong, Chang Nie, Caifeng ShanVisual Token PruningAudio-Visual Reasoning

  33. OmniScope: Modality-Decoupled Token Compression for Omnimodal Large Language Models

    Jul 25, 2026Jinsen Su, Yongdong Luo, Yuexiao Ma +3Token CompressionModality-Specific Encoders

  34. Towards Dual-Brain Minimal Sufficient Representation for Vision-Language Navigation

    Jul 25, 2026Yihao Wu, Chenyi Xu, Liqi Yan +6Vision-Language NavigationNavigation

  35. Controlling Embedding Spaces with Text-Conditioned Transformations

    Jul 24, 2026Joseph Fioresi, Fabian Caba Heilbron, Pankaj Nathani +2Visual EmbeddingsCross-Modal Learning

  36. Visual Saliency Steering Distillation for Multimodal Chain-of-Thought Reasoning

    Jul 24, 2026Hao Yang, Jin Wang, Xuejie ZhangCross-Modal LearningSaliency

  37. Multimodal Wearable-Based Olfactory-Induced Emotion Recognition in Arousal-Valence Dimensions

    Jul 24, 2026Chen-Yang Xu, Lan Zhang, Fei-Yi Fan +2Olfactory PerceptionValence-Arousal Estimation

  38. UnDA: Unpaired Domain Alignment for Cross-Modal Knowledge Transfer in Medical Imaging

    Jul 23, 2026Rafsan Jany, Shadab Tanjeed Ahmad, Ahsan Bulbul +3Cross-Modal DistillationCross-Modal Learning

  39. GeoThreat: Transferable Targeted Adversarial Attacks on Large Vision-Language Models for Remote Sensing Image Interpretation

    Jul 23, 2026Yimin Fu, Yuefeng Bai, Baicheng Pan +2Remote SensingLarge Vision Language Models

  40. Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval

    Jul 23, 2026Kyeongmo Chae, Jihoon Lee, Sangtae AhnText-To-Video ModelsCross-Modal Alignment

  41. Silent Failures in Multimodal Agentic Search:A Diagnostic Taxonomy and Cross-Judge Evaluation

    Jul 22, 2026Zhengxian Wu, Junjie Gao, Kai YangMultimodal Search AgentsCross-Modal Learning

  42. Style over Substance: A Shortcut Audit of Emotion-Description Preference Evaluation

    Jul 20, 2026Jiabing Yang, Yixiang Chen, Yuan Xu +6Emotion RecognitionMultimodal Evaluation

  43. Pailitao-MMSearch: Building Native E-Commerce Multimodal Search Foundation

    Jul 20, 2026Xiaohan Ye, Xu Chen, Zihan Gong +15Multimodal Search AgentsE-Commerce

  44. One Modality to Forget Them All: Enhancing Cross-Modal Unlearning in Vision-Language Models

    Jul 17, 2026Sudharshan Balaji, Yili Ren, Guangjing Wang +2Large Language Model UnlearningCross-Modal Learning

  45. HCIG: A Hierarchical Cross-Modal Incongruity Graph Network for Multimodal Sarcasm and Cyberbullying Detection

    Jul 17, 2026Bhavana Verma, Priyanka Meel, Dinesh Kumar VishwakarmaHumorCross-Modal Learning

  46. Knowledge-Guided Cross-Modal Fusion for Adult-to-Pediatric ECG Transfer via Label-Conditioned Contrastive Alignment

    Jul 17, 2026Xinran Liu, Yuwen Li, Hongxiang Gao +4Pediatric-Adult Electrocardiogram AlignmentContrastive Alignment

  47. AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities

    Jul 17, 2026Yuqing Wen, Yukai Huang, Qianqian Xie +6Video EditingAudio-Visual Consistency

  48. Toward Federated Multimodal Graph Foundation Models: A Topology-Aware Multimodal Alignment Framework

    Jul 17, 2026Xunkai Li, Guohao Fu, Yuming Ai +4Federated Graph LearningGraph Foundation Model

  49. MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion

    Jul 17, 2026Xu Hou, Meiyu Liang, Wei Huang +6Knowledge Graph CompletionCross-Modal Learning

  50. AlphaWiSE: Adaptive Weight Interpolation for Continual Multimodal Representation Learning

    Jul 16, 2026Sarthak Jain, Qiran Hu, Zhen Zhu +1Cross-Modal LearningMulti-Modal Representation Learning

  51. On Success and Simplicity: A Second Look at Transferable Vision-Language Attack Pipeline

    Jul 16, 2026Yuchen Ren, Zhengyu Zhao, Chenhao Lin +2Cross-Modal LearningTransferable Attack

  52. Multimodality as Supervision: Self-Supervised Specialization to the Test Environment via Multimodality

    Jul 16, 2026Kunal Pratap Singh, Ali Garjani, Rishubh Singh +6Cross-Modal LearningSelf-Supervised

  53. CF-Net: Conflict Fusion with Speaker Normalisation and Certainty Weighting for Ambivalence/Hesitancy Recognition

    Jul 15, 2026Tung Hung Bui, Hong Hai Nguyen, Van Thong HuynhMultimodal Deep LearningFine-Grained Video Understanding

  54. Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes

    Jul 14, 2026Minh-Quan Le, Armand Comas, Alexandros Lattas +7Multimodal GenerationLarge-Scale Image Generation

  55. EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrieval

    Jul 14, 2026Jiashi Lin, Changhong Jiang, Xiangru Lin +12Graph-Based Retrieval Augmented GenerationKnowledge Graph Embeddings

  56. Segregate, Refine, Integrate: Decomposing Multimodal Fusion for Sentiment Analysis

    Jul 14, 2026Alexios Filippakopoulos, Elias Kallioras, Nikolaos Xiros +2Multimodal FusionCross-Modal Learning

  57. Text-Aided Multi-Modal Panoptic Symbol Spotting for CAD Floor Plan Drawings

    Jul 14, 2026Yan Gong, Bohao Li, Bowen Du +1Text-To-CadComputer-Aided Design

  58. MQAdapter: Multi-Modal Quantum Adapter for Coarse-to-Fine VLM Fine-tuning

    Jul 14, 2026Yumiao Zhao, Bo Jiang, Min Lu +2Large Vision Language ModelsFine-Grained Perception

  59. UMSS: Towards Unsupervised Multi-modal Semantic Segmentation

    Jul 14, 2026Haitian Zhang, Thai Duy Nguyen, Xiangyuan Wang +2Multimodal FusionDense Semantic Segmentation

  60. Affordance-Based Manipulation Planning with Text Goals and Sim-to-Real Generalisation via Real-to-Sim Image Conversion

    Jul 13, 2026Solvi Arnold, Rin Karashima, Tadashi Adachi +2AffordancesRobot Systems