Overview

Cross-modal attention studies how information from one modality—such as text, images, audio, video, or sensor data—can guide the representation of another. It matters for tasks including visual question answering, retrieval, medical diagnosis, speech separation, and autonomous systems, where useful evidence may be distributed across inputs. Common approaches include bidirectional or asymmetric cross-attention, query- and register-based fusion, and sparse, local, or temporally guided attention, sometimes combined with confidence gating or feature disentanglement. Performance has improved across many benchmarks, but reliable fusion remains difficult when modalities are misaligned, unevenly informative, or prone to dominating one another; attention patterns also do not always guarantee faithful grounding or reasoning.

Latest papers

CardsList

93 papers4 papers in the last four weeks, down 60% on the four weeks before. 0.0% of all new papers.

  1. GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Grounding

    Nov 2, 2025Shijie Zhou, Viet Dac Lai, Hao Tan +4Multimodal GroundingGUI Grounding

  2. Taming Text-to-Sounding Video Generation via Advanced Modality Condition and Interaction

    Oct 3, 2025Kaisi Guan, Xihua Wang, Zhengfeng Lai +5Audio-Video GenerationVideo Diffusion Models

  3. NEARL: Interacted Query Adaptation with Orthogonal Regularization for Medical Vision-Language Understanding

    Aug 6, 2025Zelin Peng, Yichen Zhao, Yu Huang +5Cross-Modal LearningVLM Adaptation