Cross-Modal Attention

Ask about this topic

Momentum

9 papers in the last four weeks, up 125% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 81

All topics
CardsList

  1. Beyond Attention Imbalance: Mitigating Hallucinations via Spectral Surgery

    Sep 29, 2026Siqi Lu, Suo Wei, Yongbin Zheng +3Recent Vision-Language ModelsVisual Hallucinations

    College of Intelligence Science and Technology, National University of Defense Technology, China · School of Computer Science, Northwestern Polytechnical University, China · Ningbo Institute, Northwestern Polytechnical University, China +1

  2. Mind What Matters for Reasoning: Aligning Cross-Modal Attention via Selective Probability Mass Concentration

    Sep 24, 2026Jiaqi Deng, Zonghan Wu, Zhan Heng +3Multimodal ReasoningMultimodal Large Language Models

    University of Technology Sydney · East China Normal University · The University of New South Wales +2

  3. Integrating Local Detail and Global Context: A Dual-Input Multi-Task Learning Framework for Bone Tumor Diagnosis

    Sep 23, 2026S. M. Nasif Uddin, Rusab Sarmun, Muhammad E. H. Chowdhury +3LesionTumor

    Department of Electrical and Electronic Engineering, Ahsanullah University of Science and Technology, Bangladesh · Department of Electrical and Electronic Engineering, University of Dhaka, Bangladesh · Department of Electrical Engineering, Qatar University, Doha 2713, Doha, Qatar +1

  4. All modalities are equal, but video is more equal: Closing the Cross-Attention Gap in Joint Video Generation

    Sep 23, 2026Ohad Rahamim, Dvir Samuel, Idan Schwartz +1Cross-Modal AttentionAudio-Visual Consistency

    Bar-Ilan University · NVIDIA

  5. S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detection

    Sep 23, 2026Qiangqiang Zhou, Yang Luo, Yong Chen +1Rgb-Thermal Object DetectionCross-Modal Alignment

    Jiangxi Normal University

  6. Detecting Phone-Induced Pedestrian Distraction via a Multimodal Fusion Transformer

    Sep 20, 2026Yuanzhe Li, Hounian Liu, Xiaotong Chang +1PedestrianDetection Transformer

    Chair of Automotive Engineering Technische Universität Berlin Berlin, Germany

  7. Cross-Modal Attention Acts as a Frequency Filter: Why Verbose Prompts Improve Robustness in Vision-Language Models

    Sep 17, 2026Farooq Ahmad Wani, Maria Sofia Bucarelli, Mujtaba Hussain Mirza +5Cross-Modal AttentionPrompt Engineering

    Sapienza University of Rome · Université Côte d’Azur · CNRS +3

  8. CCMAN: Cognitive Instability-Aware Cross-Modal Attention Network for Interpretable Temporal Biomarkers of Verbal Fluency Speech

    Sep 13, 2026Madhurananda Pahar, Caitlin Illingworth, Dorota Braun +2Cross-Modal AttentionBiomarker

    School of Computer Science, University of Sheffield, Sheffield, S1 4DP, UK · Sheffield Institute for Translational Neuroscience (SITraN), University of Sheffield, Sheffield, S10 2HQ, UK

  9. Exploring Diffusion Transformers for Cross-Modal Augmentation in Multimodal Brain State Decoding

    Sep 12, 2026Ziwei Wang, Xingyi He, Hongbin Wang +3Cross-Modal AttentionMultimodal Learning

    School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, China

  10. The Attention Triangle in Audio-Video Models

    Sep 3, 2026Sagi Polaczek, Noa Kraicer, Gal Metzer +4Cross-Modal AttentionAudio-Video Generation

    1Tel Aviv University · 2Simon Fraser University

  11. Detecting Object Hallucinations in Large Vision-Language Models via Cross-Modal Attention Drifts and Mask-Based Verification

    Sep 2, 2026Xuanbing Wen, Boxu Chen, Le Yang +4Citation Hallucination DetectionObject Hallucination

    Xi’an Jiaotong University, Xi’an 710049, China · Zhongguancun Laboratory, Beijing 100194, China

  12. Forbid Your Attention: Fooling Multimodal Large Language Models by Selectively Removing Intrinsic Focus in Spectral Domain

    Sep 1, 2026Daizong Liu, Junhao Dong, Zhiyuan Ma +6Multimodal Large Language ModelsCross-Modal Attention

    Institute for Math & AI, Wuhan University, Wuhan, 430072, China · College of Computing and Data Science, Nanyang Technological University, Singapore · School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China +3

  13. DreamX-Creator: Democratizing Native Audio-Video Generation at 2K Resolution

    Aug 31, 2026Jiashu Zhu, Yanhao Zheng, Ruitian Tian +7Audio-Video GenerationMultimodal Generation

    DreamX Team, Alibaba Group

  14. C3^3PO: Evaluating Cross-Modal Composition and Counterfactual Performance in Omnimodal Models

    Aug 5, 2026Swapnanil Mukherjee, Agyeya Negi, Tanuja Ganu +1Cross-Modal ConflictsCross-Modal

    Microsoft Research India · IIIT Hyderabad, India

  15. Generic Vision and Cross-Attention for Reaction Yield Prediction

    Aug 1, 2026Qiwei Han, Chi ZhouMolecular Property PredictionReaction

    Department of Chemistry, Duke University, Durham, NC 27708, USA · Department of Computer Science, Georgia Institute of Technology, Atlanta, GA 30332, USA

  16. VCP-DCN: Beyond Visual Concealed Property via Depth Collaborative Network for Camouflaged Object Detection

    Jul 30, 2026Songsong Duan, Xi Yang, Nannan WangCamouflaged Object DetectionCross-Modal Attention

    the State Key Laboratory of Integrated Services Networks, School of Telecommunications Engineering, Xidian University, Xi’an, China

  17. SepPrune:A Separator-based Pruning Framework for Efficient Multimodal Large Language Models

    Jul 28, 2026Yuchen Wang, Qihui Zhu, Yang Liu +2Visual Token PruningLong Visual-Token Sequences

    MoE Key Lab of BIPC, NEL-BITA, University of Science and Technology of China, Hefei, China · ChangXin Memory Technologies, Hefei, China · APKL of BIIP, IAI, Hefei Comprehensive National Science Center, Hefei, China

  18. I2VShield: An Efficient Proactive Defense Framework against DiT-based Image-to-Video Models

    Jul 28, 2026Yimao Guo, Zuomin Qu, Wei LuDiffusion TransformersBlack-Box Adversarial Attacks

    School of Computer Science and Engineering, Sun Yat-sen University Ministry of Education Key Laboratory of Information Technology Guangdong Province Key Laboratory of Information Security Technology Guangzhou 510006, China · Guangdong Province Key Laboratory of Information Security Technology Guangzhou 510006, China · State Key Laboratory of HVDC, China Southern Power Grid Electric Power Research Institute

  19. Disentangling Semantic Attention from Structural Bias in the Attention Manifold

    Jul 27, 2026Pengkun Jiao, Bin Zhu, Jingjing Chen +1Cross-Modal AttentionMultimodal Large Language Models

    Fudan University · Singapore Management University

  20. MOJITO: Modal Joint Learning for Unified End-to-End Autonomous Driving

    Jul 26, 2026Zhijing Cheng, Xuancheng Zhang, Donglin Di +4Causality-Aware End-To-End Autonomous DrivingAutonomous Driving

    University of Science and Technology of China, China · Li Auto, China · University of New South Wales, Australia

  21. Multimodal Domain Generalization for Depression Detection: An Attention-Based BiLSTM Network with Domain-Adversarial Training

    Jul 24, 2026Ali Tabaraei, Federico Simonetta, Stavros NtalampirasDepressionMultimodal Deep Learning

    Department of Computer Science, University of Milan, Milan, Italy · Computer Science Department, Gran Sasso Science Institute (GSSI), L’Aquila, Italy

  22. Learning to Detect Cross-Modal Negation: An Analysis of Latent Representations and an Attention-Based Solution

    Jul 20, 2026Ali AbuSaleh, Leon Hammerla, Alexander MehlerCross-Modal AttentionNegation

    Text Technology Lab Department of Computer Science Goethe University Frankfurt Frankfurt, Germany

  23. ChemFusion: A Multimodal Cross-Attention Network for Reaction Yield Prediction

    Jul 19, 2026Qiwei Han, Chi ZhouReactionHeterogeneous Catalysis

    Department of Chemistry, Duke University, Durham, NC 27708, USA · Department of Computer Science, Georgia Institute of Technology, Atlanta, GA 30332, USA

  24. On the Geometry of Learned Representations in Event-Based Multi-Modal Egomotion Estimation

    Jul 17, 2026Stefano Silvestrini, Michele CeresoliEgocentric Motion GenerationMulti-Sensor Fusion

    Politecnico di Milano, Via Giuseppe La Masa, 34, 20156, Milan, Italy

  25. Adaptive Cross-Modal Fusion with Sparse Attention for Pedestrian Crossing Intention Prediction

    Jul 14, 2026Md Mahfuzur Rahman, Pengzhan Zhou, A F M Abdun Noor +5Pedestrian Trajectory PredictionCross-Modal Fusion

    College of Computer Science, Chongqing University, Chongqing, China · Department of Software Engineering, Daffodil International University, Bangladesh · Faculty of Information Science & Technology, Multimedia University, Malaysia

  26. Propose and Attend: Training-free MLLM Grounding Confidence via Multi-Token Localized Attention

    Jul 7, 2026Daniel Shalam, Emanuel Ben Baruch, Avi Ben Cohen +1Vision-Language Model GroundingMultimodal Large Language Models

    Amazon

  27. Cross-Modal Fusion of OCT and OCT angiography enface for Improved Diagnostics of Diabetic Retinopathy

    Jul 4, 2026Rashadul Hasan Badhon, Atalie Carina Thompson, Jennifer I. Lim +2Optical Coherence TomographyGlaucoma Detection

  28. Q-TriM: Question-Guided Tri-Modal Attention for Audio-Visual Question Answering

    Jul 4, 2026SungHun Kim, SeungJun BaekAudio-Visual ReasoningCross-Modal Attention

    Dept. of Computer Science and Engineering Korea University Seoul, South Korea

  29. ViPo-MLLM: Visual-Pose Multimodal LLM for Gloss-Free Sign Language Translation

    Jul 4, 2026Ahmed Abul Hasanaath, Bicheng Xu, Mir Rayat Imtiaz Hossain +2Gloss-Free Sign Language TranslationVideo Multimodal Large Language Models

    King Fahd University of Petroleum and Minerals, Dhahran, KSA · University of British Columbia, Vancouver, Canada

  30. Token-level Response-visual Attention Guidance for Multimodal LLMs Knowledge Distillation

    Jul 1, 2026Jaehyun Jang, Eunseop Yoon, Hee Suk Yoon +3Knowledge DistillationFew-Step Distillation

    Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea · University of Illinois Urbana-Champaign, Champaign, USA

  31. ADAPT: Attention Dynamics Alignment with Preference Tuning for Faithful MLLMs

    Jun 30, 2026Zhiyuan Yao, Zheren Fu, Zhixiao Zheng +3Multimodal Large Language ModelsLarge Language Model Hallucination

    University of Science and Technology of China, Hefei, China · State Key Laboratory of Communication Content Cognition, People’s Daily Online, China · Huawei Technologies Ltd., China

  32. Steering Vision-Language Models with Joint Sparse Autoencoders

    Jun 24, 2026Huizhen Shu, Xuying Li, Hongxu Lin +2Improving Sparse AutoencodersCross-Modal Attention

    yunshanai · HKUST(Guangzhou) · Zidongtaichu +1

  33. Cross-Attention Multimodal Learning for Predicting Response to Neoadjuvant Imatinib in Gastrointestinal Stromal Tumors: A Multicenter Retrospective Study

    Jun 24, 2026Fariba Tohidinezhad, Douwe J. Spaanderman, Natalia Oviedo Acosta +14Multicenter EvaluationColorectal Cancer

    Department of Radiology and Nuclear Medicine, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Rotterdam, the Netherlands. · Department of Pathology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Rotterdam, the Netherlands. · Department of Surgical Oncology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Rotterdam, the Netherlands. +6

  34. iFLYTEK-Embodied-Omni Technical Report

    Jun 24, 2026Yuan Zhang, Jingfei Ni, Guanchen Lu +12Action GenerationCross-Modal Attention

    1iFLYTEK · University of Science and Technology of China · 2LindenBot

  35. Spectral Evolution-Guided Token Pruning in Multimodal Large Language Models

    Jun 23, 2026Bin Chen, Yuxiang Cai, Yadan Luo +3Visual Token PruningCross-Modal Attention

    School of Software Technology, Zhejiang University, Ningbo, China · Zhejiang Key Laboratory of Digital-Intelligence Service Technology, China · The University of Queensland, St Lucia, QLD, Australia +2

  36. Attention-Spectrum Regularization for Replay-Free Continual Multimodal LLMs

    Jun 22, 2026Chuangxin Zhao, Canran Xiao, Siyuan Ma +5Multimodal Large Language ModelsCross-Modal Attention

    The Hong Kong University of Science and Technology (Guangzhou) · Sun Yat-sen University · Nanyang Technological University +2

  37. Three-Step Hierarchical Transformer for Multi-Pedestrian Trajectory Prediction

    Jun 22, 2026Raphaël Delécluse, Hazem Wannous, Laurent Grisoni +1Pedestrian Trajectory PredictionSpatio-Temporal Transformers

    IMT Nord Europe, University of Lille, CNRS UMR 9189 - CRIStAL, F-59000 Lille, France · University of Lille, CNRS UMR 9189 - CRIStAL, F-59000 Lille, France · Explain, F-59000 Lille, France

  38. Multi-Modal Attention for Automated Disaster Damage Assessment Using Remote Sensing Imagery and Deep Learning

    Jun 12, 2026Tewodros Syum Gebre, Jagrati Talreja, Leila Hashemi-BeniPost-Disaster Damage AssessmentRemote Sensing

    Built Environment Department, College of Science and Technology, North Carolina A&T State University, Greensboro, NC, USA · United Nations University Institute for Water, Environment and Health, Richmond Hill, ON, Canada

  39. Explainable Task-Oriented Token Communication for AI-Native 6G Networks

    Jun 12, 2026Feibo Jiang, Lei Mao, Li Dong +3Semantic CommunicationsCross-Modal Attention

  40. Last But Not Least: Boundary Attention CalibratiON for Multimodal KV Cache Compression

    Jun 10, 2026Tianhao Chen, Yuheng Wu, Kelu Yao +3Key-Value Cache CompressionMultimodal Large Language Models

    KAIST · Zhejiang Laboratory · The Chinese University of Hong Kong +1

  41. Multimodal Brain Tumour Classification Using Feature Fusion

    Jun 9, 2026Wajih ul Islam, Muhammad Yaqoob, Javed Ali Khan +1Brain Tumor ClassificationRadiomics

    School of Physics, Engineering and Computer Science, University of Hertfordshire, UK

  42. Multi-View Speech Representation Learning for Parkinson's Disease Detection Using Context-guided Cross-modal Attention

    Jun 8, 2026George Theodosiou, Loukas Ilias, Dimitris AskounisDiscrete Speech RepresentationsDysarthric Speech

    Decision Support Systems Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, 15780 Athens, Greece

  43. Look Less, Reason More: Block-wise Attention Skipping for Efficient Multimodal LLMs

    Jun 7, 2026Jie Ma, Zhike Qiu, Jiayi Ji +2Cross-Modal AttentionMultimodal Large Language Models

    Xiamen University

  44. GRAMformer: Any-Order Modality Interactions via Volumetric Multimodal Cross-Attention

    Jun 4, 2026Giordano Cicchetti, Eleonora Grassucci, Danilo ComminielloCross-Modal AttentionModalities

    Dept. of Information Engineering, Electronics, and Telecommunications, Sapienza University of Rome, Italy

  45. Query-based Cross-Modal Projector Bolstering Mamba Multimodal LLM

    Jun 3, 2026SooHwan Eom, Jay Shim, Gwanhyeong Koo +4Multimodal Large Language ModelsCross-Modal Attention

    Korea Advanced Institute of Science and Technology / Korea, Republic of · University of Illinois in Urbana-Champaign / United States of America · Korea University / Korea, Republic of

  46. Attend to Anything: Foundation Model for Unified Human Attention Modeling

    Jun 2, 2026Wenzhuo Zhao, Ronghao Xian, Keren Fu +1Cross-Modal AttentionSaliency

    College of Computer Science, Sichuan University, Chengdu, 610065, China · National Key Laboratory of Fundamental Science on Synthetic Vision, Sichuan University, Chengdu, 610065, China

  47. Spectral-Progressive Thought Flow for Lightweight Multimodal Reasoning

    Jun 1, 2026Yixian Shen, Zhiheng Yang, Qi Bi +6Multimodal ReasoningVisual Reasoning

    Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands · University of Thessaly, Volos, Greece · Department of Computer Science, University College London +3

  48. DeepIPCv3: Event-Aware Multi-Modal Sensor Fusion for Sudden Pedestrian Crossing Avoidance

    May 31, 2026Oskar Natan, Andi Dharmawan, Aufaclav Zatu Kusuma Frisky +2Multi-Sensor FusionAutonomous Navigation

    Department of Computer Science and Electronics, Universitas Gadjah Mada, Yogyakarta 55281, Indonesia

  49. Escape the Language Prior: Mitigating Late-Stage Modality Collapse in Audio Reasoning via Modality-Aware Policy Optimization

    May 26, 2026Cihan Xiao, Yiwen Shao, Chenxing Li +5Audio UnderstandingCross-Modal Attention

    Johns Hopkins University · Tencent Hunyuan

  50. Unveiling the Fragility of Vision-Language Models: Multi-Modal Adversarial Synergy via Texture-Constrained Perturbations and Cross-Modal Optimization

    May 26, 2026Xiang Fang, Wanlong Fang, Changshuo WangRecent Vision-Language ModelsCross-Modal Attention

    School of Software Engineering, Huazhong University of Science and Technology · Nanyang Technological University, Singapore · University College London

  51. Not All Modalities Are Equal: Instruction-Aware Gating for Multimodal Videos

    May 25, 2026Bonan Ding, Umair Nawaz, Ufaq Khan +5Fine-Grained Video UnderstandingCross-Modal Attention

    Mohamed bin Zayed University of Artificial Intelligence · Tianjin University · Chongqing University +1

  52. Stage-adaptive Token Selection for Efficient Omni-modal LLMs

    May 19, 2026Zijie Xin, Jie Yang, Ruixiang Zhao +4Omni-ModalCross-Modal Attention

    Renmin University of China · WeChat Vision, Tencent Inc.

  53. RAVE: Re-Allocating Visual Attention in Large Multimodal Models

    May 18, 2026Xi Leng, Xinhong Ma, Ziqiang Dong +4Cross-Modal AttentionLarge Multimodal Models

    Qwen Business Unit of Alibaba · The Chinese University of Hong Kong, Shenzhen · Beijing Institute of Technology

  54. See What I Mean: Aligning Vision and Language Representations for Video Fine-grained Object Understanding

    May 18, 2026Boyuan Sun, Bowen Yin, Yuanming Li +2Fine-Grained PerceptionVisual In-Context Learning

    VCIP, CS, Nankai University · Tongyi Lab, Alibaba Group · NKIARI, Shenzhen Futian

  55. CAM-VFD: Cross-Attention Multimodal Video Forgery Detection

    May 16, 2026Hoda Osama Elkhodary, Sherin Mostafa Youssef, Marwa Elshenawy +1Deepfake DetectionAi-Generated Video Detection

    Computer Engineering Department, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria, Egypt

  56. A Cross-Modal Prompt Injection Attack against Large Vision-Language Models with Image-Only Perturbation

    May 15, 2026Hao Yang, Zhuo Ma, Yang Liu +3Recent Vision-Language ModelsCross-Modal Attention

    Xidian University Xi’an, Shaanxi, China

  57. MaTe: Images Are All You Need for Material Transfer via Diffusion Transformer

    May 15, 2026Nisha Huang, Henglin Liu, Yizhou Lin +5Diffusion TransformersDiffusion Models

    Tsinghua University · PengCheng Laboratory · Lenovo Research +1

  58. MHSA: A Lightweight Framework for Mitigating Hallucinations via Steered Attention in LVLMs

    May 14, 2026Wei Ding, Yilin Li, Yudong Zhang +4Hallucination MitigationGenerative Hallucination

    Tsinghua University Beijing, China · Tsinghua University, Tencent Beijing, China · Tencent Beijing, China +2

  59. Learning to See What You Need: Gaze Attention for Multimodal Large Language Models

    May 13, 2026Junha Song, Byeongho Heo, Geonmo Gu +3Cross-Modal AttentionMultimodal Large Language Models

    1KAIST · 2NAVER AI Lab

  60. Towards Visually Grounded Multimodal Summarization via Cross-Modal Transformer and Gated Attention

    May 12, 2026Abid Ali, Diego Molla-Aliod, Usman NaseemCross-Modal AttentionSummarization

    School of Computing, Macquarie University, Sydney, Australia