Cross-Modal Alignment

Ask about this topic

Momentum

5 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 65

All topics
CardsList

  1. S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detection

    Sep 23, 2026Qiangqiang Zhou, Yang Luo, Yong Chen +1Rgb-Thermal Object DetectionCross-Modal Alignment

    Jiangxi Normal University

  2. HyperCLIP++: Fine-tuning CLIP forOpen-vocabulary Semantic Segmentation in Hyperbolic Space

    Sep 21, 2026Zelin Peng, Zhengqin Xu, Changsong Wen +4Contrastive Language-Image Pre-Training ModelOpen-Vocabulary Segmentation

    MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science, Shanghai Jiao Tong University, Shanghai 200240, China · State Key Laboratory of Infrared Physics, Shanghai Institute of Technical Physics, Chinese Academy of Science, Shanghai, 200083, China · Meituan, Shanghai, 200051, China

  3. Efficient Quantization-Aware Distillation with Cross-Modal Alignment for Edge Vision-Language Models

    Sep 15, 2026Jinwoo Jeon, GyuYeop Do, Yubin Lim +4Cross-Modal DistillationRecent Vision-Language Models

    Korea University · Seoul National University

  4. Bridging the Perceptual Gap: Residual-Enhanced Downscaling and Manifold-Aware Perception Alignment Adaptation for NR-IQA

    Sep 15, 2026Yu Li, Zhengran Shen, Yachun Mi +2Image Quality AssessmentCross-Modal Alignment

    Harbin Institute of Technology, Harbin, China.

  5. Supervised Cross-Modal Feature Alignment for Zero-Wearable Freezing of Gait Detection in Parkinsonism

    Sep 8, 2026Aryan Singh, Chandan BiswasGait RecognitionInertial Measurement Units

    NeuroAI Fusion Labs Kolkata, India

  6. When Modality Gap Reduction Fails: Prediction-Level Hubness in CLIP

    Sep 1, 2026Shota Sato, Hajime Kiyama, Tosho Hirasawa +1Modality GapContrastive Language-Image Pre-Training Model

    Hitotsubashi University

  7. Towards Expressive and Faithful Audio-to-Image Generation: A Unified Multimodal Dataset and Synthesis Framework

    Aug 10, 2026Dongxu Ge, Shansong Liu, Cheng Gong +3Audio-Video GenerationMultimodal Generation

    University of Science and Technology of China Hefei, China · Institute of Artificial Intelligence, China Telecom (TeleAI) Beijing, China · Northwest Polytechnical University Xi’an, China

  8. Vision-Language Grounding as Bidirectional Concept Correspondence

    Aug 8, 2026Jieyu Zhang, Ziqi Gao, Luke Zettlemoyer +1Vision-Language Model GroundingContextual Grounding

    University of Washington · Allen Institute for AI · FAIR at Meta

  9. DARAD: Dual Adapters and Ranking-Aware Distillation for Continual Remote Sensing Image-Text Retrieval

    Aug 6, 2026Xi Chen, Xu Chen, Xiangyang Jia +3Remote SensingCross-Modal Distillation

    School of Computer Science, Wuhan University, Wuhan 430072, China · Beijing Institute for General Artificial Intelligence (BIGAI)

  10. DistMedVL: Distributional Vision-Language Alignment for Uncertainty-Aware Medical Image Segmentation

    Aug 6, 2026Jiaxuan Li, Qing Xu, Xiangjian He +4Vision-Language AlignmentSemi-Supervised Medical Image Segmentation

    School of Computer Science, University of Nottingham Ningbo China, Ningbo, Zhejiang, China · School of Computer Science, University of Nottingham, UK

  11. Learning Molecular Representations from Cellular Phenotypes with Structure Preservation

    Aug 3, 2026Xuan Lin, Jingyu Sheng, Tengfei Ma +2Molecular Representation LearningChemical Structures

    School of Computer Science, Xiangtan University, Xiangtan, Hunan, China · College of Computer Science and Electronic Engineering, Hunan University, Changsha, Hunan, China · School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, China +1

  12. SCALPEL: Semantic Cross-modal Alignment via LLM-Powered Encoder Learning for Medical Vision-Language Representation

    Jul 29, 2026Yunzhan Fu, Enyu Bao, Xiangyu Shen +4Medical Vision-Language ModelsVision-Language Alignment

    School of Computer Science, Hangzhou Dianzi University, China

  13. OmniDelta: Skill-Driven Budget Allocation for Token Compression in OmniLLMs

    Jul 28, 2026Haoyang Huang, Wenjie Huang, Tianqi Xu +14Token CompressionAudio Tokenizers

    Zhejiang University · Qwen Application, Alibaba · Carnegie Mellon University +2

  14. OmniVAE: An Audio-Video VAE with Cross-Modal Alignment for Joint Generation

    Jul 26, 2026Jun Zhan, Chen Yang, Yitian Gong +23Audio-Video GenerationCross-Modal Alignment

    1Fudan University · 2Shanghai Innovation Institute · 3MOSI Intelligence +1

  15. DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation

    Jul 23, 2026Sung-Hoon Yoon, Hoyong Kwon, Changgyoon Oh +1Open-Vocabulary SegmentationImage-Text Alignment

    Multimodal Intelligence and Perception Lab., DGIST, Republic of Korea · Visual Intelligence Lab., KAIST, Republic of Korea

  16. Achieving Text-based Person Retrieval with Any Granularity

    Jul 23, 2026Jialong Zuo, Hanyu Zhou, Dongyue Wu +5Cross-Modal Alignment

    National Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China · School of Software Engineering, Huazhong University of Science and Technology, Wuhan 430074, China

  17. Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval

    Jul 23, 2026Kyeongmo Chae, Jihoon Lee, Sangtae AhnFine-Grained Video UnderstandingCross-Modal Alignment

    School of Electronic and Electrical Engineering, Kyungpook National University, Daegu, South Korea

  18. RMS@CC-MMD 2026: Multimodal Misogyny Detection via Geometric Interaction and Multi-View Consensus

    Jul 20, 2026Md. Ajwad HossainMemesMultimodal Sentiment Analysis

    Department of Electronics and Telecommunication Engineering Chittagong University of Engineering & Technology (CUET) Chattogram, Bangladesh

  19. Towards Predictive, Aligned, and Scalable Robot Learning

    Jul 13, 2026Peijun Tang, Shangjin Xie, Baifu Huang +6Latent World ModelsScalable Robot Learning

    Astribot Team

  20. VTaMo: Video-Text Alignment Model for Sign Language Translation

    Jul 10, 2026Junyi Hu, Zhewen He, Haomian Huang +2Gloss-Free Sign Language TranslationSign Language Translation

    New York University Abu Dhabi, UAE · ChatSign Technology

  21. Optimal Transport-based Semantic Alignment for LLM-based Audio-Visual Speech Recognition

    Jul 10, 2026Xugang Lu, Peng Shen, Yu Tsao +1Cross-Modal AlignmentLatent Representation Alignment

    National Institute of Information and Communications Technology, Kyoto, Japan · Research Center for Information Technology Innovation, Academia Sinica, Taiwan

  22. Precise Video-to-Audio Generation with Cross-Modal Alignment in Latent Space

    Jul 7, 2026Thanh V. T. Tran, Ngoc-Son Nguyen, Luong Tran +4Audio-Video GenerationCross-Modal Alignment

    FPT Software AI Center, Vietnam · NVIDIA Corporation, USA

  23. Video-Text Temporal Localization via Multi-Scale Convolution and Dynamic Routing

    Jul 6, 2026Gengtian Shi, Jinze Yu, Chenhao Wu +5Temporal Action LocalizationCross-Modal Alignment

    Graduate School of Fundamental Science and Engineering, Waseda University, Tokyo, Japan · Generative AI Innovation Center, Amazon Web Services, Japan · Amazon, Germany

  24. Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning

    Jul 2, 2026Chen Zhao, Jiajun Ma, Qilong Huang +6Audio-Visual ConsistencyCross-Modal Alignment

    Meituan, China · Nanjing University, State Key Laboratory for Novel Software Technology, China

  25. CALM: Interpretable Cross-Modal Alignment for Biomarker Discovery from Unpaired Data

    Jul 2, 2026Jueqi Wang, Zachary Jacokes, John Darrell Van Horn +3Multimodal NeuroimagingBiomarker

    Department of Electrical and Computer Engineering, Boston University · School of Data Science, University of Virginia · Department of Psychology, University of Virginia +2

  26. Resolving superposition in AI for interpretability and cross-modal alignment in patient-neuronal images

    Jun 30, 2026Jisung Park, Seohyeon Kang, Daeun Yoo +8Multimodal NeuroimagingSpatial Transcriptomics

    1KAIST · 2Konyang University · 4UCL Queen Square Institute of Neurology & The Francis Crick Institute +1

  27. Semantic-Driven Scale and Spatial Selection for Efficient Cross-Modal Alignment in Referring Remote Sensing Image Segmentation

    Jun 29, 2026Kun Li, Shengxi Gui, Francesco Nex +1Remote Sensing Image SegmentationCross-Modal Alignment

    University of Liverpool, UK · University of Michigan, USA · University of Twente, NL +1

  28. Heterogeneous Tactile Transformer

    Jun 29, 2026Jianxin Bi, Qiang Wang, Jayaram Reddy +4TactileContact-Rich Dexterous Manipulation

    National University of Singapore · Carnegie Mellon University · 3Smart Systems Institute, NUS

  29. Text as Illumination: Spatial Contrastive Retinex Learning for Language-guided Medical Image Segmentation

    Jun 26, 2026Jian Shi, Cheng Zhen, Pingping Zhang +6Semi-Supervised Medical Image SegmentationRetinex Theory

    School of Software Technology & DUT-RU International School of Information Science and Engineering, Dalian University of Technology, Dalian, China · School of Future Technology, Dalian University of Technology, Dalian, China · Central Hospital of Dalian University of Technology, Dalian, China +2

  30. Progressive Pixel-Neighborhood Deformable Cross-Attention for Multispectral Object Detection

    Jun 23, 2026Tian Qiu, Jifeng Shen, Xin ZuoCross-Modal AlignmentLong-Range Coherence

    School of Electrical and Information Engineering, Jiangsu University, Zhenjiang, 212013, China · School of Computer Science and Engineering, Jiangsu University of Science and Technology, Zhenjiang, 212003, China

  31. Mind the Heads: Topological Representation Alignment for Multimodal LLMs

    Jun 22, 2026Davide Caffagni, Alberto Compagnoni, Federico Melis +5Cross-Modal AlignmentMultimodal Large Language Models

    University of Modena and Reggio Emilia · University of Pisa · AMD Silo AI

  32. MV-WAM: Manifold-Aware World Action Model with Value Augmentation

    Jun 19, 2026Jintao Chen, Peidong Jia, Qingpo Wuwu +13Efficient World-Action ModelFaster-Wam

    State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University · Beijing Innovation Center of Humanoid Robotics

  33. MixProLAP: Mixture-Induced Uncertainty Modeling for Probabilistic Language-Audio Pretraining

    Jun 18, 2026Yu Nakagome, Jaesong Lee, Soo-Whan ChungSpeech-To-Text AlignmentLarge Audio Language Models

    LINE WORKS Corporation, Japan · NAVER Cloud Corporation, South Korea

  34. The Slop Paradox: How Synthetic Standardization Erodes Clinical Uncertainty and Cross-Modal Alignment in AI-Rewritten Radiology Reports

    Jun 16, 2026Samar AnsariRadiology Report GenerationSummarization

    School of Computing and Engineering Sciences University of Chester Chester, CH1 4BJ, United Kingdom

  35. Structure-aware Knowledge-guided Heterogeneous Mamba for Zygomaticomaxillary Suture Assessment

    Jun 15, 2026Xiaoqi Guo, Birui Chen, Xinquan Yang +8Occlusal ConstraintMorphometric Analysis

    College of Computer Science and Software Engineering, Shenzhen University, Shenzhen, China · School of Artificial Intelligence, Shenzhen University, Shenzhen, China · Affiliated Stomatology Hospital of Kunming Medical University, Kunming, China +1

  36. Fusion is not one-size-fits-all: Cross-Modal Representation Alignment for Time-to-Event Modeling

    Jun 13, 2026Zhemin Zhang, Weijie Chen, David Le +7Multimodal Clinical DataCross-Modal Alignment

    Arizona State University · Mayo Clinic

  37. SMGFM: Spectral Multimodal Graph Pretraining for Multimodal-Attributed Graphs

    Jun 11, 2026Zhengyu Wu, Xu Wang, Hongchao Qin +4Graph Foundation ModelText-Attributed Graph

  38. UniCA: Bi-directional Cross-Attention with Positive Similarity Loss for Robust Multi-Modal Retrieval

    Jun 3, 2026Yini Huang, Wenlong ZhangMultimodal RetrievalCross-Modal Alignment

    The Hong Kong University of Science and Technology (Guangzhou), Guangdong, China · Southern Medical University, Guangdong, China

  39. Mixed-Modality Dual Face-Hair Retrieval

    Jun 2, 2026Quoc-Anh Bui-Huynh, Mai-Tuyen Lam, Dai-Anh-Tuan Nguyen +1Multimodal RetrievalFace Recognition Model

    Vietnam National University, Ho Chi Minh City, Vietnam · University of Information Technology, VNU-HCM, Ho Chi Minh City, Vietnam

  40. Variational Adapter for Cross-modal Similarity Representation

    May 29, 2026WenZhang Wei, Zhipeng Gui, Dehua Peng +2Cross-Modal AlignmentCross-Modal

    School of Remote Sensing and Information Engineering, Wuhan University, Wuhan 430079, China · School of Data Science and Engineering, East China Normal University, Shanghai 200062, China · State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China

  41. Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding

    May 29, 2026Xiang Fang, Daizong Liu, Wanlong Fang +4Temporal GroundingCross-Modal Alignment

    Hubei Key Laboratory of Distributed System Security, Hubei Engineering Research Center on Big Data Security, School of Cyber Science and Engineering, Huazhong University of Science and Technology · Peking University · Henan University +3

  42. CMAP: Cross-Modal Adaptive Prompting for Multi-Domain Task-Incremental Learning

    May 25, 2026Sriram MandalikaCross-Modal AlignmentCross-Modal

    Hasso Plattner Institute Potsdam, Germany

  43. Baton: Explicit Semantic Blueprints for Joint Video-Audio Generation

    May 24, 2026Shuyuan Tu, Qi Tian, Zihan Yang +9Audio-Video GenerationDenoising Trajectory

    Fudan University · Tencent Hunyuan

  44. Representation Alignment Rests on Linear Structure

    May 22, 2026Kiril Bangachev, Guy Bresler, Yury PolyanskiyCross-Modal AlignmentBiases

    Department of Electrical Engineering and Computer Science · Massachusetts Institute of Technology

  45. Composing People Together: Iterative Pose-Image Generation for Multi-Person Interaction Scenes

    May 22, 2026Wenxuan Peng, Bharath Hariharan, Hadar Averbuch-ElorMulti-Reference Image GenerationIndoor Scene Generation

    Cornell University, Ithaca, USA · Cornell University, New York, New York, USA

  46. Single-Sample Black-Box Membership Inference Attack against Vision-Language Models via Cross-modal Semantic Alignment

    May 17, 2026Jiaqing Li, Yajuan Lu, Xiaochuan Shi +3Membership Inference AttacksCross-Modal Alignment

    1Wuhan University · 2Tarim University

  47. Semi-MedRef: Semi-Supervised Medical Referring Image Segmentation with Cross-Modal Alignment

    May 15, 2026Yuchen Li, Zhen Zhao, Yi Liu +1Semi-Supervised Medical Image SegmentationCross-Modal Alignment

    The University of Sydney, Sydney, NSW 2006, Australia · Shanghai Artificial Intelligence Laboratory, Shanghai, China · Changzhou University, Changzhou, China

  48. Differentially Private Motif-Preserving Multi-modal Hashing

    May 14, 2026Zehua Cheng, Wei Dai, Jiahao SunLocality-Sensitive HashingΔ)$-Differential Privacy

    Department of Computer Science University of Oxford Oxford, United Kingdom · FLock.io London, United Kingdom

  49. STAR: Semantic-Temporal Adaptive Representation Learning for Few-Shot Action Recognition

    May 13, 2026Hongli Liu, Yu Wang, Shengjie ZhaoOpen-Vocabulary Action RecognitionPhotometric Supervision

    School of Computer Science and Technology, Tongji University, Shanghai, China · Engineering Research Center of Key Software Technologies for Smart City Perception and Planning, Ministry of Education

  50. Lifelong Learning in Vision-Language Models: Enhanced EWC with Cross-Modal Knowledge Retention

    May 12, 2026Hamza Ahmed Durrani, Rafay Suleman DurraniRecent Vision-Language ModelsCross-Modal Alignment

    Sejong University, Computer Science Engineering · Technische Universität Ilmenau, Computer Engineering

  51. Cross-Modal-Domain Generalization Through Semantically Aligned Discrete Representations

    May 12, 2026Souptik Sen, Raneen Younis, Zahra AhmadiCross-Modal AlignmentCross-Modal

    Peter L. Reichertz Institute for Medical Informatics, Hannover Medical School, Germany · Lower Saxony Center for AI and Causal Methods in Medicine (CAIMed), Hannover, Germany

  52. DAPE: Dynamic Non-uniform Alignment and Progressive Detail Enhancement Techniques for Improving the Performance of Efficient Visual Language Models

    May 9, 2026Mengyuan Tian, Qiyan Zhao, Yanan Wang +1Cross-Modal AlignmentRecent Vision-Language Models

    The Wang Yanan Institute for Studies in Economics, Xiamen University, Xiamen 361005, China · Fujian Key Laboratory of Pattern Recognition and Image Understanding, School of Computer and Information Engineering, Xiamen University of Technology, Xiamen 361024, China

  53. Align3D-AD: Cross-Modal Feature Alignment and Dual-Prompt Learning for Zero-shot 3D Anomaly Detection

    May 7, 2026Letian Bai, Xuanming Cao, Juan Du +1Multimodal Anomaly Detection3D Generation

    Smart Manufacturing Thrust, The Hong Kong University of Science and Technology (Guangzhou) · The Hong Kong University of Science and Technology · College of Mechanical and Vehicle Engineering, Hunan University

  54. Direct Product Flow Matching: Decoupling Radial and Angular Dynamics for Few-Shot Adaptation

    May 6, 2026Hongxu Chen, Yanghao Wang, Bowei Zhu +6Vision-Language Model AdaptationCross-Modal Alignment

    HKUST · USTC · Huawei Research

  55. SpectraDINO: Bridging the Spectral Gap in Vision Foundation Models via Lightweight Adapters

    May 4, 2026Yagiz Nalcakan, Hyeongjin Ju, Incheol Park +3Recent Vision Foundation ModelsVision Foundation Models

    Yonsei University, Seoul, Republic of Korea

  56. TMD-Bench: A Multi-Level Evaluation Paradigm for Music-Dance Co-Generation

    May 3, 2026Xiaoda Yang, Majun Zhang, Changhao Pan +10DuetText-To-Music

    Department of Zhejiang, University of China · Tecent, China · School of National University of Singapore.

  57. Personalized Cross-Modal Emotional Correlation Learning for Speech-Preserving Facial Expression Manipulation

    Apr 28, 2026Tianshui Chen, Yujie Zhu, Jianman Lin +4Facial Expression RecognitionEmotion Recognition

    Guangdong University of Technology · South China University of Technology · Peking University +1

  58. Fast-then-Fine: A Two-Stage Framework with Multi-Granular Representation for Cross-Modal Retrieval in Remote Sensing

    Apr 22, 2026Xi Chen, Xu Chen, Xiangyang Jia +3Multimodal RetrievalRemote Sensing

    School of Computer Science, Wuhan University, Wuhan, China · Beijing Institute for General Artificial Intelligence (BIGAI), Beijing, China

  59. Can LLM-Generated Text Empower Surgical Vision-Language Pre-training?

    Apr 20, 2026Chengan Che, Chao Wang, Jiayuan Huang +2Medical Vision-Language ModelsMultimodal Pretraining

    Visual Understanding Research Group, Department of Informatics, King’s College London, UK

  60. PivotMerge: Bridging Heterogeneous Multimodal Pre-training via Post-Alignment Model Merging

    Apr 18, 2026Zibo Shao, Baochen Xiong, Xiaoshan Yang +4Cross-Modal AlignmentMultimodal Pretraining

    State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China · Pengcheng Laboratory, Shenzhen 518066, China · School of Artificial Intelligence, University of Chinese Academy Sciences, Beijing 100049, China +1