Overview

Vision-language alignment studies how models connect visual information with words, phrases, and longer descriptions, enabling tasks such as image-text retrieval, visual grounding, segmentation, and captioning. Common approaches include contrastive learning, prompt and adapter tuning, optimal transport, and fine-grained alignment between text tokens and image regions or video frames. Work also applies these methods to medical images, remote sensing, robotics, and multilingual settings, while developing benchmarks and diagnostics for compositional understanding and cross-modal correspondence. A central tension is that stronger semantic alignment can improve matching but may blur local details, amplify language bias, or weaken generalization across domains and tasks.

Latest papers

CardsList

370 papers22 papers in the last four weeks, down 24% on the four weeks before. 0.2% of all new papers.

  1. Vision-Grounded Semantic Learning and Alignment for Scalable Multilingual Text-Based Person Retrieval

    Nov 11, 2026Xinyu Zhou, Fan Li, Shasha Chen +4Text-Based Person SearchVision-Language Alignment

  2. Permute-then-Adapt: Weak-to-Strong Contrastive Image-Text Adaptation

    Nov 7, 2026Jinhao Li, Sarah Erfani, Lei Feng +3VLM AdaptationVision-Language Alignment

  3. Beyond Scene Shortcuts: Action-Centric Video-Text Alignment for Fine-Grained Action Understanding

    Nov 4, 2026Zhiliang Zhu, Jiazheng Huang, Dawei Zhaofine-grained action understandingVideo-Language Models

  4. Grounding in the Dark: Text-Only Training for Zero-Shot Video Temporal Localization

    Nov 4, 2026Divyanshu Mishra, Sabine Sternig, Rakshith Shetty +1Temporal Video GroundingModality Gap in VLMs

  5. ODC: Orthogonal Drift Correction for Improved Text-to-Image Semantic Alignment at Inference

    Oct 31, 2026Kasra Kamali, Basim Azam, Tuan Duong Trinh +2Prompt Optimization for T2I GenerationDiffusion Model Guidance

  6. GAVAGAI: Referential Alignment for Infant-Scale Vision-Language Models via Balanced Optimal Transport

    Oct 30, 2026Rajdeep Pal, Jotiraditya Banerjee, Saptarshi PaniVision-Language AlignmentVisual Grounding

  7. Proving and Improving the Platonic Representation Hypothesis with JEPAs

    Oct 29, 2026Randall Balestriero, Yann LeCunPlatonic Representation HypothesisCross-Modal Alignment

  8. RankAlign: Vision-Language Representation Alignment via Rank Transformation

    Oct 22, 2026Enzhe Zhao, Marco Fiorucci, Lamberto BallanVision-Language AlignmentCross-Modal Feature Matching

  9. Mitigating Saliency Collapse: Robust Saliency-Aware Long-Text Image-Text Alignment

    Oct 22, 2026Qiuyu Kong, Zanxi Ruan, Marco Cristani +1Vision-Language AlignmentImage-Text Retrieval

  10. Query-Time Calibration of CLIP Features for Open-Vocabulary 3D Segmentation

    Oct 22, 2026Dominik Engel, Yousef Rajeh, Leon Sick +1Open-Vocabulary 3D SegmentationVLM Calibration

  11. Refining Open-Vocabulary Semantic Segmentation via Regional Semantics and Visual Prototypes

    Oct 22, 2026Aijing Yu, Zhengbo Wang, Lijun Sheng +2Open-Vocabulary Semantic SegmentationVision-Language Alignment

  12. Visual Memory and Textual Alignment for Cross-Modal Few-Shot Segmentation

    Oct 19, 2026Tianqi Wei, Zhi Chen, Xin Yu +2Few-Shot Semantic SegmentationText-Guided Image Segmentation

  13. Persistent Representational Misalignment Induces Vision-Language Model Failures

    Oct 18, 2026Yonatan Gideoni, Yoav Gelberg, Tim G. J. Rudner +1Vision-Language AlignmentModality Gap in VLMs

  14. Domain-specific language alignment of multimodal embeddings towards explainable predictions

    Oct 16, 2026Gabrielė Tijūnaitytė, Thijs L. van der Plas, Mohamed-Bachir Belaid +3Multimodal EmbeddingConcept-Based Explanations

  15. Flow-CLIP: Image-Conditioned Residual Scoring for CompositionalImage-Text Matching

    Oct 15, 2026Minghong Wei, Enguang Zhu, Pu Cao +2Vision-Language AlignmentCross-Modal Feature Matching

  16. Why Do VLMs Fail at Remote Physiological Measurement? Rethinking with Physiological Grounding and Numerical Alignment

    Oct 13, 2026Xiao Yang, Zekun Zhang, Yuxuan Fan +5Remote PhotoplethysmographyVLM Adaptation

  17. Rethinking Projector Training in Multimodal LLMs

    Oct 13, 2026Fabian Gröger, Naël Ouerghemi, Shuo Wen +1Multimodal Large Language ModelsVision-Language Alignment

  18. VARI: Robust Text-to-Video Generation via Group-Structured Intent Alignment

    Oct 13, 2026Mingxuan Zhu, Hohei Chan, Shiyuan Liu +2T2V GenerationVideo Diffusion Models

  19. MicroCLIP: Connecting Text and Microscopy Images via Contrastive Language--Image Pretraining

    Oct 13, 2026Yanran Ruan, Zhixiang Wei, Shiyao Hong +5Fluorescence MicroscopyMicroscopy Image Analysis

  20. When Left Is Right? Camera-Motion Understanding beyond Screen

    Oct 12, 2026Chong Cheng, Ran Zhang, Xinyuan Li +3Camera Motion UnderstandingVideo-Language Models

  21. Revisiting Natural Language Prompts from Large Language Models for Open-Vocabulary Video Recognition

    Oct 12, 2026Haichen He, Weibin Liu, Weiwei XingPrompt Learning for VLMsVision-Language Models

  22. Attribute-Centric Vision-Language Alignment for Fine-Grained Gait Understanding

    Oct 10, 2026Saihui Hou, Chenye Wang, Wenpeng Lang +5Gait RecognitionVision-Language Alignment

  23. Vision Transformers Learn Word Meaning from Images Alone

    Oct 9, 2026Anders Gjølbye, Sebastian Ray Mason, Stella Frank +1Vision TransformerSemantic Clustering

  24. CliQ-RRG: Clinical-Knowledge Guided Disease-aware Visual-Textual Alignment for QA-Style Radiology Report Generation

    Oct 9, 2026Chandravardhan Singh Raghaw, Shahid Shafi Dar, Arnav Nishith Sharma +2Radiology Report GenerationMedical VLMs

  25. DVLA-RL++: Dual-Level Vision-Language Alignment with Reinforcement Learning Gating for Few-Shot Learning

    Oct 8, 2026Wenhao Li, Xianjing Meng, Qiangchang Wang +3Few-Shot LearningFew-Shot Image Classification

  26. DiscoVL: Unveiling Disentangled C ross-Modal Representation Learning via Orthogonal Adversarial Regularization for V ision-Language Models

    Oct 8, 2026Mengping Dong, Jinbao Li, Fei LiVision-Language ModelsVLM Adaptation

  27. From Global Alignment to Local Grounding: Zero-Shot Chinese Character Recognition with Radical Verification

    Oct 7, 2026Yu-Heng Shih, Bing-Chen Wu, Tsz-To Wong +6Zero-Shot LearningOptical Character Recognition