Overview

Vision-language retrieval studies how to rank images, video, and visual documents against text queries, from short captions to detailed or compositional descriptions. Common approaches include CLIP-style contrastive dual encoders, fine-grained attribute or region alignment, and coarse-to-fine pipelines that rerank candidates with vision-language models or language-model reasoning. Benchmarks span image-text datasets such as COCO and Flickr, video retrieval, and specialized settings including visual documents, geolocation, and fine-grained product search. A central tension is that fast similarity scores can miss logical constraints or subtle evidence, while richer reranking and reasoning improve precision at greater computational cost and may generalize unevenly across domains.

Latest papers

CardsList

98 papers17 papers in the last four weeks, up 70% on the four weeks before. 0.1% of all new papers.

  1. CLIP Is Shortsighted: Paying Attention Beyond the First Sentence

    Feb 25, 2026Marc-Antoine Lavoie, Anas Mahmoud, Aldo Zaimi +2Position Bias in VLMsVision-Language Alignment

  2. Seeing Through Words: Controlling Visual Retrieval Quality with Language Models

    Feb 24, 2026Jianglin Lu, Simon Jenni, Kushal Kafle +3Vision-Language RetrievalImage Retrieval

  3. Visual Model Checking: Graph-Based Inference of Visual Routines for Image Retrieval

    Feb 19, 2026Adrià Molina, Oriol Ramos Terrades, Josep LladósVision-Language RetrievalFine-Grained Image Retrieval

  4. LaVPR: Benchmarking Language and Vision for Place Recognition

    Feb 3, 2026Ofer Idan, Dan Badur, Yosi Keller +1Multimodal RobustnessVisual Place Recognition

  5. R3G: A Reasoning-Retrieval-Reranking Framework for Vision-Centric Answer Generation

    Jan 25, 2026Zhuohong Chen, Zhengxian Wu, Zirui Liao +6Multimodal RAGVisual Question Answering

  6. CLIMP: Contrastive Language-Image Mamba Pretraining

    Jan 11, 2026Nimrod Shabtay, Itamar Zimerman, Eli Schwartz +1Vision-Language PretrainingVLM Robustness

  7. Contrastive vision-language learning with paraphrasing and negation

    Nov 20, 2025Kwun Ho Ngan, Saman Sadeghi Afgeh, Joe Townsend +1VLM RobustnessVLM Reasoning