Overview

Vision-language retrieval studies how to rank images, video, and visual documents against text queries, from short captions to detailed or compositional descriptions. Common approaches include CLIP-style contrastive dual encoders, fine-grained attribute or region alignment, and coarse-to-fine pipelines that rerank candidates with vision-language models or language-model reasoning. Benchmarks span image-text datasets such as COCO and Flickr, video retrieval, and specialized settings including visual documents, geolocation, and fine-grained product search. A central tension is that fast similarity scores can miss logical constraints or subtle evidence, while richer reranking and reasoning improve precision at greater computational cost and may generalize unevenly across domains.

Latest papers

CardsList

97 papers17 papers in the last four weeks, up 70% on the four weeks before. 0.1% of all new papers.

  1. Whispers from the Neighbors: Rethinking Caption Consensus as Inference-Time Evidence for Vision-Language Retrieval

    Oct 24, 2026Khang Nhat Hoang Vo, Belal Shoer, Abhirama Subramanyam PenamakuriVision-Language RetrievalCross-Modal Retrieval

  2. Mitigating Saliency Collapse: Robust Saliency-Aware Long-Text Image-Text Alignment

    Oct 22, 2026Qiuyu Kong, Zanxi Ruan, Marco Cristani +1Vision-Language AlignmentImage-Text Retrieval

  3. OASIS: Online Anchor-centric Scene Inference System for Open-Vocabulary Retrieval and Navigation in Dynamic Environments

    Oct 22, 2026Kaiyao Liao, Qingfeng Li, Chen Chen +3Indoor Robot NavigationSemantic Mapping

  4. In PRAISE of Attributes: Grounding Retrieval Geometry with Query-Conditioned Subspaces for Person Re-Identification

    Oct 20, 2026Rajarshi Bhattacharya, Aryan Shukla, Shakeeb Murtaza +4Person Re-IdentificationVision-Language Retrieval

  5. VTrajEmbed: Aligning Text with Video Object Trajectories via Spatiotemporal Embeddings

    Oct 16, 2026Ruizhi Chen, Zining Fan, Yudi Guo +5Multimodal EmbeddingVision-Language Retrieval

  6. Stuck on Shuffle: On Attribute-Object Binding in Vision-Language Models

    Oct 15, 2026Netanel Y. Tamir, Michael Green, Issar Tzachor +4Vision-Language RetrievalMultimodal Embedding

  7. Flow-CLIP: Image-Conditioned Residual Scoring for CompositionalImage-Text Matching

    Oct 15, 2026Minghong Wei, Enguang Zhu, Pu Cao +2Vision-Language AlignmentCross-Modal Feature Matching

  8. SPELUNKA: A Framework for Finding Unanticipated Associations in Vision-Language Models

    Oct 13, 2026Cassandra Parent, Isha Agarwal, Kumail Alhamoud +4VLM EvaluationVision-Language Retrieval

  9. Token-Budgeted Candidate Retrieval for 3D Scene-Grounded VLMs: Category Names vs. Pairwise Geometry

    Oct 9, 2026Michał Zakrzewski, Mariia Shpir, Taras RumezhakVision-Language Retrieval3D VLMs

  10. VEDJE: Video-Efficient Discriminative Joint Encoder for Scalable Video-Text Retrieval

    Oct 8, 2026Shahaf Wagner, Gabriele Serussi, Dan Ben Ami +2Video RetrievalVision-Language Retrieval

  11. SoccerNet-FoulRet: Retrieving Semantically Similar Soccer Foul Videos

    Oct 7, 2026Jacobus Arthur, Ahmad Sait, Batool Hani +6Video RetrievalSports Video Analysis

  12. Enhancing Long-Video VLM Embeddings with Query-Aware Streaming Latent Reasoning

    Oct 4, 2026Haozhe Chi, Song Jin, Yang Jin +1Multimodal EmbeddingVision-Language Retrieval

  13. AMBER: Multi-View Adaptive Budget Allocation for Listwise Vision-Language Reranking

    Oct 2, 2026Wenteng Chen, Jiachen Zhu, Rong Shan +10Multimodal RerankingVision-Language Retrieval

  14. AiSearch: Interactive Multi-Modal Search with VLMs

    Oct 1, 2026Ali Koksal, Mei Chee Leong, Vicky Sintunata +2Multimodal IRVision-Language Models

  15. LazySloth: Bounded LLM-based Lazy Tree Search for Fast Long Video Comprehension

    Sep 29, 2026Arka Mukherjee, Kaleen Shrestha, Larissa Zhu +1Efficient VLM InferenceLong-Video Understanding

  16. Concepts Complement Dense Semantics: Learning Compact Sparse Spaces for Text-Image Retrieval

    Sep 26, 2026Yoonseo Kim, Jungwoo Choi, Cheonyoung Park +3Cross-Modal RetrievalVision-Language Retrieval

  17. Kernel-Based Steering of CLIP with Vision-Language Model Preferences

    Sep 26, 2026Sajjad Ghiasvand, Haniyeh Ehsani Oskouie, Sina Mansouri +3VLM AdaptationVisual Representation Learning

  18. MINER: Multi-crop INference-time Enhancement for Rare-Object Retrieval with Frozen Dual Encoders

    Sep 22, 2026Abdulmalik Alquwayfili, Faisal AlMeshal, Jumanah Almajnouni +2Vision-Language RetrievalImage Retrieval

  19. Selective Commitment for Language-Guided Object Retrieval under Partial Observability

    Sep 19, 2026Wonhee Koh, Sushil Samuel Dinesh, Hansol Ko +2Vision-Language RetrievalActive Vision for Robot Manipulation

  20. Human-Grounded Calibration for Long-Text Image-Text Congruence in Vision-Language Models

    Sep 14, 2026Alessandro Gambetti, Qiwei HanText-Image AlignmentVision-Language Retrieval

  21. Bridging the Semantic-Utility Gap in Multimodal RAG via Generator-in-the-Loop Alignment

    Sep 8, 2026Zhan-Lun Chang, Dong-Jun Han, Seyyedali Hosseinalipour +2Multimodal RAGMultimodal Reranking

  22. A Reverse Sign Language Dictionary: Open-Vocabulary Sign Recognition from Continuous Signing via Video Captioning and Description Retrieval

    Sep 3, 2026Santiago Poveda-Gutiérrez, Hideki Nakayama, Mayumi BonoVideo CaptioningVision-Language Retrieval

  23. From Saliency to Discriminability: Rank-Preserving Visual Token Pruning for VLM Rerankers

    Sep 1, 2026Siyi Liu, Hanjun Yang, Chenchen Zhang +7Efficient VLM InferenceMultimodal Reranking

  24. Hyper3-CLIP: Hierarchy-Conditioned Hyperbolic Vision-Language Training

    Aug 29, 2026Matin Mahmood, Antonio Rueda-Toicen, Mohamed ElBassat +3Vision-Language ModelsVision-Language Alignment

  25. PlaceSeek: Human-Centered Geospatial Retrieval of Urban Outdoor Places via Semantic Grounding and Affective Alignment

    Aug 25, 2026Ziqi Cui, Shangyu LouInformation RetrievalImage Retrieval