Overview

Video retrieval studies how to find the videos or time spans that best match a query, supporting search, question answering, and evidence gathering. Common approaches use contrastive dual-encoder embeddings for fast candidate search, then apply query expansion, multimodal reranking, or temporal localization to refine results; long-video systems also use keyframe indexes, memory, and retrieval-augmented generation. Benchmarks such as MSR-VTT and ActivityNet test text-to-video matching and moment localization, while long-video and domain-specific evaluations probe extended evidence, actions, and specialized content. A central tension is balancing scalable semantic matching with precise temporal and contextual reasoning: systems can find broadly relevant clips yet miss action order, fine-grained details, or queries with no valid match, while deeper verification costs more.

Latest papers

CardsList

61 papers8 papers in the last four weeks, up 60% on the four weeks before. 0.0% of all new papers.

  1. MLLM Frame Subset Ensembling for Audio-Visual Video QA and MLLM-based Reranking for Ad-hoc Video Search in TRECVID 2025

    Oct 16, 2026Andreas Goulas, Damianos Galanopoulos, Ioannis Patras +1Audio-Visual QAVideo Retrieval

  2. VEDJE: Video-Efficient Discriminative Joint Encoder for Scalable Video-Text Retrieval

    Oct 8, 2026Shahaf Wagner, Gabriele Serussi, Dan Ben Ami +2Video RetrievalVision-Language Retrieval

  3. VideoEvolve: Co-Evolving Memory and Retrieval for Long Video Understanding

    Oct 7, 2026Yongchao Xu, Bowen Ye, Jiefeng Gan +5Long-Video UnderstandingMemory-Augmented Video Understanding

  4. SoccerNet-FoulRet: Retrieving Semantically Similar Soccer Foul Videos

    Oct 7, 2026Jacobus Arthur, Ahmad Sait, Batool Hani +6Video RetrievalSports Video Analysis

  5. Enhancing Long-Video VLM Embeddings with Query-Aware Streaming Latent Reasoning

    Oct 4, 2026Haozhe Chi, Song Jin, Yang Jin +1Multimodal EmbeddingVision-Language Retrieval

  6. Concept Driven Domain Adaptation: Finding an Abstract Needle in a Haystack

    Oct 1, 2026Haiming Zhao, Tai Wang, Kun Zhang +2VLM AdaptationVideo Moment Retrieval

  7. MultiVENT-Raw: A Benchmark for Retrieval and Reasoning over Raw Videos

    Sep 23, 2026Reno Kriz, David Etter, Alexander Martin +11Video UnderstandingVideo Retrieval

  8. Verify, Don't Trust: Agentic Model Development for Video Discovery Retrieval at Scale

    Sep 18, 2026Hao Fu, Baiting Zhu, Minglei Chen +2Autonomous ExperimentationAutonomous Research Agents

  9. Concentrate After Imagination: Text-Conditioned Evidence Grounding for Partially Relevant Video Retrieval

    Sep 8, 2026Shuaiqi Cheng, Siyu You, Yanbi Wu +3Temporal Video GroundingInformation Retrieval

  10. Allocate Before You Embed: Adaptive Visual Input Allocation for Video Embeddings

    Sep 1, 2026Song Jin, Zhongtao Jiang, Chenglei Shen +5Multimodal EmbeddingInformation Retrieval

  11. From Intent to Evidence: Policy-Steered Multi-Strategy Retrieval for Long-Video Agents

    Aug 31, 2026Can Zhang, Baofeng Zhang, Xiaotian Han +5Long-Video UnderstandingLong-Video QA

  12. Coarse Indexing, Fine Evidence: Decoupling Temporal Granularity in Long-Video RAG

    Aug 24, 2026Zhe Jin, Zhimin Lin, Bin Zheng +2Graph Retrieval-Augmented GenerationLong-Video QA

  13. TraVEL: Trajectory-Guided Video Embedding Learning for Driving-Video Retrieval

    Aug 13, 2026Yi-Chung Chen, Philip Jacobson, Tom Lampo +6VLMs for Autonomous DrivingMultimodal Embedding

  14. Keep It Simple: Multi-Key Episodic Memory Retrieval for Ultra-Long Video Understanding

    Aug 7, 2026Yeeun Choi, Youngbeom Yoo, Joon-Young Lee +2Memory-Augmented VLMsEpisodic Memory

  15. Predict, Then Retrieve: Cross-Instance Future-State Retrieval from Video Prefixes

    Aug 5, 2026Quynh Vo, Thong Nguyen, Vinh-Hien Do +2Cross-Modal RetrievalVideo Prediction

  16. Prompting-MammAlps: Fine-Grained Text-to-Video Retrieval for Camera-Trap Data

    Jul 10, 2026Valentin Gabeff, Baptiste Maquignaz, Jennifer Shan +5Vision-Language RetrievalWildlife Monitoring

  17. QSVideo: Query-Conditioned Semantic Temporal Retrieval for Video Understanding

    Jul 6, 2026Wei Ao, Lan Wang, Vishnu Naresh BoddetiTemporal Video GroundingStreaming Video Understanding

  18. VideoSearch-R1: Iterative Video Retrieval and Reasoning via Soft Query Refinement

    Jul 1, 2026Seohyun Lee, Seoung Choi, Dohwan Ko +2Temporal Video GroundingTemporal IR

  19. Vortex: Multi-Modal Fusion System for Intelligent Video Retrieval

    Jun 18, 2026Duc-Tho Nguyen, Hieu-Hoc Tran-Minh, Khanh-Hoa Lam +4Multimodal IRInformation Retrieval

  20. Rethinking RAG in Long Videos: What to Retrieve and How to Use It?

    Jun 11, 2026Yuho Lee, Jisu Shin, Nicole Hee-Yeon Kim +5Multimodal RAGEgocentric Video Understanding

  21. Findings of the MAGMaR 2026 Shared Task

    Jun 10, 2026Alexander Martin, Dengjia Zhang, Joel Brogan +7Multimodal RAGMultimodal Grounding

  22. MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding

    Jun 8, 2026Jie Zhang, Qilang Ye, Hao Zhou +2Video UnderstandingMulti-Agent Collaboration

  23. Driving Video Retrieval for Complex Queries with Structured Grounding

    Jun 8, 2026Manyi Yao, Sparsh Garg, Christian Shelton +2Autonomous DrivingVision-Language Retrieval

  24. To Be Multimodal or Not to Be: Query-Adaptive Audio-Visual Person Retrieval via Active Modality Detection

    Jun 4, 2026Erfan Loweimi, Mengjie Qian, Kate Knill +7Cross-Modal RetrievalMissing-Modality Learning

  25. VidMsg: A Benchmark for Implicit Message Inference in Short Videos

    Jun 2, 2026Issar Tzachor, Michael Green, Rami Ben-AriVLM EvaluationVideo QA

  26. Reason-Then-Retrieve for CoVR-R with Structured Edit Prompts and Dense-Sparse Fusion

    Jun 1, 2026DongQing Liu, MengShi Qi, HongWei JiCross-Modal RetrievalVideo Reasoning