cs.CVNov 7, 2026

Interactive Person Retrieval with On-the-Fly Visual Feedback

Authors: Lyucheng Qian, John Yuehan Zhang, Pingyu Wang

Organizations: Sichuan University · University of California, Berkeley

Abstract

Traditional text-based person retrieval (TPR) assumes that a witness provides a complete description at once, whereas interactive person retrieval (Inter-PR) refines a partial description through question-answer exchanges. In this setting, the questioner inspects retrieved candidates to decide what evidence to request next, while the answerer sees only the witness-side memory and cannot report candidate-specific visual differences. Existing methods mainly learn offline question orderings, leaving this visual-feedback loop underexplored. To address this limitation, we introduce visual-feedback interactive person retrieval (VFI-PR), a new interactive retrieval paradigm in which retrieved candidates produce visual feedback that becomes evidence for subsequent questioning and re-ranking. To support training and evaluation in this setting, we construct VFI-PEDES, a dataset and evaluation protocol for visual-feedback interaction, and propose VFI-ReID, a framework that learns to use visual feedback during interactive person retrieval. Through the Dynamic Accumulated-evidence Retriever (DAR) and retrieval-aware question optimization, VFI-ReID adapts retrieval and question generation to evolving evidence states, turning visual feedback into complementary evidence for subsequent retrieval. Experiments show that VFI-ReID consistently improves retrieval across VFI-PR interaction stages, demonstrating the utility of visual feedback for interactive person retrieval and outperforming existing Inter-PR baselines.

Figures & tables

Explore similar work

CardsList
  1. What Should We Ask Next? Retrieval-Aware Question Learning for Interactive ReID

    Sep 18, 2026Lyucheng Qian, John Yuehan Zhang, Pingyu WangPerson Re-IdentificationRL for IR

  2. In PRAISE of Attributes: Grounding Retrieval Geometry with Query-Conditioned Subspaces for Person Re-Identification

    Oct 20, 2026Rajarshi Bhattacharya, Aryan Shukla, Shakeeb Murtaza +4Person Re-IdentificationVision-Language Retrieval

  3. IntRec: Intent-based Retrieval with Contrastive Refinement

    Feb 19, 2026Pourya Shamsolmoali, Masoumeh Zareapoor, Eric Granger +1Open-Vocabulary Object Detection