cs.CVOct 5, 2026

From Transformation to Target State: Rethinking Query Representation for Zero-Shot Composed Image Retrieval

Authors: Yihe Zhao, Songhe Feng

Organizations: School of Computer Science and Technology, Beijing Jiaotong University, Beijing, 100044, China.

Abstract

Composed image retrieval (CIR) aims to retrieve a desired target image from a query consisting of a reference image and a modification text. This task exhibits an unusual representational asymmetry: the modification text specifies a transition from the reference state, whereas retrieval candidates depict completed target states. This creates a representation mismatch for zero-shot methods that query pretrained vision-language spaces directly with transformation-oriented language. We study this mismatch and reformulate zero-shot composed image retrieval as target-state reconstruction followed by retrieval. We instantiate this formulation with ASAP-CIR, a training-free framework that reconstructs a static target representation using a frozen multimodal large language model (MLLM). The representation combines multiple holistic descriptions with a variable set of importance-weighted atomic semantics, thereby preserving both overall target identity and fine-grained visual constraints. Retrieval then integrates holistic state alignment, atomic constraint grounding, and calibrated target-state evidence aggregation. A controlled text-only diagnostic shows that target-side static query formulations achieve more reliable retrieval than dynamic composed query formulations, particularly when source-state semantics must be suppressed or transformed. Experiments on FashionIQ, CIRR, and CIRCO further characterize the effectiveness and limitations of this representation principle, with the clearest gains on the multi-target CIRCO benchmark. These results show that how composed intent is represented before retrieval is a consequential design choice, distinct from the choice of retrieval backbone itself.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Thinking Before Retrieving: Robust Zero-Shot Composed Image Retrieval via Strategic Planning and Self-Criticism

    Jun 30, 2026Gunho Jung, Jeong-Woo Park, Seon Bin Kim +1Image RetrievalComposed Image Retrieval

  2. DiCE-CIR: Direct Composition Learning for Efficient Zero-Shot Composed Image Retrieval

    Jul 6, 2026Gwang-Ho Na, Ho-Joong Kim, Seong-Whan LeeCross-Modal AlignmentCompositional Representation Learning