Composed Image Retrieval
Overview
Composed image retrieval studies how to find a target image from a query that combines a reference image with an instruction, such as changing an outfit while preserving its style. Methods learn joint image–text embeddings from paired examples, or adapt pretrained vision-language models with projection, interpolation, or instruction-based composition; reranking and interactive clarification can further refine results. Work spans fashion and product search as well as medical and other domain-specific retrieval, with both supervised training and zero-shot approaches that use pretrained models without task-specific training. A central challenge is balancing broad semantic understanding with fine-grained attribute and instance fidelity, while ensuring benchmarks test genuine multimodal composition rather than shortcuts and remain robust to ambiguity and noisy labels.
Latest papers
66 papers4 papers in the last four weeks, up 33% on the four weeks before. 0.0% of all new papers.
Less is More: Concise Retrieval and Critic-based Re-ranking for Composed Image Retrieval
CaptionFuse: Training-Free Composed Product Retrieval Via VLM Intent Captioning and Weighted Embedding Fusion
make it red with shorter sleeves'' specifies what to change but not what to keep (the floral pattern, the V-neck, the fit-and-flare silhouette). We introduce language-space fusion: a Vision-Language Model (VLM) jointly interprets the reference image and modification to generate a visually grounded product-title caption---e.g., Red floral fit-and-flare dress with short sleeves and V-neck''---that fills in the missing attributes from the image. Our method, CaptionFuse, requires no task-specific training and is model-agnostic. A controlled experiment confirms that attribute content--- not linguistic style---drives the gains: imperative and descriptive captions with identical attributes achieve equal R@10, while both outperform raw modifications by +6.5 points.