cs.CVJul 10, 2026

Bridging the Catalog-to-Real Gap: Scalable Product Recognition via Multi-Stage Contrastive Learning

Authors: Anyi ZhangJoy MazumderKiril Lomakin

Organizations: Walmart Global Tech Sunnyvale, CA, USA

Abstract

Automated product recognition is a cornerstone of modern retail intelligence; however, accurately matching real-world, in-store images against extensive corporate catalogs remains a major scalability bottleneck for large-scale applications. In this work, we address this challenge by reformulating the task as an embedding-based cross-domain retrieval problem rather than a standard closed-set classification task. Specifically, we define the objective as retrieving the most corresponding catalog reference image for a given real-world product query crop from an expansive inventory. To bridge the severe domain gap between pristine studio packshots and noisy in-store queries, we introduce a novel catalog-to-real multi-stage contrastive learning paradigm (Cat2Real). This framework fine-tunes a vision backbone by systematically exploiting both item-level and image-level similarities to drive targeted hard negative mining. Extensive empirical evaluations demonstrate that our paradigm scales seamlessly to unseen products and categories, yielding outstanding zero-shot generalization performance even in the complete absence of real-world training images for novel inventory.

Explore similar work

CardsList
  1. Catalogue Photography as a Cold Start: Toward Deployable Rotary Milling Tool Recognition

    Date pendingAbilash Philip Madavath, Chandra Yuvesh Aubeeluck, Augustin Raju +3Computer VisionDomain Shift

  2. Extreme Meta-Classification for Large-Scale Zero-Shot Retrieval

    Jun 23, 2026Sachin Yadav, Deepak Saini, Anirudh Buvanesh +6Zero-Shot InferenceEncoders