cs.CVNov 15, 2026

PRISM: Primitive-Integrated Separable Modulation with Priority Visual Memory Queue for Compositional Zero-Shot Learning

Authors: Jianhua Wang, Zhihang Zheng, Yang Liu, Jiale Du

Organizations: School of Electronic Engineering, Xidian University, Shaanxi 710071, China · School of Computer Science and Technology, Xidian University, Shaanxi 710071, China · School of Telecommunications Engineering, Xidian University, Shaanxi 710071, China

Abstract

Compositional Zero-Shot Learning (CZSL) recognizes unseen attribute--object pairs by recombining primitives from seen compositions. Existing methods stop sharing evidence at deployment: fixed prototypes cannot exploit unlabeled test streams, while composition-wise refinement cannot propagate corrections across pairs sharing a primitive. We introduce PRISM, an online CZSL framework that extends primitive sharing to test-time adaptation. Its Hierarchical Knowledge Accumulation Module (HiKAM) factorizes prototype migration into composition-, attribute-, and object-level residual banks. A Priority Visual Memory Queue (PVMQ), initialized by Prototype Queue Initialization (PQI), grounds text updates with bounded visual evidence. The same adaptive core supports exhaustive Full PRISM and recall-calibrated Adaptive PRISM-Lite, which selects candidate budgets from held-out ranks. Comprehensive closed- and open-world experiments on UT-Zappos, MIT-States, and C-GQA demonstrate the state of the art, with Full PRISM achieving the best open-world AUC and harmonic mean on all three benchmarks and the best closed-world results on UT-Zappos and C-GQA. Fine-grained long-tail and non-stationary primitive-block evaluations reveal gains on under-supported concepts and stable adaptation under prolonged skew. Adaptive PRISM-Lite further delivers substantial efficiency gains in the full open-world space with only a small accuracy cost. PRISM thus combines primitive-shared online adaptation, multimodal grounding, and candidate-aware inference.

Figures & tables

Explore similar work

CardsList
  1. WARM-CAT: Warm-Started Test-Time Comprehensive Knowledge Accumulation for Compositional Zero-Shot Learning

    Feb 26, 2026Xudong Yan, Songhe Feng, Jiaxin Wang +2Zero-Shot LearningTest-Time Adaptation

  2. Progressive Reasoning with Primitive Correction for Compositional Zero-Shot Learning

    Jul 7, 2026Ziyi Chen, Haoyan Shi, Sunhan Xu +1Zero-Shot LearningVLM Reasoning

  3. From Model Patterns to Abstract Semantics in Compositional Zero-Shot Learning

    Sep 14, 2026Weize Li, Zhicheng Zhao, Fei SuZero-Shot LearningVLM Reasoning