cs.LGSep 27, 2025

Graph Your Own Prompt

Authors: Xi Ding, Lei Wang, Piotr Koniusz, Yongsheng Gao

Organizations: Griffith University · Australian National University · Data61/CSIRO · University of New South Wales

Abstract

We propose Graph Consistency Regularization (GCR), a novel framework that injects relational graph structures, derived from model predictions, into the learning process to promote class-aware, semantically meaningful feature representations. Functioning as a form of self-prompting, GCR enables the model to refine its internal structure using its own outputs. While deep networks learn rich representations, these often capture noisy inter-class similarities that contradict the model's predicted semantics. GCR addresses this issue by introducing parameter-free Graph Consistency Layers (GCLs) at arbitrary depths. Each GCL builds a batch-level feature similarity graph and aligns it with a global, class-aware masked prediction graph, derived by modulating softmax prediction similarities with intra-class indicators. This alignment enforces that feature-level relationships reflect class-consistent prediction behavior, acting as a semantic regularizer throughout the network. Unlike prior work, GCR introduces a multi-layer, cross-space graph alignment mechanism with adaptive weighting, where layer importance is learned from graph discrepancy magnitudes. This allows the model to prioritize semantically reliable layers and suppress noisy ones, enhancing feature quality without modifying the architecture or training procedure. GCR is model-agnostic, lightweight, and improves semantic structure across various networks and datasets. Experiments show that GCR promotes cleaner feature structure, stronger intra-class cohesion, and improved generalization, offering a new perspective on learning from prediction structure. Project website Code

Figures & tables

Appendix figures & tables15 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. GCCM: Enhancing Generative Graph Prediction via Contrastive Consistency Model

    May 7, 2026Shaozhen Ma, Wei Huang, Hanchen Wang +2Physics-Guided DiffusionGenerative Models

  2. Structure-Feature Aligned Graph Learning via Alternating Constrained Optimization

    Jul 13, 2026Chengcheng Yan, Qingsong WangGraph Neural NetworksSparse Spatial Anchors

  3. SAOT: Self-Supervised Continual Graph Learning with Structure-Aware Optimal Transport

    Jul 1, 2026Yuting Zhang, Yanbei Liu, Zhitao Xiao +3Graph Representation Learning