Daily Arxiv

This page organizes papers related to artificial intelligence published around the world.
This page is summarized using Google Gemini and is operated on a non-profit basis.
The copyright of the paper belongs to the author and the relevant institution. When sharing, simply cite the source.

Graph Your Own Prompt

Created by
  • Haebom

Author

Xi Ding, Lei Wang, Piotr Koniusz, Yongsheng Gao

Outline

Graph Consistency Regularization (GCR) is a novel framework that promotes class-aware and meaningful feature representations by injecting a relational graph structure derived from model predictions into the learning process. GCR acts as a kind of self-prompting mechanism, using its own output to improve its internal structure. GCR introduces parameter-free Graph Consistency Layers (GCLs) at arbitrary depths to address noisy inter-class similarities that contradict the model's prediction semantics. Each GCL builds a batch-level feature similarity graph and aligns it with a global class-aware mask prediction graph derived by adjusting the softmax prediction similarity as a within-class metric. This alignment acts as a semantic regularizer across the network, forcing feature-level relationships to reflect class-consistent prediction behavior. GCR introduces a multi-layer, cross-spatial graph alignment mechanism and uses adaptive weights to learn layer importance from graph disparity magnitude. GCR improves feature quality by prioritizing semantically reliable layers and suppressing noisy layers without modifying the model architecture or training procedure. GCR is model-agnostic, lightweight, and improves semantic structure across diverse networks and datasets.

Takeaways, Limitations

Takeaways:
Facilitates class-aware feature representation using a relational graph structure derived from model predictions.
It provides self-prompting capabilities to improve internal structure through its own output.
Solving the noisy inter-class similarity problem with parameter-free Graph Consistency Layers (GCL).
We introduce a multilayer, cross-spatial graph alignment mechanism and adaptive weights to learn layer importance.
Improve semantic structure across diverse networks and datasets, model-independently.
Promotes cleaner feature structures, stronger intra-class cohesion, and improved generalization.
Limitations:
There is no Limitations directly mentioned in the paper.
👍