mlsanityData to 14 Oct 2026

Energy-Balanced Hyperspherical Graph Representation Learning via Structural Binding and Entropic Dispersion

arXiv 2512.24062 ↗First posted 30 Dec 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Graph Representation Learning (GRL) can be fundamentally modeled as a physical process of seeking an energy equilibrium state for a node system on a latent manifold. However, existing Graph Neural Networks (GNNs) often suffer from uncontrolled energy dissipation during message passing, driving the system towards a state of Thermal Death--manifested as feature collapse or over-smoothing--due to the absence of explicit thermodynamic constraints. To address this, we propose HyperGRL, a thermodynamics-driven framework that embeds nodes on a unit hypersphere by minimizing a Helmholtz free energy objective composed of two competing potentials. First, we introduce Structural Binding Energy (via Neighbor-Mean Alignment), which functions as a local binding force to strengthen structural cohesion, encouraging structurally related nodes to form compact local clusters. Second, to counteract representation collapse, we impose a Mean-Field Repulsive Potential (via Sampling-Free Uniformity), which acts as a global entropic force to maximize representation dispersion without the need for negative sampling. Crucially, to govern the trade-off between local alignment and global uniformity, we devise an Adaptive Thermostat. This entropy-guided strategy dynamically regulates the system's "temperature" during training, guiding the representation towards a robust metastable state that balances local cohesion with global discriminability. Extensive experiments on node classification, node clustering, and link prediction show that HyperGRL consistently achieves strong performance across diverse benchmark datasets, yielding more discriminative and robust representations while alleviating over-smoothing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 48 references that are in the map. First posted on arXiv 30 Dec 2025.

Builds on

30 of 48 references.

References · 30

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  2. 2017Graph Attention Networkscited by 8,923
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2017Inductive Representation Learning on Large Graphscited by 6,320
  5. 2016node2vec: Scalable Feature Learning for Networkscited by 1,918
  6. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  7. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
  8. 2016Variational Graph Auto-Encoderscited by 1,382
  9. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  10. 2018Deep Graph Infomaxcited by 1,106
  11. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
  12. 2018Pitfalls of Graph Neural Network Evaluationcited by 1,007
18 more
  1. 2020Simple and Deep Graph Convolutional Networkscited by 860
  2. 2018Link Prediction Based on Graph Neural Networkscited by 832
  3. 2020Contrastive Multi-View Representation Learning on Graphscited by 652
  4. 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 545
  5. 2020Deep Graph Contrastive Representation Learningcited by 539
  6. 2019Graph Transformer Networkscited by 523
  7. 2020Graph Contrastive Learning with Adaptive Augmentationcited by 519
  8. 2019PairNorm: Tackling Oversmoothing in GNNscited by 297
  9. 2021Neural Bellman-Ford Networks: A General Graph Neural Network Framework for Link Predictioncited by 275
  10. 2020Wiki-CS: A Wikipedia-Based Benchmark for Graph Neural Networkscited by 260
  11. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
  12. 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 186
  13. 2021From Canonical Correlation Analysis to Self-supervised Graph Neural Networkscited by 141
  14. 2021Augmentation-Free Self-Supervised Learning on Graphscited by 94
  15. 2022Graph Neural Networks for Link Prediction with Subgraph Sketchingcited by 81
  16. 2022Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Predictioncited by 78
  17. 2023Evaluating Graph Neural Networks for Link Prediction: Current Pitfalls and New Benchmarkingcited by 69
  18. 2023Neural Common Neighbor with Completion for Link Predictioncited by 64

Built on by

Not cited yet.