Topology Matters: A Cautionary Case Study of Graph SSL on Neuro-Inspired Benchmarks
Not on the map. Why?
Abstract (arXiv)
Understanding how local interactions give rise to global brain organization requires models that can represent information across multiple scales. We introduce a hierarchical self-supervised learning (SSL) framework that jointly learns node-, edge-, and graph-level embeddings, inspired by multimodal neuroimaging. We construct a controllable synthetic benchmark mimicking the topological properties of connectomes. Our four-stage evaluation protocol reveals a critical failure: the invariance-based SSL model is fundamentally misaligned with the benchmark's topological properties and is catastrophically outperformed by classical, topology-aware heuristics. Ablations confirm an objective mismatch: SSL objectives designed to be invariant to topological perturbations learn to ignore the very community structure that classical methods exploit. Our results expose a fundamental pitfall in applying generic graph SSL to connectome-like data. We present this framework as a cautionary case study, highlighting the need for new, topology-aware SSL objectives for neuro-AI research that explicitly reward the preservation of structure (e.g., modularity or motifs).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 31 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
13 of 31 references.
References · 13
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2020Graph Contrastive Learning with Augmentationscited by 1,203
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2020GCC: Graph Contrastive Coding for Graph Neural Network Pre-Trainingcited by 461
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 443
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
- 2019A Fair Comparison of Graph Neural Networks for Graph Classificationcited by 244
- 2017Spectral Graph Convolutions for Population-based Disease Predictioncited by 42
- 2023Pitfalls in Link Prediction with Graph Neural Networks: Understanding the Impact of Target-link Inclusion & Better Practicescited by 13
- 2021Pairwise Half-graph Discrimination: A Simple Graph-level Self-supervised Strategy for Pre-training Graph Neural Networkscited by 10
1 more
Built on by
Not cited yet.