mlsanityData to 14 Oct 2026

Learned, Relied Upon, or Necessary? Separating Checkpoint Dependence from Task-Level Value in Sheaf GNNs

arXiv 2607.25387 ↗First posted 28 Jul 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Learned restriction maps in sheaf graph neural networks are often treated as proof that the model has discovered useful edge geometry. That conclusion does not follow from parameter movement or from a post-hoc ablation: both can show how one checkpoint is organized while leaving open whether learned transport still helps after the rest of the model adapts. We separate these claims with two estimands. Checkpoint reliance intervenes on the maps of a fixed predictor; protocol-relative replacement retrains matched families that remove map capacity, edge variation, or persistent edge assignment. A task-null theorem shows why the claims can diverge: labels identify only the transported classifier directions, leaving d2-d invisible degrees of freedom in every full d× d map. An exact frame model then gives the boundary at which reliance becomes unreplaced task value. Label-only training realizes the predicted separation, while audits of public NSD, DNSD, and Directed Sheaf Neural Network (DSNN) implementations recover both replaceable and unreplaced transport regimes on real graphs. All five DNSD benchmarks exhibit fixed-checkpoint reliance. After retraining, assignment-breaking or shared-map controls recover Full performance on four; Roman-Empire retains a .0675 advantage over continually resampled assignment and a .0391 advantage over a parameter-matched shared map across ten official splits. Thus, a learned map can govern a fitted computation without constituting indispensable edge geometry. Claims of learned transport should pair checkpoint interventions with matched retraining.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 23 references that are in the map. First posted on arXiv 28 Jul 2026.

Builds on

15 of 23 references.

References · 15

  1. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  2. 2018A Benchmark for Interpretability Methods in Deep Neural Networkscited by 476
  3. 2018All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneouslycited by 373
  4. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
  5. 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
  6. 2020Sheaf Neural Networkscited by 84
  7. 2022Sheaf Neural Networks with Connection Laplacianscited by 65
  8. 2023Tangent Bundle Convolutional Learning: from Manifolds to Cellular Sheaves and Backcited by 22
  9. 2025Cooperative Sheaf Neural Networkscited by 12
  10. 2024Joint Diffusion Processes as an Inductive Bias in Sheaf Neural Networkscited by 9
  11. 2025Polynomial Neural Sheaf Diffusion: A Spectral Filtering Approach on Cellular Sheavescited by 9
  12. 2025Learning Sheaf Laplacian Optimizing Restriction Mapscited by 7
3 more
  1. 2026On the Necessity of Learnable Sheaf Laplacianscited by 5
  2. 2025Sheaf Graph Neural Networks via PAC-Bayes Spectral Optimizationcited by 2
  3. 2026Oversmoothing as Representation Degeneracy in Neural Sheaf Diffusioncited by 1

Built on by

Not cited yet.