# Learned, Relied Upon, or Necessary? Separating Checkpoint Dependence from Task-Level Value in Sheaf GNNs

arXiv: https://arxiv.org/abs/2607.25387 · HTML: https://mlsanity.com/paper/2607.25387/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 15 of its 23 references that are in the map.
- First posted on arXiv 28 Jul 2026.

## Builds on (most cited first, 15 of 15)

- [Fast Graph Representation Learning with PyTorch Geometric](https://mlsanity.com/paper/1903.02428/) (2019)
- [A Benchmark for Interpretability Methods in Deep Neural Networks](https://mlsanity.com/paper/1806.10758/) (2018)
- [All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously](https://mlsanity.com/paper/1801.01489/) (2018)
- [A critical look at the evaluation of GNNs under heterophily: Are we really making progress?](https://mlsanity.com/paper/2302.11640/) (2023)
- [Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNs](https://mlsanity.com/paper/2202.04579/) (2022)
- [Sheaf Neural Networks](https://mlsanity.com/paper/2012.06333/) (2020)
- [Sheaf Neural Networks with Connection Laplacians](https://mlsanity.com/paper/2206.08702/) (2022)
- [Tangent Bundle Convolutional Learning: from Manifolds to Cellular Sheaves and Back](https://mlsanity.com/paper/2303.11323/) (2023)
- [Cooperative Sheaf Neural Networks](https://mlsanity.com/paper/2507.00647/) (2025)
- [Joint Diffusion Processes as an Inductive Bias in Sheaf Neural Networks](https://mlsanity.com/paper/2407.20597/) (2024)
- [Polynomial Neural Sheaf Diffusion: A Spectral Filtering Approach on Cellular Sheaves](https://mlsanity.com/paper/2512.00242/) (2025)
- [Learning Sheaf Laplacian Optimizing Restriction Maps](https://mlsanity.com/paper/2501.19207/) (2025)
- [On the Necessity of Learnable Sheaf Laplacians](https://mlsanity.com/paper/2603.05395/) (2026)
- [Sheaf Graph Neural Networks via PAC-Bayes Spectral Optimization](https://mlsanity.com/paper/2508.00357/) (2025)
- [Oversmoothing as Representation Degeneracy in Neural Sheaf Diffusion](https://mlsanity.com/paper/2605.11178/) (2026)

## Abstract (arXiv)

Learned restriction maps in sheaf graph neural networks are often treated as proof that the model has discovered useful edge geometry. That conclusion does not follow from parameter movement or from a post-hoc ablation: both can show how one checkpoint is organized while leaving open whether learned transport still helps after the rest of the model adapts. We separate these claims with two estimands. Checkpoint reliance intervenes on the maps of a fixed predictor; protocol-relative replacement retrains matched families that remove map capacity, edge variation, or persistent edge assignment. A task-null theorem shows why the claims can diverge: labels identify only the transported classifier directions, leaving d2-d invisible degrees of freedom in every full d× d map. An exact frame model then gives the boundary at which reliance becomes unreplaced task value. Label-only training realizes the predicted separation, while audits of public NSD, DNSD, and Directed Sheaf Neural Network (DSNN) implementations recover both replaceable and unreplaced transport regimes on real graphs. All five DNSD benchmarks exhibit fixed-checkpoint reliance. After retraining, assignment-breaking or shared-map controls recover Full performance on four; Roman-Empire retains a .0675 advantage over continually resampled assignment and a .0391 advantage over a parameter-matched shared map across ten official splits. Thus, a learned map can govern a fitted computation without constituting indispensable edge geometry. Claims of learned transport should pair checkpoint interventions with matched retraining.
