mlsanityData to 14 Oct 2026

PATTERN Can Be Solved from Memory: Generator-Aware Baselines for Synthetic Node Classification

arXiv 2610.15020 ↗First posted 10 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

PATTERN, a synthetic node-classification benchmark still used to rank graph networks, plants a random subgraph in a random host graph and asks which nodes belong to it. Its generator draws 100 patterns once and plants the same ones in every split, so each test graph carries a pattern that also appears in 100 training graphs. A matcher that reads these patterns off the training labels and looks them up in each test graph reaches 99.2 class-weighted accuracy with no trained parameters, against 89.8 for the best published model. Inference under the generator without the patterns reaches 86.8. Two published models, CKGConv and GRIT, score lower on patterns they have not seen: on new graphs with fresh patterns both fall below this pattern-blind predictor, and withholding patterns from CKGConv's training lowers its accuracy on the test graphs that carry them. Training CKGConv with a new pattern in every graph raises its accuracy on fresh patterns by about 2 points, to the level of the pattern-blind predictor, at some cost on the reused patterns. The same kind of inference under the generator matches the best published result on CLUSTER and, without any training, scores above every published result we found on Minesweeper's released board. We recommend that synthetic benchmarks report scores on fresh templates beside reused ones, publish baselines built from their generators, and state how their metric is weighted and pooled.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 52 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

38 of 52 references.

References · 38

  1. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  2. 2020Shortcut Learning in Deep Neural Networkscited by 1,969
  3. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
  4. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  5. 2020Benchmarking Graph Neural Networkscited by 680
  6. 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
  7. 2023A critical look at the evaluation of GNNs under heterophily: Are we really making progress?cited by 343
  8. 2017Community Detection and Stochastic Block Modelscited by 319
  9. 2022Structure-Aware Transformer for Graph Representation Learningcited by 194
  10. 2023Exphormer: Sparse Transformers for Graphscited by 170
  11. 2023Graph Inductive Biases in Transformers without Message Passingcited by 153
  12. 2020Question and Answer Test-Train Overlap in Open-Domain Question Answering Datasetscited by 138
26 more
  1. 2020Directional Graph Networkscited by 133
  2. 2021Global Self-Attention as a Replacement for Graph Convolutioncited by 114
  3. 2019Rank-normalization, folding, and localization: An improved widehatR for assessing convergence of MCMCcited by 93
  4. 2022GRPE: Relative Positional Encoding for Graph Transformercited by 70
  5. 2019Do We Train on Test Data? Purging CIFAR of Near-Duplicatescited by 62
  6. 2025Position: Graph Learning Will Lose Relevance Due To Poor Benchmarkscited by 53
  7. 2023Learning Probabilistic Symmetrization for Architecture Agnostic Equivariancecited by 26
  8. 2025Can Classic GNNs Be Strong Baselines for Graph-level Tasks? Simple Architectures Meet Excellencecited by 26
  9. 2019Understanding Isomorphism Bias in Graph Data Setscited by 23
  10. 2023Are More Layers Beneficial to Graph Transformers?cited by 15
  11. 2022Taxonomy of Benchmarks in Graph Representation Learningcited by 12
  12. 2023Optimal Inference in Contextual Stochastic Block Modelscited by 12
  13. 2024Joint Graph Rewiring and Feature Denoising via Spectral Resonancecited by 12
  14. 2025Cooperative Sheaf Neural Networkscited by 12
  15. 2024Gradformer: Graph Transformer with Exponential Decaycited by 11
  16. 2014Phase transitions in semisupervised clustering of sparse networkscited by 5
  17. 2024CKGConv: General Graph Convolution with Continuous Kernelscited by 5
  18. 2026Fixed Aggregation Features Can Rival GNNscited by 4
  19. 2023Graphtester: Exploring Theoretical Boundaries of GNNs on Graph Datasetscited by 3
  20. 2025Plain Transformers Can be Powerful Graph Learnerscited by 3
  21. 2019Factored Probabilistic Belief Trackingcited by 2
  22. 2024Greener GRASS: Enhancing GNNs with Encoding, Rewiring, and Attentioncited by 2
  23. 2025Graph Alignment for Benchmarking Graph Neural Networks and Learning Positional Encodingscited by 2
  24. 2025GraphTARIF: Linear Graph Transformer with Augmented Rank and Improved Focuscited by 2
  25. 2022Bridging Graph Position Encodings for Transformers with Weighted Graph-Walking Automatacited by 1
  26. 2026Swarm-Inspired Generation of Collective Behaviors in Graph Dynamical Systemscited by 1

Built on by

Not cited yet.