Measuring trainable degrees of freedom in materials graph neural networks: a random-subspace intrinsic dimension analysis
Not on the map. Why?
Abstract (arXiv)
Final predictive accuracy is the standard basis for comparing graph neural networks (GNNs) in materials-property prediction, but it does not show how strongly performance depends on access to trainable parameter-space directions. Here, we introduce trainable-degree dependence as a complementary characterization of materials GNN learning. Using random-subspace intrinsic-dimension analysis, we train CGCNN, ALIGNN, and DimeNet++ in randomly oriented parameter subspaces across six prediction tasks and measure how performance recovers as independent trainable degrees of freedom are restored. The resulting recovery curves separate endpoint accuracy from the trainable-dimensional demand required to recover it. They reveal distinctions that final errors alone miss: metallic classification and log-bulk-modulus regression recover near-reference performance from small fractional subspaces, formation-energy and band-gap prediction show stronger architecture dependence, and phonon prediction is most sensitive to dimensional restriction. Dataset-size sweeps show that band-gap models require larger fractional subspaces as training data grows, whereas formation-energy and bulk-modulus responses are more stable. A width sweep shows that fractional thresholds can remain stable while absolute threshold dimensions increase with model size. Random-subspace analysis therefore provides a targeted stress test for how materials GNNs use their optimization space.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
9 of 30 references.
References · 9
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
- 2017Learning Efficient Convolutional Networks through Network Slimmingcited by 676
- 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 672
- 2018Measuring the Intrinsic Dimension of Objective Landscapescited by 370
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 255
- 2022Graph neural networks for materials science and chemistrycited by 182
- 2022Periodic Graph Transformers for Crystal Material Property Predictioncited by 87
- 2024Structure-based out-of-distribution (OOD) materials property prediction: a benchmark studycited by 17
- 2022ET-AL: Entropy-Targeted Active Learning for Bias Mitigation in Materials Datacited by 6
Built on by
Not cited yet.