Understanding the Capabilities of Molecular Graph Neural Networks in Materials Science Through Multimodal Learning and Physical Context Encoding
Not on the map. Why?
Abstract (arXiv)
Molecular graph neural networks (GNNs) often focus exclusively on XYZ-based geometric representations and thus overlook valuable chemical context available in public databases like PubChem. This work introduces a multimodal framework that integrates textual descriptors, such as IUPAC names, molecular formulas, physicochemical properties, and synonyms, alongside molecular graphs. A gated fusion mechanism balances geometric and textual features, allowing models to exploit complementary information. Experiments on benchmark datasets indicate that adding textual data yields notable improvements for certain electronic properties, while gains remain limited for others. Furthermore, the GNN architectures display similar performance patterns (improving and deteriorating on analogous targets), suggesting they learn comparable representations rather than distinctly different physical insights.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 64 references that are in the map. First posted on arXiv 17 May 2025.
Builds on
25 of 64 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
- 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 256
- 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 255
- 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
13 more
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
- 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 200
- 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 182
- 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 156
- 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
- 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
- 2021SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effectscited by 104
- 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalystscited by 95
- 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 73
- 2021ForceNet: A Graph Neural Network for Large-Scale Quantum Calculationscited by 58
- 2022A Self-Attention Ansatz for Ab-initio Quantum Chemistrycited by 49
- 2013Orbital-free Bond Breaking via Machine Learningcited by 8
- 2021Physics-informed Neural Network for Nonlinear Dynamics in Fiber Opticscited by 7
Built on by
Citing papers per year: 2025: 1.
1 paper.
- 2025xChemAgents: Agentic AI for Explainable Quantum Chemistry26 May 2025