mlsanityData to 14 Oct 2026

Understanding the Capabilities of Molecular Graph Neural Networks in Materials Science Through Multimodal Learning and Physical Context Encoding

arXiv 2505.12137 ↗First posted 17 May 2025cs.LG cond-mat.mtrl-scicited by 1

Not on the map. Why?

Abstract (arXiv)

Molecular graph neural networks (GNNs) often focus exclusively on XYZ-based geometric representations and thus overlook valuable chemical context available in public databases like PubChem. This work introduces a multimodal framework that integrates textual descriptors, such as IUPAC names, molecular formulas, physicochemical properties, and synonyms, alongside molecular graphs. A gated fusion mechanism balances geometric and textual features, allowing models to exploit complementary information. Experiments on benchmark datasets indicate that adding textual data yields notable improvements for certain electronic properties, while gains remain limited for others. Furthermore, the GNN architectures display similar performance patterns (improving and deteriorating on analogous targets), suggesting they learn comparable representations rather than distinctly different physical insights.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 64 references that are in the map. First posted on arXiv 17 May 2025.

Builds on

25 of 64 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,919
  3. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  4. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  5. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  6. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
  7. 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
  8. 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
  9. 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
  10. 2023SciBench: Evaluating College-Level Scientific Problem-Solving Abilities of Large Language Modelscited by 256
  11. 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 255
  12. 2020The Open Catalyst 2020 (OC20) Dataset and Community Challengescited by 246
13 more
  1. 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
  2. 2019Ab-Initio Solution of the Many-Electron Schr"odinger Equation with Deep Neural Networkscited by 200
  3. 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 182
  4. 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 156
  5. 2019An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applicationscited by 118
  6. 2022Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questionscited by 116
  7. 2021SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effectscited by 104
  8. 2022The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalystscited by 95
  9. 2023FAENet: Frame Averaging Equivariant GNN for Materials Modelingcited by 73
  10. 2021ForceNet: A Graph Neural Network for Large-Scale Quantum Calculationscited by 58
  11. 2022A Self-Attention Ansatz for Ab-initio Quantum Chemistrycited by 49
  12. 2013Orbital-free Bond Breaking via Machine Learningcited by 8
  13. 2021Physics-informed Neural Network for Nonlinear Dynamics in Fiber Opticscited by 7

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.