Multimodal Molecular Representation Learning with Graph Neural Networks, Deep & Cross Networks, and SMILES Embeddings
Not on the map. Why?
Abstract (arXiv)
Molecular property prediction often relies on isolated data modalities, where continuous 3D graph neural networks (GNNs) struggle to efficiently capture long-range topological dependencies and exact macroscopic heuristics. In this work, we introduce a parameter-efficient Tri-Branch Modular Fusion Neural Network that synthesizes three orthogonal modalities: 3D spatial geometry (SchNet), discrete topological grammar (SMILES via ChemBERTa), and explicit macroscopic physicochemical descriptors (Deep & Cross Network). By bypassing standard scalar readouts and employing a shared late-fusion architecture, the framework establishes a mathematically rigorous multimodal latent space that effectively resolves the arithmetic and oversmoothing limitations of local message passing. We evaluate the proposed architecture on the QM9 benchmark, targeting the extensive thermodynamic property of atomization energy at 0 K (U0atom). Through systematic combinatorial ablation and latent bottleneck optimization (de=64), the tri-modal framework achieves a validation Mean Absolute Error (MAE) of 0.0207 eV. Operating with fewer than one million parameters, this architecture decisively surpasses the sub-chemical accuracy threshold and yields a substantial 20.6% error reduction over a strictly controlled geometric baseline. Ultimately, our findings demonstrate that integrating orthogonal macroscopic and topological data streams provides a synergistic, O(1) physical shortcut. This multimodal alignment offers a highly efficient alternative to brute-force parameter scaling, establishing a robust surrogate model for high-throughput virtual screening (HTVS) pipelines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 26 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
19 of 26 references.
References · 19
- 2017Attention Is All You Needcited by 60,361
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2016Layer Normalizationcited by 5,669
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2020GLU Variants Improve Transformercited by 1,804
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,051
- 2021E(n) Equivariant Graph Neural Networkscited by 965
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 765
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
7 more
- 2017Deep & Cross Network for Ad Click Predictionscited by 393
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
- 2020DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systemscited by 327
- 2020Can Graph Neural Networks Count Substructures?cited by 236
- 2020Machine Learning Force Fieldscited by 207
- 2019Do NLP Models Know Numbers? Probing Numeracy in Embeddingscited by 159
- 2024Multi-Modal Representation Learning for Molecular Property Prediction: Sequence, Graph, Geometrycited by 10
Built on by
Not cited yet.