Structure-Aware Fusion with Progressive Injection for Multimodal Molecular Representation Learning
Not on the map. Why?
Abstract (arXiv)
Multimodal molecular models often suffer from 3D conformer unreliability and modality collapse, limiting their robustness and generalization. We propose MuMo, a structured multimodal fusion framework that addresses these challenges in molecular representation through two key strategies. To reduce the instability of conformer-dependent fusion, we design a Structured Fusion Pipeline (SFP) that combines 2D topology and 3D geometry into a unified and stable structural prior. To mitigate modality collapse caused by naive fusion, we introduce a Progressive Injection (PI) mechanism that asymmetrically integrates this prior into the sequence stream, preserving modality-specific modeling while enabling cross-modal enrichment. Built on a state space backbone, MuMo supports long-range dependency modeling and robust information propagation. Across 29 benchmark tasks from Therapeutics Data Commons (TDC) and MoleculeNet, MuMo achieves an average improvement of 2.7% over the best-performing baseline on each task, ranking first on 22 of them, including a 27% improvement on the LD50 task. These results validate its robustness to 3D conformer noise and the effectiveness of multimodal fusion in molecular representation. The code is available at: github.com/selmiss/MuMo.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 53 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
23 of 53 references.
References · 23
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
- 2019Strategies for Pre-training Graph Neural Networkscited by 964
- 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
- 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
- 2020Directional Message Passing for Molecular Graphscited by 556
- 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
- 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
11 more
- 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 203
- 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
- 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 123
- 2020Molecular representation learning with language models and domain-relevant auxiliary taskscited by 91
- 2020Accelerating high-throughput virtual screening through molecular pool-based active learningcited by 59
- 2022FP-GNN: a versatile deep learning architecture for enhanced molecular property predictioncited by 31
- 2020Molecular machine learning with conformer ensemblescited by 27
- 2024Uni-Mol2: Exploring Molecular Pretraining Model at Scalecited by 20
- 2023MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Predictioncited by 4
- 2024Pre-trained Molecular Language Models with Random Functional Group Maskingcited by 2
- 2025The impact of conformer quality on learned representations of molecular conformer ensemblescited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.