mlsanityData to 7 Oct 2026

Structure-Aware Fusion with Progressive Injection for Multimodal Molecular Representation Learning

arXiv 2510.23640 ↗First posted 24 Oct 2025cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Multimodal molecular models often suffer from 3D conformer unreliability and modality collapse, limiting their robustness and generalization. We propose MuMo, a structured multimodal fusion framework that addresses these challenges in molecular representation through two key strategies. To reduce the instability of conformer-dependent fusion, we design a Structured Fusion Pipeline (SFP) that combines 2D topology and 3D geometry into a unified and stable structural prior. To mitigate modality collapse caused by naive fusion, we introduce a Progressive Injection (PI) mechanism that asymmetrically integrates this prior into the sequence stream, preserving modality-specific modeling while enabling cross-modal enrichment. Built on a state space backbone, MuMo supports long-range dependency modeling and robust information propagation. Across 29 benchmark tasks from Therapeutics Data Commons (TDC) and MoleculeNet, MuMo achieves an average improvement of 2.7% over the best-performing baseline on each task, ranking first on 22 of them, including a 27% improvement on the LD50 task. These results validate its robustness to 3D conformer noise and the effectiveness of multimodal fusion in molecular representation. The code is available at: github.com/selmiss/MuMo.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 53 references that are in the map. First posted on arXiv 24 Oct 2025.

Builds on

23 of 53 references.

References · 23

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  4. 2017MoleculeNet: A Benchmark for Molecular Machine Learningcited by 1,037
  5. 2019Strategies for Pre-training Graph Neural Networkscited by 964
  6. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  7. 2016Automatic chemical design using a data-driven continuous representation of moleculescited by 762
  8. 2020Directional Message Passing for Molecular Graphscited by 556
  9. 2019Analyzing Learned Molecular Representations for Property Predictioncited by 373
  10. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 332
  11. 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 258
  12. 2021Pre-training Molecular Graph Representation with 3D Geometrycited by 248
11 more
  1. 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 203
  2. 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
  3. 2022ChemBERTa-2: Towards Chemical Foundation Modelscited by 123
  4. 2020Molecular representation learning with language models and domain-relevant auxiliary taskscited by 91
  5. 2020Accelerating high-throughput virtual screening through molecular pool-based active learningcited by 59
  6. 2022FP-GNN: a versatile deep learning architecture for enhanced molecular property predictioncited by 31
  7. 2020Molecular machine learning with conformer ensemblescited by 27
  8. 2024Uni-Mol2: Exploring Molecular Pretraining Model at Scalecited by 20
  9. 2023MolKD: Distilling Cross-Modal Knowledge in Chemical Reactions for Molecular Property Predictioncited by 4
  10. 2024Pre-trained Molecular Language Models with Random Functional Group Maskingcited by 2
  11. 2025The impact of conformer quality on learned representations of molecular conformer ensemblescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.