Enhancing Peak Assignment in 13C NMR Spectroscopy: A Novel Approach Using Multimodal Alignment
Not on the map. Why?
Abstract (arXiv)
Nuclear magnetic resonance (NMR) spectroscopy plays an essential role in deciphering molecular structure and dynamic behaviors. While AI-enhanced NMR prediction models hold promise, challenges still persist in tasks such as molecular retrieval, isomer recognition, and peak assignment. In response, this paper introduces a novel solution, Multi-Level Multimodal Alignment with Knowledge-Guided Instance-Wise Discrimination (K-M3AID), which establishes correspondences between two heterogeneous modalities: molecular graphs and NMR spectra. K-M3AID employs a dual-coordinated contrastive learning architecture with three key modules: a graph-level alignment module, a node-level alignment module, and a communication channel. Notably, K-M3AID introduces knowledge-guided instance-wise discrimination into contrastive learning within the node-level alignment module. In addition, K-M3AID demonstrates that skills acquired during node-level alignment have a positive impact on graph-level alignment, acknowledging meta-learning as an inherent property. Empirical validation underscores K-M3AID's effectiveness in multiple zero-shot tasks.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 22 of its 43 references that are in the map. First posted on arXiv 23 Nov 2023.
Builds on
22 of 43 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 968
- 2020Self-supervised Learning: Generative or Contrastivecited by 694
- 2020A Survey on Contrastive Self-supervised Learningcited by 554
- 2020Graph Neural Networks in Recommender Systems: A Surveycited by 494
- 2021Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigmcited by 405
- 2020Keystroke Dynamics as Part of Lifeloggingcited by 334
10 more
- 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
- 2018Meta-Learning: A Surveycited by 256
- 2020UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive Learningcited by 239
- 2020Audio-Visual Instance Discrimination with Cross-Modal Agreementcited by 195
- 2019Analyzing and Improving Representations with the Soft Nearest Neighbor Losscited by 95
- 2021CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representationscited by 72
- 2017Deep Cross-Modal Audio-Visual Generationcited by 63
- 2018Towards a universal neural network encoder for time seriescited by 28
- 2020Review and Prospect: Deep Learning in Nuclear Magnetic Resonance Spectroscopycited by 17
- 2020Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignmentcited by 16
Built on by
Citing papers per year: 2024: 1.
1 paper.