Learning Molecular Representation in a Cell
Not on the map. Why?
Abstract (arXiv)
Predicting drug efficacy and safety in vivo requires information on biological responses (e.g., cell morphology and gene expression) to small molecule perturbations. However, current molecular representation learning methods do not provide a comprehensive view of cell states under these perturbations and struggle to remove noise, hindering model generalization. We introduce the Information Alignment (InfoAlign) approach to learn molecular representations through the information bottleneck method in cells. We integrate molecules and cellular response data as nodes into a context graph, connecting them with weighted edges based on chemical, biological, and computational criteria. For each molecule in a training batch, InfoAlign optimizes the encoder's latent representation with a minimality objective to discard redundant structural information. A sufficiency objective decodes the representation to align with different feature spaces from the molecule's neighborhood in the context graph. We demonstrate that the proposed sufficiency objective for alignment is tighter than existing encoder-based contrastive methods. Empirically, we validate representations from InfoAlign in two downstream applications: molecular property prediction against up to 27 baseline methods across four datasets, plus zero-shot molecule-morphology matching.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 37 of its 70 references that are in the map. First posted on arXiv 17 Jun 2024.
Builds on
37 of 70 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
- 2014DeepWalk: Online Learning of Social Representationscited by 1,547
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
25 more
- 2019Strategies for Pre-training Graph Neural Networkscited by 971
- 2016Deep Variational Information Bottleneckcited by 930
- 2020What Makes for Good Views for Contrastive Learning?cited by 846
- 2019On Variational Bounds of Mutual Informationcited by 559
- 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
- 2021Graph Contrastive Learning Automatedcited by 287
- 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 206
- 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
- 2022Translation between Molecules and Natural Languagecited by 177
- 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
- 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
- 2022SELFIES and the future of molecular string representationscited by 76
- 2022Graph Rationalization with Environment-based Augmentationscited by 70
- 2020MolTrans: Molecular Interaction Transformer for Drug Target Interaction Predictioncited by 65
- 2022Does GNN Pretraining Help Molecular Representation?cited by 60
- 2024Graph Diffusion Transformers for Multi-Conditional Molecular Generationcited by 45
- 2023BioBridge: Bridging Biomedical Foundation Models via Knowledge Graphscited by 25
- 2022Evaluating Self-Supervised Learning for Molecular Graph Embeddingscited by 22
- 2022Graph Self-supervised Learning with Accurate Discrepancy Learningcited by 21
- 2023Data-Centric Learning from Unlabeled Graphs with Diffusion Modelcited by 19
- 2023Motif-aware Attribute Masking for Molecular Graph Pre-trainingcited by 16
- 2023Semi-Supervised Graph Imbalanced Regressioncited by 14
- 2023Molecule-Morphology Contrastive Pretraining for Transferable Molecular Representationcited by 8
- 2023Removing Biases from Molecular Representations via Information Maximizationcited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 3; 2026: 4.
8 papers.
- 2024An Information Criterion for Controlled Disentanglement of Multimodal Datacited by 14
- 2025MolTextNet: A Two-Million Molecule-Text Dataset for Multimodal Molecular Learningcited by 8
- 2025Efficient Cell Painting Image Representation Learning via Cross-Well Aligned Masked Siamese Networkcited by 2
- 2025Learning Cell-Aware Hierarchical Multi-Modal Representations for Robust Molecular Modelingcited by 1
- 2026Intervention-Aware Multiscale Representation Learning from Imaging Phenomics and Perturbation Transcriptomicscited by 0
- 2026PhAME: Phenotype-Aware Molecular Editing via Latent Diffusioncited by 0
- 2026From Cellular Responses to Pharmacological Domains: Multimodal Zero-Shot Drug Representation Learningcited by 0
- 2026CalibHyper: Chance-Corrected Relational Hypergraphs for Few-Shot Molecular Property Predictioncited by 0
- 2026CalibHyper: Chance-Corrected Relational Hypergraphs for Few-Shot Molecular Property Prediction27 Sep 2026
- 2026From Cellular Responses to Pharmacological Domains: Multimodal Zero-Shot Drug Representation Learning28 Jul 2026
- 2026PhAME: Phenotype-Aware Molecular Editing via Latent Diffusion27 May 2026
- 2026Intervention-Aware Multiscale Representation Learning from Imaging Phenomics and Perturbation Transcriptomics19 Apr 2026
- 2025Learning Cell-Aware Hierarchical Multi-Modal Representations for Robust Molecular Modeling26 Nov 2025
- 2025Efficient Cell Painting Image Representation Learning via Cross-Well Aligned Masked Siamese Network24 Sep 2025
- 2025MolTextNet: A Two-Million Molecule-Text Dataset for Multimodal Molecular Learning15 May 2025
- 2024An Information Criterion for Controlled Disentanglement of Multimodal Data31 Oct 2024