mlsanityData to 14 Oct 2026

Learning Molecular Representation in a Cell

arXiv 2406.12056 ↗First posted 17 Jun 2024cs.LG q-bio.QMcited by 8

Not on the map. Why?

Abstract (arXiv)

Predicting drug efficacy and safety in vivo requires information on biological responses (e.g., cell morphology and gene expression) to small molecule perturbations. However, current molecular representation learning methods do not provide a comprehensive view of cell states under these perturbations and struggle to remove noise, hindering model generalization. We introduce the Information Alignment (InfoAlign) approach to learn molecular representations through the information bottleneck method in cells. We integrate molecules and cellular response data as nodes into a context graph, connecting them with weighted edges based on chemical, biological, and computational criteria. For each molecule in a training batch, InfoAlign optimizes the encoder's latent representation with a minimality objective to discard redundant structural information. A sufficiency objective decodes the representation to align with different feature spaces from the molecule's neighborhood in the context graph. We demonstrate that the proposed sufficiency objective for alignment is tighter than existing encoder-based contrastive methods. Empirically, we validate representations from InfoAlign in two downstream applications: molecular property prediction against up to 27 baseline methods across four datasets, plus zero-shot molecule-morphology matching.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 37 of its 70 references that are in the map. First posted on arXiv 17 Jun 2024.

Builds on

37 of 70 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2018How Powerful are Graph Neural Networks?cited by 4,393
  9. 2020Open Graph Benchmark: Datasets for Machine Learning on Graphscited by 2,163
  10. 2014DeepWalk: Online Learning of Social Representationscited by 1,547
  11. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  12. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,175
25 more
  1. 2019Strategies for Pre-training Graph Neural Networkscited by 971
  2. 2016Deep Variational Information Bottleneckcited by 930
  3. 2020What Makes for Good Views for Contrastive Learning?cited by 846
  4. 2019On Variational Bounds of Mutual Informationcited by 559
  5. 2022GraphMAE: Self-Supervised Masked Graph Autoencoderscited by 448
  6. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
  7. 2021Graph Contrastive Learning Automatedcited by 287
  8. 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 206
  9. 2023Large Language Models on Graphs: A Comprehensive Surveycited by 192
  10. 2022Translation between Molecules and Natural Languagecited by 177
  11. 2021Motif-based Graph Self-Supervised Learning for Molecular Property Predictioncited by 159
  12. 2021Self-supervised Graph-level Representation Learning with Local and Global Structurecited by 125
  13. 2022SELFIES and the future of molecular string representationscited by 76
  14. 2022Graph Rationalization with Environment-based Augmentationscited by 70
  15. 2020MolTrans: Molecular Interaction Transformer for Drug Target Interaction Predictioncited by 65
  16. 2022Does GNN Pretraining Help Molecular Representation?cited by 60
  17. 2024Graph Diffusion Transformers for Multi-Conditional Molecular Generationcited by 45
  18. 2023BioBridge: Bridging Biomedical Foundation Models via Knowledge Graphscited by 25
  19. 2022Evaluating Self-Supervised Learning for Molecular Graph Embeddingscited by 22
  20. 2022Graph Self-supervised Learning with Accurate Discrepancy Learningcited by 21
  21. 2023Data-Centric Learning from Unlabeled Graphs with Diffusion Modelcited by 19
  22. 2023Motif-aware Attribute Masking for Molecular Graph Pre-trainingcited by 16
  23. 2023Semi-Supervised Graph Imbalanced Regressioncited by 14
  24. 2023Molecule-Morphology Contrastive Pretraining for Transferable Molecular Representationcited by 8
  25. 2023Removing Biases from Molecular Representations via Information Maximizationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 4.

8 papers.