mlsanityData to 14 Oct 2026

PolyCL: Contrastive Learning for Polymer Representation Learning via Explicit and Implicit Augmentations

arXiv 2408.07556 ↗First posted 14 Aug 2024cs.LGcited by 7

Not on the map. Why?

Abstract (arXiv)

Polymers play a crucial role in a wide array of applications due to their diverse and tunable properties. Establishing the relationship between polymer representations and their properties is crucial to the computational design and screening of potential polymers via machine learning. The quality of the representation significantly influences the effectiveness of these computational methods. Here, we present a self-supervised contrastive learning paradigm, PolyCL, for learning high-quality polymer representation without the need for labels. Our model combines explicit and implicit augmentation strategies for improved learning performance. The results demonstrate that our model achieves either better, or highly competitive, performances on transfer learning tasks as a feature extractor without an overcomplicated training strategy or hyperparameter optimisation. Further enhancing the efficacy of our model, we conducted extensive analyses on various augmentation combinations used in contrastive learning. This led to identifying the most effective combination to maximise PolyCL's performance.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 30 of its 58 references that are in the map. First posted on arXiv 14 Aug 2024.

Builds on

30 of 58 references.

References · 30

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  6. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  7. 2018How Powerful are Graph Neural Networks?cited by 4,393
  8. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
  9. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  10. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  11. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
  12. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
18 more
  1. 2020Graph Contrastive Learning with Augmentationscited by 1,208
  2. 2019Strategies for Pre-training Graph Neural Networkscited by 971
  3. 2020What Makes for Good Views for Contrastive Learning?cited by 846
  4. 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
  5. 2018Rethinking ImageNet Pre-trainingcited by 377
  6. 2023A Cookbook of Self-Supervised Learningcited by 250
  7. 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
  8. 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
  9. 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
  10. 2022polyBERT: A chemical language model to enable fully machine-driven ultrafast polymer informaticscited by 48
  11. 2022TransPolymer: a Transformer-based language model for polymer property predictionscited by 43
  12. 2021Mutual Contrastive Learning for Visual Representation Learningcited by 42
  13. 2020Polymer Informatics with Multi-Task Learningcited by 29
  14. 2020Polymer Informatics: Current Status and Critical Next Stepscited by 29
  15. 2022MOFormer: Self-Supervised Transformer model for Metal-Organic Framework Property Predictioncited by 28
  16. 2021A Study of the Generalizability of Self-Supervised Representationscited by 18
  17. 2021Multilingual Molecular Representation Learning via Contrastive Pre-trainingcited by 12
  18. 2018Graph Convolutional Neural Networks for Polymers Property Predictioncited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 3.

7 papers.