PolyCL: Contrastive Learning for Polymer Representation Learning via Explicit and Implicit Augmentations
Not on the map. Why?
Abstract (arXiv)
Polymers play a crucial role in a wide array of applications due to their diverse and tunable properties. Establishing the relationship between polymer representations and their properties is crucial to the computational design and screening of potential polymers via machine learning. The quality of the representation significantly influences the effectiveness of these computational methods. Here, we present a self-supervised contrastive learning paradigm, PolyCL, for learning high-quality polymer representation without the need for labels. Our model combines explicit and implicit augmentation strategies for improved learning performance. The results demonstrate that our model achieves either better, or highly competitive, performances on transfer learning tasks as a feature extractor without an overcomplicated training strategy or hyperparameter optimisation. Further enhancing the efficacy of our model, we conducted extensive analyses on various augmentation combinations used in contrastive learning. This led to identifying the most effective combination to maximise PolyCL's performance.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 30 of its 58 references that are in the map. First posted on arXiv 14 Aug 2024.
Builds on
30 of 58 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,434
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
- 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
- 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,405
18 more
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2019Strategies for Pre-training Graph Neural Networkscited by 971
- 2020What Makes for Good Views for Contrastive Learning?cited by 846
- 2019InfoGraph: Unsupervised and Semi-supervised Graph-Level Representation Learning via Mutual Information Maximizationcited by 441
- 2018Rethinking ImageNet Pre-trainingcited by 377
- 2023A Cookbook of Self-Supervised Learningcited by 250
- 2022SimGRACE: A Simple Framework for Graph Contrastive Learning without Data Augmentationcited by 171
- 2022Multi-modal Molecule Structure-text Model for Text-based Retrieval and Editingcited by 166
- 2021AutoGCL: Automated Graph Contrastive Learning via Learnable View Generatorscited by 73
- 2022polyBERT: A chemical language model to enable fully machine-driven ultrafast polymer informaticscited by 48
- 2022TransPolymer: a Transformer-based language model for polymer property predictionscited by 43
- 2021Mutual Contrastive Learning for Visual Representation Learningcited by 42
- 2020Polymer Informatics with Multi-Task Learningcited by 29
- 2020Polymer Informatics: Current Status and Critical Next Stepscited by 29
- 2022MOFormer: Self-Supervised Transformer model for Metal-Organic Framework Property Predictioncited by 28
- 2021A Study of the Generalizability of Self-Supervised Representationscited by 18
- 2021Multilingual Molecular Representation Learning via Contrastive Pre-trainingcited by 12
- 2018Graph Convolutional Neural Networks for Polymers Property Predictioncited by 9
Built on by
Citing papers per year: 2025: 4; 2026: 3.
7 papers.
- 2026Tabular foundation models for in-context prediction of molecular propertiescited by 6
- 2025Joint Embedding Predictive Architecture for self-supervised pretraining on polymer molecular graphscited by 1
- 2025Multi-modal cascade feature transfer for polymer property predictioncited by 0
- 2025Chemistry Integrated Language Model using Hierarchical Molecular Representation for Polymer Informaticscited by 0
- 2025PolySet: Restoring the Statistical Ensemble Nature of Polymers for Machine Learningcited by 0
- 2026PolyMon: A Unified Framework for Polymer Property Predictioncited by 0
- 2026PolyFusionAgent: A Multimodal Foundation Model and Autonomous AI Assistant for Polymer Property Prediction and Inverse Designcited by 0
- 2026PolyFusionAgent: A Multimodal Foundation Model and Autonomous AI Assistant for Polymer Property Prediction and Inverse Design26 May 2026
- 2026Tabular foundation models for in-context prediction of molecular properties17 Apr 2026
- 2026PolyMon: A Unified Framework for Polymer Property Prediction2 Mar 2026
- 2025PolySet: Restoring the Statistical Ensemble Nature of Polymers for Machine Learning15 Dec 2025
- 2025Chemistry Integrated Language Model using Hierarchical Molecular Representation for Polymer Informatics6 Dec 2025
- 2025Joint Embedding Predictive Architecture for self-supervised pretraining on polymer molecular graphs22 Jun 2025
- 2025Multi-modal cascade feature transfer for polymer property prediction6 May 2025