mlsanityData to 7 Oct 2026

A smile is all you need: Predicting limiting activity coefficients from SMILES with natural language processing

arXiv 2206.07048 ↗First posted 15 Jun 2022physics.chem-ph cs.CL cs.LGcited by 19

Not on the map. Why?

Abstract (arXiv)

Knowledge of mixtures' phase equilibria is crucial in nature and technical chemistry. Phase equilibria calculations of mixtures require activity coefficients. However, experimental data on activity coefficients is often limited due to high cost of experiments. For an accurate and efficient prediction of activity coefficients, machine learning approaches have been recently developed. However, current machine learning approaches still extrapolate poorly for activity coefficients of unknown molecules. In this work, we introduce the SMILES-to-Properties-Transformer (SPT), a natural language processing network to predict binary limiting activity coefficients from SMILES codes. To overcome the limitations of available experimental data, we initially train our network on a large dataset of synthetic data sampled from COSMO-RS (10 Million data points) and then fine-tune the model on experimental data (20 870 data points). This training strategy enables SPT to accurately predict limiting activity coefficients even for unknown molecules, cutting the mean prediction error in half compared to state-of-the-art models for activity coefficient predictions such as COSMO-RS, UNIFAC, and improving on recent machine learning approaches.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 10 of its 38 references that are in the map. First posted on arXiv 15 Jun 2022.

Builds on

10 of 38 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2020On Layer Normalization in the Transformer Architecturecited by 906
  5. 2018Image Transformercited by 770
  6. 2019SMILES Transformer: Pre-trained Molecular Fingerprint for Low Data Drug Discoverycited by 89
  7. 2017SMILES Enumeration as Data Augmentation for Neural Network Modeling of Moleculescited by 58
  8. 2021Generative Chemical Transformer: Neural Machine Learning of Molecular Geometric Structures from Chemical Language via Attentioncited by 20
  9. 2020Machine Learning in Thermodynamics: Prediction of Activity Coefficients by Matrix Completioncited by 19
  10. 2020Predicting Chemical Properties using Self-Attention Multi-task Learning based on SMILES Representationcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 0; 2024: 7; 2025: 7; 2026: 2.

19 papers.

Sort:

By area:

  1. 2024HANNA: Hard-constraint Neural Network for Consistent Activity Coefficient Predictioncited by 17
  2. 2022Graph Neural Networks for Temperature-Dependent Activity Coefficient Prediction of Solutes in Ionic Liquidscited by 14
  3. 2024From Words to Molecules: A Survey of Large Language Models in Chemistrycited by 14
  4. 2022Gibbs-Helmholtz Graph Neural Network: capturing the temperature dependency of activity coefficients at infinite dilutioncited by 12
  5. 2024Thermodynamics-Consistent Graph Neural Networkscited by 12
  6. 2022SPT-NRTL: A physics-guided machine learning model to predict thermodynamically consistent activity coefficientscited by 11
  7. 2025Artificial Intelligence and Generative Models for Materials Discovery -- A Reviewcited by 8
  8. 2025A Survey of AI for Materials Science: Foundation Models, LLM Agents, Datasets, and Toolscited by 7
  9. 2024Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Surveycited by 6
  10. 2024GraphXForm: Graph transformer for computer-aided molecular designcited by 6
  11. 2025Molecular Machine Learning in Chemical Process Designcited by 5
  12. 2024Hierarchical Matrix Completion for the Prediction of Properties of Binary Mixturescited by 4
7 more
  1. 2025Federated Learning from Molecules to Processes: A Perspectivecited by 2
  2. 2026Differentiable Thermodynamic Phase-Equilibria for Machine Learningcited by 1
  3. 2024When SMILES have Language: Drug Classification using Text Classification Methods on Drug SMILES Stringscited by 0
  4. 2025MLPROP -- an open interactive web interface for thermophysical property prediction with machine learningcited by 0
  5. 2025Data-Driven Extended Corresponding State Approach for Residual Property Prediction of Hydrofluoroolefinscited by 0
  6. 2025DeepEOSNet: Capturing the dependency on thermodynamic state in property prediction taskscited by 0
  7. 2026A Systematic Evaluation of Molecular Mixture Behavior Predictioncited by 0