mlsanityData to 14 Oct 2026

Dynamic language model representations for multi-objective reaction optimisation

arXiv 2609.11790 ↗First posted 10 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Optimising chemical reactions across multiple objectives, such as yield, selectivity, and safety, is central to chemical synthesis, and model-driven approaches depend critically on how reaction components are represented. Established featurisations are either chemically uninformative, as with one-hot encodings, or, as with molecular descriptors, do not readily extend across chemically distinct components. For structurally and functionally diverse components, it is therefore unclear what a shared representation should contain. Constructing such a representation is itself a challenging research undertaking that must be revisited for each new reaction system. Here we bypass this step by learning the reaction representation dynamically from text. Textual descriptions of reaction conditions are encoded by a fine-tuned language model trained jointly with Gaussian process surrogates, yielding task-adaptive representations within a multi-objective Bayesian optimisation loop. Across nickel- and palladium-catalysed cross-couplings in both sequential and parallel experimentation regimes, this approach reaches optimisation convergence in fewer experiments than descriptor libraries or one-hot encoding. Applied prospectively to a palladium-catalysed cyanation spanning mixed ligand denticity and heterogeneous additives, and to a three-objective asymmetric hydrogenation across chiral iridium and ruthenium catalyst families, two rounds of high-throughput experimentation (192 reactions, under 3% of each design space) delivered conditions translating directly to gram scale in 94% and 84% isolated yield, the latter at 99.6% enantiomeric excess.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 90 references that are in the map. First posted on arXiv 10 Sep 2026.

Builds on

16 of 90 references.

References · 16

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2024Qwen2 Technical Reportcited by 2,120
  6. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 631
  7. 2018GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Accelerationcited by 609
  8. 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
  9. 2021Large-Scale Chemical Language Representations Capture Molecular Structure and Propertiescited by 206
  10. 2020Differentiable Expected Hypervolume Improvement for Parallel Multi-Objective Bayesian Optimizationcited by 179
  11. 2023Unexpected Improvements to Expected Improvement for Bayesian Optimizationcited by 149
  12. 2021Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvementcited by 118
4 more
  1. 2023Unifying Molecular and Textual Representations via Multi-task Language Modellingcited by 93
  2. 2025Chemical reasoning in LLMs unlocks strategy-aware synthesis planning and reaction mechanism elucidationcited by 17
  3. 2025Large language models as uncertainty-calibrated optimizers for experimental discoverycited by 13
  4. 2026Bi-semantic Chemical Embedder for Joint Representation Learning of SMILES and Natural Languagecited by 1

Built on by

Not cited yet.