mlsanityData to 7 Oct 2026

Reaction Prediction via Interaction Modeling of Symmetric Difference Shingle Sets

arXiv 2511.06356 ↗First posted 9 Nov 2025cs.LG cs.AI q-bio.BMcited by 0

Not on the map. Why?

Abstract (arXiv)

Chemical reaction prediction remains a fundamental challenge in organic chemistry, where existing machine learning models face two critical limitations: sensitivity to input permutations (molecule/atom orderings) and inadequate modeling of substructural interactions governing reactivity. These shortcomings lead to inconsistent predictions and poor generalization to real-world scenarios. To address these challenges, we propose ReaDISH, a novel reaction prediction model that learns permutation-invariant representations while incorporating interaction-aware features. It introduces two innovations: (1) symmetric difference shingle encoding, which extends the differential reaction fingerprint (DRFP) by representing shingles as continuous high-dimensional embeddings, capturing structural changes while eliminating order sensitivity; and (2) geometry-structure interaction attention, a mechanism that models intra- and inter-molecular interactions at the shingle level. Extensive experiments demonstrate that ReaDISH improves reaction prediction performance across diverse benchmarks. It shows enhanced robustness with an average improvement of 8.76% on R2 under permutation perturbations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 63 references that are in the map. First posted on arXiv 9 Nov 2025.

Builds on

15 of 63 references.

References · 15

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  6. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,303
  7. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  8. 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 225
  9. 2020Mapping the Space of Chemical Reactions Using Attention-Based Neural Networkscited by 70
  10. 2021Permutation invariant graph-to-sequence model for template-free retrosynthesis and reaction predictioncited by 66
  11. 2017SMILES Enumeration as Data Augmentation for Neural Network Modeling of Moleculescited by 58
  12. 2021Rotation Invariant Graph Neural Networks using Spin Convolutionscited by 52
3 more
  1. 2021Geometric Transformer for End-to-End Molecule Properties Predictioncited by 8
  2. 2022Rxn Hypergraph: a Hypergraph Attention Model for Chemical Reaction Representationcited by 6
  3. 2025Challenging reaction prediction models to generalize to novel chemistrycited by 6

Built on by

Not cited yet.