Tokenizing Electron Cloud in Protein-Ligand Interaction Learning
Not on the map. Why?
Abstract (arXiv)
The affinity and specificity of protein-molecule binding directly impact functional outcomes, uncovering the mechanisms underlying biological regulation and signal transduction. Most deep-learning-based prediction approaches focus on structures of atoms or fragments. However, quantum chemical properties, such as electronic structures, are the key to unveiling interaction patterns but remain largely underexplored. To bridge this gap, we propose ECBind, a method for tokenizing electron cloud signals into quantized embeddings, enabling their integration into downstream tasks such as binding affinity prediction. By incorporating electron densities, ECBind helps uncover binding modes that cannot be fully represented by atom-level models. Specifically, to remove the redundancy inherent in electron cloud signals, a structure-aware transformer and hierarchical codebooks encode 3D binding sites enriched with electron structures into tokens. These tokenized codes are then used for specific tasks with labels. To extend its applicability to a wider range of scenarios, we utilize knowledge distillation to develop an electron-cloud-agnostic prediction model. Experimentally, ECBind demonstrates state-of-the-art performance across multiple tasks, achieving improvements of 6.42% and 15.58% in per-structure Pearson and Spearman correlation coefficients, respectively.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 43 of its 76 references that are in the map. First posted on arXiv 25 May 2025.
Builds on
43 of 76 references.
References · 43
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 734
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 677
31 more
- 2021Vector-quantized Image Modeling with Improved VQGANcited by 658
- 2018Junction Tree Variational Autoencoder for Molecular Graph Generationcited by 652
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
- 2020Directional Message Passing for Molecular Graphscited by 561
- 2022GeoDiff: a Geometric Diffusion Model for Molecular Conformation Generationcited by 516
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 248
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
- 2022TorchMD-NET: Equivariant Transformers for Neural Network based Molecular Potentialscited by 182
- 2022Self-supervised Learning with Random-projection Quantizer for Speech Recognitioncited by 162
- 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
- 2023Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networkscited by 82
- 2020ATOM3D: Tasks On Molecules in Three Dimensionscited by 74
- 2022DiffBP: Generative Diffusion of 3D Molecules for Target Protein Bindingcited by 58
- 2022Multi-Scale Representation Learning on Proteinscited by 52
- 2023A new perspective on building efficient and expressive 3D equivariant graph neural networkscited by 47
- 2023De Novo Molecular Generation via Connection-aware Motif Miningcited by 46
- 2021Conditional Local Convolution for Spatio-temporal Meteorological Forecastingcited by 30
- 2023Functional-Group-Based Diffusion for Pocket-Specific Molecule Generation and Elaborationcited by 30
- 2021Transformers are Deep Infinite-Dimensional Non-Mercer Binary Kernel Machinescited by 22
- 2024MAPE-PPI: Towards Effective and Efficient Protein-Protein Interaction Prediction via Microenvironment-Aware Protein Embeddingcited by 22
- 2023Generalist Equivariant Transformer Towards 3D Molecular Interaction Learningcited by 19
- 2023Unsupervised Protein-Ligand Binding Energy Prediction via Neural Euler's Rotation Equationcited by 18
- 2024Are High-Degree Representations Really Unnecessary in Equivariant Graph Neural Networks?cited by 18
- 2023EquiPocket: an E(3)-Equivariant Geometric Graph Neural Network for Ligand Binding Site Predictioncited by 15
- 2024SurfPro: Functional Protein Design Based on Continuous Surfacecited by 14
- 2024Learning to Predict Mutation Effects of Protein-Protein Interactions by Microenvironment-aware Hierarchical Prompt Learningcited by 11
- 2024Geometry Informed Tokenization of Molecules for Language Model Generationcited by 10
- 2022Non-equispaced Fourier Neural Solvers for PDEscited by 8
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025AtomDisc: An Atom-level Tokenizer that Boosts Molecular LLMs and Reveals Structure--Property Associations
- 2026ED-DiT: Physics-Guided Diffusion Pretraining for Transferable Molecular Representations from Electron Density
- 2026VQ-Atom: Semantic Discretization of Local Atomic Environments for Molecular Representation Learning
- 2024Bio2Token: All-atom tokenization of any biomolecular structure with Mamba
- 2025Automated Machine Learning Pipeline: Large Language Models-Assisted Automated Dataset Generation for Training Machine-Learned Interatomic Potentials
- 2026DBMol: Design of High-Affinity, Target-Specific Small Molecules through Structure Prediction Models
- 2026Accurate structural modeling of chemically diverse molecular interfaces with Vilya-2
- 2024nach0-pc: Multi-task Language Model with Molecular Point Cloud Encoder