# GraphVAMPNet, using graph neural networks and variational approach to markov processes for dynamical modeling of biomolecules

arXiv: https://arxiv.org/abs/2201.04609 · HTML: https://mlsanity.com/paper/2201.04609/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 23 of its 70 references that are in the map.
- First posted on arXiv 12 Jan 2022.

## Builds on (most cited first, 23 of 23)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Semi-Supervised Classification with Graph Convolutional Networks](https://mlsanity.com/paper/1609.02907/) (2016)
- [Graph Attention Networks](https://mlsanity.com/paper/1710.10903/) (2017)
- [Inductive Representation Learning on Large Graphs](https://mlsanity.com/paper/1706.02216/) (2017)
- [Relational inductive biases, deep learning, and graph networks](https://mlsanity.com/paper/1806.01261/) (2018)
- [Spectral Networks and Locally Connected Networks on Graphs](https://mlsanity.com/paper/1312.6203/) (2013)
- [Geometric deep learning: going beyond Euclidean data](https://mlsanity.com/paper/1611.08097/) (2016)
- [Hierarchical Graph Representation Learning with Differentiable Pooling](https://mlsanity.com/paper/1806.08804/) (2018)
- [Convolutional Networks on Graphs for Learning Molecular Fingerprints](https://mlsanity.com/paper/1509.09292/) (2015)
- [SchNet: A continuous-filter convolutional neural network for modeling quantum interactions](https://mlsanity.com/paper/1706.08566/) (2017)
- [Molecular Graph Convolutions: Moving Beyond Fingerprints](https://mlsanity.com/paper/1603.00856/) (2016)
- [ASAP: Adaptive Structure Aware Pooling for Learning Hierarchical Graph Representations](https://mlsanity.com/paper/1911.07979/) (2019)
- [Encoding Sentences with Graph Convolutional Networks for Semantic Role Labeling](https://mlsanity.com/paper/1703.04826/) (2017)
- [VAMPnets: Deep learning of molecular kinetics](https://mlsanity.com/paper/1710.06012/) (2017)
- [Coarse Graining Molecular Dynamics with Graph Neural Networks](https://mlsanity.com/paper/2007.11412/) (2020)
- [Variational approach for learning Markov processes from time series data](https://mlsanity.com/paper/1707.04659/) (2017)
- [Deeptime: a Python library for machine learning dynamical models from time series data](https://mlsanity.com/paper/2110.15013/) (2021)
- [Variational Encoding of Complex Dynamics](https://mlsanity.com/paper/1711.08576/) (2017)
- [Variational Koopman models: slow collective variables and molecular kinetics from short off-equilibrium simulations](https://mlsanity.com/paper/1610.06773/) (2016)
- [Graph Dynamical Networks for Unsupervised Learning of Atomic Scale Dynamics in Materials](https://mlsanity.com/paper/1902.06836/) (2019)
- [High-resolution Markov state models for the dynamics of Trp-cage miniprotein constructed over slow folding modes identified by state-free reversible VAMPnets](https://mlsanity.com/paper/1906.04890/) (2019)
- [Variational Selection of Features for Molecular Kinetics](https://mlsanity.com/paper/1811.11714/) (2018)
- [Variational embedding of protein folding simulations using gaussian mixture variational autoencoders](https://mlsanity.com/paper/2108.12493/) (2021)

## Built on by (most cited first, 8 of 8)

- [Learning invariant representations of time-homogeneous stochastic dynamical systems](https://mlsanity.com/paper/2307.09912/) (2023)
- [Self-Supervised Evolution Operator Learning for High-Dimensional Dynamical Systems](https://mlsanity.com/paper/2505.18671/) (2025)
- [Reaction coordinate flows for model reduction of molecular kinetics](https://mlsanity.com/paper/2309.05878/) (2023)
- [Using pretrained graph neural networks with token mixers as geometric featurizers for conformational dynamics](https://mlsanity.com/paper/2409.19838/) (2024)
- [Beyond Ensembles: Simulating All-Atom Protein Dynamics in a Learned Latent Space](https://mlsanity.com/paper/2509.02196/) (2025)
- [Hierarchical geometric deep learning enables scalable analysis of molecular dynamics](https://mlsanity.com/paper/2512.06520/) (2025)
- [Random functions as data compressors for machine learning of molecular processes](https://mlsanity.com/paper/2509.17937/) (2025)
- [PIS: A Physics-Informed System for Accurate State Partitioning of Aβ42 Protein Trajectories](https://mlsanity.com/paper/2602.19444/) (2026)

## Abstract (arXiv)

Finding low dimensional representation of data from long-timescale trajectories of biomolecular processes such as protein-folding or ligand-receptor binding is of fundamental importance and kinetic models such as Markov modeling have proven useful in describing the kinetics of these systems. Recently, an unsupervised machine learning technique called VAMPNet was introduced to learn the low dimensional representation and linear dynamical model in an end-to-end manner. VAMPNet is based on variational approach to Markov processes (VAMP) and relies on neural networks to learn the coarse-grained dynamics. In this contribution, we combine VAMPNet and graph neural networks to generate an end-to-end framework to efficiently learn high-level dynamics and metastable states from the long-timescale molecular dynamics trajectories. This method bears the advantages of graph representation learning and uses graph message passing operations to generate an embedding for each datapoint which is used in the VAMPNet to generate a coarse-grained representation. This type of molecular representation results in a higher resolution and more interpretable Markov model than the standard VAMPNet enabling a more detailed kinetic study of the biomolecular processes. Our GraphVAMPNet approach is also enhanced with an attention mechanism to find the important residues for classification into different metastable states.
