Scalable Spatio-Temporal SE(3) Diffusion for Long-Horizon Protein Dynamics
On the map: Diffusion models → Flow matching, time series and science
Abstract (arXiv)
Molecular dynamics (MD) simulations remain the gold standard for studying protein dynamics, but their computational cost limits access to biologically relevant timescales. Recent generative models have shown promise in accelerating simulations, yet they struggle with long-horizon generation due to architectural constraints, error accumulation, and inadequate modeling of spatio-temporal dynamics. We present STAR-MD (Spatio-Temporal Autoregressive Rollout for Molecular Dynamics), a scalable SE(3)-equivariant diffusion model that generates physically plausible protein trajectories over microsecond timescales. Our key innovation is a causal diffusion transformer with joint spatio-temporal attention that efficiently captures complex space-time dependencies while avoiding the memory bottlenecks of existing methods. On the standard ATLAS benchmark, STAR-MD achieves state-of-the-art performance across all metrics--substantially improving conformational coverage, structural validity, and dynamic fidelity compared to previous methods. STAR-MD successfully extrapolates to generate stable microsecond-scale trajectories where baseline methods fail catastrophically, maintaining high structural quality throughout the extended rollout. Our comprehensive evaluation reveals severe limitations in current models for long-horizon generation, while demonstrating that STAR-MD's joint spatio-temporal modeling enables robust dynamics simulation at biologically relevant timescales, paving the way for accelerated exploration of protein function.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 22 of its 43 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
22 of 43 references.
Closest ancestors · 4
Same direction, newest first
- 2024AlphaFolding: 4D Diffusion for Dynamic Protein Structure Prediction with Reference and Motion Guidance22 Aug
- 2024Protein Conformation Generation via Force-Guided SE(3) Diffusion Models21 Mar
- 2024AlphaFold Meets Flow Matching for Generating Protein Ensembles7 Feb
- 2023SE(3) diffusion model with application to protein backbone generation5 Feb
Other references · 18
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
- 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 634
- 2025Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Modelscited by 385
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2024Rotary Position Embedding for Vision Transformercited by 226
- 2025History-Guided Video Diffusioncited by 165
- 2023Timewarp: Transferable Acceleration of Molecular Dynamics by Learning Time-Coarsened Dynamicscited by 62
6 more
- 2017Variational approach for learning Markov processes from time series datacited by 51
- 2024Generative Modeling of Molecular Dynamics Trajectoriescited by 48
- 2024Causal Diffusion Transformers for Generative Modelingcited by 31
- 2023Str2Str: A Score-based Framework for Zero-shot Protein Conformation Samplingcited by 29
- 2024EquiJump: Protein Dynamics Simulation via SO(3)-Equivariant Stochastic Interpolantscited by 15
- 2025ConfRover: Simultaneous Modeling of Protein Conformation and Dynamics via Autoregressioncited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Generative Modeling in Protein Design: Neural Representations, Conditional Generation, and Evaluation Standardscited by 1
- 2026Learning Structure, Energy, and Dynamics: A Survey of Artificial Intelligence for Protein Dynamicscited by 1
- 2026Learning Implicit Bias in Generative Spaces for Accelerating Protein Dynamics Emulationcited by 0
- 2026Generative Modeling of Stochastic Dynamics for Long-Time Evolutioncited by 0
- 2026Generative Modeling of Stochastic Dynamics for Long-Time Evolution30 Sep 2026
- 2026Learning Implicit Bias in Generative Spaces for Accelerating Protein Dynamics Emulation1 Jun 2026
- 2026Learning Structure, Energy, and Dynamics: A Survey of Artificial Intelligence for Protein Dynamics28 Apr 2026
- 2026Generative Modeling in Protein Design: Neural Representations, Conditional Generation, and Evaluation Standards27 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2023SE(3)-Stochastic Flow Matching for Protein Backbone Generation
- 2026Equivariant Asynchronous Diffusion: An Adaptive Denoising Schedule for Accelerated Molecular Conformation Generation
- 2026Atomic Trajectory Modeling with State Space Models for Biomolecular Dynamics
- 2025MarS-FM: Generative Modeling of Molecular Dynamics via Markov State Models
- 2025Accelerating Protein Molecular Dynamics Simulation with DeepJump
- 2024F3low: Frame-to-Frame Coarse-grained Molecular Dynamics with SE(3) Guided Flow Matching
- 2024Geometric Trajectory Diffusion Models
- 2024Equivariant Blurring Diffusion for Hierarchical Molecular Conformer Generation