mlsanityData to 14 Oct 2026

Physics Consistency and Latent Dynamics in Spatiotemporal Physics Field Generation

arXiv 2505.11578 ↗First posted 16 May 2025cs.LG cs.AI physics.comp-phcited by 0

On the map: State-space sequence models (S4, Mamba) → Time series forecasting with SSMs

Abstract (arXiv)

Data-driven models for spatiotemporal physical field generation, such as flow and acoustic fields, often deviate from governing equations and lack interpretability in latent temporal dynamics. To address these challenges, we propose HMT-PF, a hybrid Mamba-Transformer architecture for physical field generation. The framework incorporates a query-based gradient computation mechanism and a physics-informed fine-tuning strategy to enhance physical consistency. Analysis of the latent space reveals that the initial latent state vector evolves as an autonomous dynamical system under the Mamba backbone. Principal component analysis (PCA) indicates that a small number of dominant modes in initial latent state vector govern the key evolution patterns of the physical field, while a Jacobian-based temporal sensitivity analysis characterizes the intrinsic dynamical structure and stability of the latent evolution. Experiments across five benchmark datasets demonstrate strong performance, and physics-informed fine-tuning further reduces physical residuals, highlighting the effectiveness of the proposed latent-level fusion strategy. An empirical scaling law between prediction error and physical residual is identified, revealing a consistent exponential relationship in the low-error regime. Based on this observation, an dual-metric framework is proposed to jointly evaluate numerical accuracy and physical realism.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Time series forecasting with SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 29 of its 44 references that are in the map. First posted on arXiv 16 May 2025.

Builds on

29 of 44 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  7. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  8. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
  9. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  10. 2022Visual Prompt Tuningcited by 1,681
  11. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  12. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
17 more
  1. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
  2. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
  3. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
  4. 2021Choose a Transformer: Fourier or Galerkincited by 343
  5. 2024Transolver: A Fast Transformer Solver for PDEs on General Geometriescited by 326
  6. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
  7. 2021U-FNO -- An enhanced Fourier neural operator-based deep-learning model for multiphase flowcited by 297
  8. 2022Transformer for Partial Differential Equations' Operator Learningcited by 283
  9. 2022MIONet: Learning multiple-input operators via tensor productcited by 181
  10. 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 167
  11. 2024Graph-Mamba: Towards Long-Range Graph Sequence Modeling with Selective State Spacescited by 134
  12. 2024DeepOKAN: Deep Operator Network Based on Kolmogorov Arnold Networks for Mechanics Problemscited by 84
  13. 2024Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategycited by 73
  14. 2023PINNsFormer: A Transformer-Based Framework For Physics-Informed Neural Networkscited by 64
  15. 2024Universal Physics Transformers: A Framework For Efficiently Scaling Neural Operatorscited by 27
  16. 2024Mamba YOLO: A Simple Baseline for Object Detection with State Space Modelcited by 19
  17. 2025Machine learning for modelling unstructured grid data in computational physics: a reviewcited by 12

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025FR-Mamba: Time-Series Physical Field Reconstruction Based on State Space Model
  2. 2024Generating Physical Dynamics under Priors
  3. 2026Latent Generative Solvers for Generalizable Long-Term Physics Simulation
  4. 2025Physically consistent and uncertainty-aware learning of spatiotemporal dynamics
  5. 2026Geometry-aware Latent Autoregressive Generative Model for PDEs in Complex Domains
  6. 2025Flow marching for a generative PDE foundation model
  7. 2026Recursive Flow Matching
  8. 2025Towards a Foundation Model for Partial Differential Equations Across Physics Domains