mlsanityData to 7 Oct 2026

Unlocking Out-of-Distribution Generalization in Dynamics through Physics-Guided Augmentation

arXiv 2510.24216 ↗First posted 28 Oct 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In dynamical system modeling, traditional numerical methods are limited by high computational costs, while modern data-driven approaches struggle with data scarcity and distribution shifts. To address these fundamental limitations, we first propose SPARK, a physics-guided quantitative augmentation plugin. Specifically, SPARK utilizes a reconstruction autoencoder to integrate physical parameters into a physics-rich discrete state dictionary. This state dictionary then acts as a structured dictionary of physical states, enabling the creation of new, physically-plausible training samples via principled interpolation in the latent space. Further, for downstream prediction, these augmented representations are seamlessly integrated with a Fourier-enhanced Graph ODE, a combination designed to robustly model the enriched data distribution while capturing long-term temporal dependencies. Extensive experiments on diverse benchmarks demonstrate that SPARK significantly outperforms state-of-the-art baselines, particularly in challenging out-of-distribution scenarios and data-scarce regimes, proving the efficacy of our physics-guided augmentation paradigm.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 69 references that are in the map. First posted on arXiv 28 Oct 2025.

Builds on

41 of 69 references.

References · 41

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  6. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
  7. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
  8. 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
  9. 2019Graph Neural Networks for Social Recommendationcited by 711
  10. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
  11. 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
  12. 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
29 more
  1. 2017PDE-Net: Learning PDEs from Datacited by 304
  2. 2022U-NO: U-shaped Neural Operatorscited by 219
  3. 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
  4. 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
  5. 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
  6. 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
  7. 2020Towards Inheritable Models for Open-Set Domain Adaptationcited by 64
  8. 2021Encoding physics to learn reaction-diffusion processescited by 61
  9. 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 54
  10. 2022Generalizing to New Physical Systems via Context-Informed Dynamics Modelcited by 49
  11. 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
  12. 2021LEADS: Learning Dynamical Systems that Generalize Across Environmentscited by 39
  13. 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 37
  14. 2022Koopman Neural Forecaster for Time Series with Temporal Distribution Shiftscited by 35
  15. 2016A probabilistic model for the numerical solution of initial value problemscited by 32
  16. 2022Domain Adaptation under Open Set Label Shiftcited by 32
  17. 2020Respecting Domain Relations: Hypothesis Invariance for Domain Generalizationcited by 30
  18. 2025OneForecast: A Universal Framework for Global and Regional Weather Forecastingcited by 30
  19. 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videoscited by 28
  20. 2018Multi-Step Prediction of Dynamic Systems with Recurrent Neural Networkscited by 25
  21. 2023DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalizationcited by 24
  22. 2014Probabilistic ODE Solvers with Runge-Kutta Meanscited by 22
  23. 2024BENO: Boundary-embedded Neural Operators for Elliptic PDEscited by 22
  24. 2023Revisiting Graph-Based Fraud Detection in Sight of Heterophily and Spectrumcited by 20
  25. 2022Learning Large-scale Subsurface Simulations with a Hybrid Graph Network Simulatorcited by 15
  26. 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulationcited by 11
  27. 2025Advanced Long-term Earth System Forecastingcited by 9
  28. 2025BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecastingcited by 4
  29. 2025Breaking the Discretization Barrier of Continuous Physics Simulation Learningcited by 4

Built on by

Not cited yet.