Unlocking Out-of-Distribution Generalization in Dynamics through Physics-Guided Augmentation
Not on the map. Why?
Abstract (arXiv)
In dynamical system modeling, traditional numerical methods are limited by high computational costs, while modern data-driven approaches struggle with data scarcity and distribution shifts. To address these fundamental limitations, we first propose SPARK, a physics-guided quantitative augmentation plugin. Specifically, SPARK utilizes a reconstruction autoencoder to integrate physical parameters into a physics-rich discrete state dictionary. This state dictionary then acts as a structured dictionary of physical states, enabling the creation of new, physically-plausible training samples via principled interpolation in the latent space. Further, for downstream prediction, these augmented representations are seamlessly integrated with a Fourier-enhanced Graph ODE, a combination designed to robustly model the enriched data distribution while capturing long-term temporal dependencies. Extensive experiments on diverse benchmarks demonstrate that SPARK significantly outperforms state-of-the-art baselines, particularly in challenging out-of-distribution scenarios and data-scarce regimes, proving the efficacy of our physics-guided augmentation paradigm.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 41 of its 69 references that are in the map. First posted on arXiv 28 Oct 2025.
Builds on
41 of 69 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 748
- 2020Neural Operator: Graph Kernel Network for Partial Differential Equationscited by 722
- 2019Graph Neural Networks for Social Recommendationcited by 711
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 629
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
- 2022PDEBENCH: An Extensive Benchmark for Scientific Machine Learningcited by 396
29 more
- 2017PDE-Net: Learning PDEs from Datacited by 304
- 2022U-NO: U-shaped Neural Operatorscited by 219
- 2023Convolutional Neural Operators for robust and accurate learning of PDEscited by 207
- 2020PhyGeoNet: Physics-Informed Geometry-Adaptive Convolutional Neural Networks for Solving Parameterized Steady-State PDEs on Irregular Domaincited by 173
- 2021PhyCRNet: Physics-informed Convolutional-Recurrent Network for Solving Spatiotemporal PDEscited by 97
- 2023Solving High-Dimensional PDEs with Latent Spectral Modelscited by 84
- 2020Towards Inheritable Models for Open-Set Domain Adaptationcited by 64
- 2021Encoding physics to learn reaction-diffusion processescited by 61
- 2023Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformerscited by 54
- 2022Generalizing to New Physical Systems via Context-Informed Dynamics Modelcited by 49
- 2023PastNet: Introducing Physical Inductive Biases for Spatio-temporal Video Predictioncited by 44
- 2021LEADS: Learning Dynamical Systems that Generalize Across Environmentscited by 39
- 2023Learning Neural PDE Solvers with Parameter-Guided Channel Attentioncited by 37
- 2022Koopman Neural Forecaster for Time Series with Temporal Distribution Shiftscited by 35
- 2016A probabilistic model for the numerical solution of initial value problemscited by 32
- 2022Domain Adaptation under Open Set Label Shiftcited by 32
- 2020Respecting Domain Relations: Hypothesis Invariance for Domain Generalizationcited by 30
- 2025OneForecast: A Universal Framework for Global and Regional Weather Forecastingcited by 30
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videoscited by 28
- 2018Multi-Step Prediction of Dynamic Systems with Recurrent Neural Networkscited by 25
- 2023DIVERSIFY: A General Framework for Time Series Out-of-distribution Detection and Generalizationcited by 24
- 2014Probabilistic ODE Solvers with Runge-Kutta Meanscited by 22
- 2024BENO: Boundary-embedded Neural Operators for Elliptic PDEscited by 22
- 2023Revisiting Graph-Based Fraud Detection in Sight of Heterophily and Spectrumcited by 20
- 2022Learning Large-scale Subsurface Simulations with a Hybrid Graph Network Simulatorcited by 15
- 2025NeuralOM: Neural Ocean Model for Subseasonal-to-Seasonal Simulationcited by 11
- 2025Advanced Long-term Earth System Forecastingcited by 9
- 2025BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecastingcited by 4
- 2025Breaking the Discretization Barrier of Continuous Physics Simulation Learningcited by 4
Built on by
Not cited yet.