Generalizing to New Dynamical Systems via Frequency Domain Adaptation
Not on the map. Why?
Abstract (arXiv)
Learning the underlying dynamics from data with deep neural networks has shown remarkable potential in modeling various complex physical dynamics. However, current approaches are constrained in their ability to make reliable predictions in a specific domain and struggle with generalizing to unseen systems that are governed by the same general dynamics but differ in environmental characteristics. In this work, we formulate a parameter-efficient method, Fourier Neural Simulator for Dynamical Adaptation (FNSDA), that can readily generalize to new dynamics via adaptation in the Fourier space. Specifically, FNSDA identifies the shareable dynamics based on the known environments using an automatic partition in Fourier modes and learns to adjust the modes specific for each new environment by conditioning on low-dimensional latent systematic parameters for efficient generalization. We evaluate our approach on four representative families of dynamic systems, and the results show that FNSDA can achieve superior or competitive generalization performance compared to existing methods with a significantly reduced parameter cost. Our code is available at https://github.com/WonderSeven/FNSDA.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 64 references that are in the map. First posted on arXiv 17 Jun 2025.
Builds on
33 of 64 references.
References · 33
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
- 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 742
- 2021Domain Generalization with MixStylecited by 566
- 2021Machine learning accelerated computational fluid dynamicscited by 471
21 more
- 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
- 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 407
- 2021FNet: Mixing Tokens with Fourier Transformscited by 347
- 2020The Risks of Invariant Risk Minimizationcited by 262
- 2021Factorized Fourier Neural Operatorscited by 249
- 2016Statistics of Robust Optimization: A Generalized Empirical Likelihood Approachcited by 183
- 2019Domain Agnostic Learning with Disentangled Representationscited by 108
- 2013Fast Training of Convolutional Networks through FFTscited by 89
- 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 84
- 2020Regularizing Deep Networks with Semantic Data Augmentationcited by 73
- 2022Generalizing to New Physical Systems via Context-Informed Dynamics Modelcited by 50
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
- 2021LEADS: Learning Dynamical Systems that Generalize Across Environmentscited by 40
- 2021Meta-Learning Dynamics Forecasting Using Task Inferencecited by 38
- 2021Training for the Future: A Simple Gradient Interpolation Loss to Generalize Along Timecited by 28
- 2022Transform Once: Efficient Operator Learning in Frequency Domaincited by 20
- 2022Generalizing to Evolving Domains with Latent Structure-Aware Sequential Autoencodercited by 19
- 2021Inferring halo masses with Graph Neural Networkscited by 13
- 2018Learning Long Term Dependencies via Fourier Recurrent Unitscited by 11
- 2021Physics perception in sloshing scenes with guaranteed thermodynamic consistencycited by 10
- 2022Sparsity in Continuous-Depth Neural Networkscited by 10
Built on by
Not cited yet.