mlsanityData to 14 Oct 2026

Generalizing to New Dynamical Systems via Frequency Domain Adaptation

arXiv 2507.00025 ↗First posted 17 Jun 2025cs.LG cs.AI stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

Learning the underlying dynamics from data with deep neural networks has shown remarkable potential in modeling various complex physical dynamics. However, current approaches are constrained in their ability to make reliable predictions in a specific domain and struggle with generalizing to unseen systems that are governed by the same general dynamics but differ in environmental characteristics. In this work, we formulate a parameter-efficient method, Fourier Neural Simulator for Dynamical Adaptation (FNSDA), that can readily generalize to new dynamics via adaptation in the Fourier space. Specifically, FNSDA identifies the shareable dynamics based on the known environments using an automatic partition in Fourier modes and learns to adjust the modes specific for each new environment by conditioning on low-dimensional latent systematic parameters for efficient generalization. We evaluate our approach on four representative families of dynamic systems, and the results show that FNSDA can achieve superior or competitive generalization performance compared to existing methods with a significantly reduced parameter cost. Our code is available at https://github.com/WonderSeven/FNSDA.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 64 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

33 of 64 references.

References · 33

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2018Neural Ordinary Differential Equationscited by 3,779
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  5. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  6. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  7. 2022FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operatorscited by 776
  8. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 766
  9. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
  10. 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 742
  11. 2021Domain Generalization with MixStylecited by 566
  12. 2021Machine learning accelerated computational fluid dynamicscited by 471
21 more
  1. 2018Generalizing to Unseen Domains via Adversarial Data Augmentationcited by 451
  2. 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 407
  3. 2021FNet: Mixing Tokens with Fourier Transformscited by 347
  4. 2020The Risks of Invariant Risk Minimizationcited by 262
  5. 2021Factorized Fourier Neural Operatorscited by 249
  6. 2016Statistics of Robust Optimization: A Generalized Empirical Likelihood Approachcited by 183
  7. 2019Domain Agnostic Learning with Disentangled Representationscited by 108
  8. 2013Fast Training of Convolutional Networks through FFTscited by 89
  9. 2022Predicting Physics in Mesh-reduced Space with Temporal Attentioncited by 84
  10. 2020Regularizing Deep Networks with Semantic Data Augmentationcited by 73
  11. 2022Generalizing to New Physical Systems via Context-Informed Dynamics Modelcited by 50
  12. 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
  13. 2021LEADS: Learning Dynamical Systems that Generalize Across Environmentscited by 40
  14. 2021Meta-Learning Dynamics Forecasting Using Task Inferencecited by 38
  15. 2021Training for the Future: A Simple Gradient Interpolation Loss to Generalize Along Timecited by 28
  16. 2022Transform Once: Efficient Operator Learning in Frequency Domaincited by 20
  17. 2022Generalizing to Evolving Domains with Latent Structure-Aware Sequential Autoencodercited by 19
  18. 2021Inferring halo masses with Graph Neural Networkscited by 13
  19. 2018Learning Long Term Dependencies via Fourier Recurrent Unitscited by 11
  20. 2021Physics perception in sloshing scenes with guaranteed thermodynamic consistencycited by 10
  21. 2022Sparsity in Continuous-Depth Neural Networkscited by 10

Built on by

Not cited yet.