mlsanityData to 7 Oct 2026

Generalizing across Temporal Domains with Koopman Operators

arXiv 2402.07834 ↗First posted 12 Feb 2024cs.LGcited by 12

Not on the map. Why?

Abstract (arXiv)

In the field of domain generalization, the task of constructing a predictive model capable of generalizing to a target domain without access to target data remains challenging. This problem becomes further complicated when considering evolving dynamics between domains. While various approaches have been proposed to address this issue, a comprehensive understanding of the underlying generalization theory is still lacking. In this study, we contribute novel theoretic results that aligning conditional distribution leads to the reduction of generalization bounds. Our analysis serves as a key motivation for solving the Temporal Domain Generalization (TDG) problem through the application of Koopman Neural Operators, resulting in Temporal Koopman Networks (TKNets). By employing Koopman Operators, we effectively address the time-evolving distributions encountered in TDG using the principles of Koopman theory, where measurement functions are sought to establish linear transition relations between evolving domains. Through empirical evaluations conducted on synthetic and real-world datasets, we validate the effectiveness of our proposed approach.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 39 of its 61 references that are in the map. First posted on arXiv 12 Feb 2024.

Builds on

39 of 61 references.

References · 39

  1. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  2. 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
  3. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
  4. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
  5. 2020In Search of Lost Domain Generalizationcited by 1,042
  6. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
  7. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
  8. 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
  9. 2013Domain Generalization via Invariant Feature Representationcited by 622
  10. 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
  11. 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
  12. 2017Functional Map of the Worldcited by 338
27 more
  1. 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
  2. 2020Gradient Starvation: A Learning Proclivity in Neural Networkscited by 262
  3. 2015Domain Generalization for Object Recognition with Multi-task Autoencoderscited by 253
  4. 2019Domain Randomization and Pyramid Consistency: Simulation-to-Real Generalization without Accessing Target Domain Datacited by 245
  5. 2020Improve Unsupervised Domain Adaptation with Mixup Trainingcited by 185
  6. 2017Domain Generalization by Marginal Transfer Learningcited by 180
  7. 2020Understanding Self-Training for Gradual Domain Adaptationcited by 149
  8. 2019Feature-Critic Networks for Heterogeneous Domain Generalizationcited by 130
  9. 2019DIVA: Domain Invariant Variational Autoencoderscited by 114
  10. 2018Best sources forward: domain generalization through source-specific netscited by 81
  11. 2020Continuously Indexed Domain Adaptationcited by 74
  12. 2020Learning Invariant Representations and Risks for Semi-supervised Domain Adaptationcited by 69
  13. 2019Learning Compositional Koopman Operators for Model-Based Controlcited by 67
  14. 2015A Century of Portraits: A Visual Historical Record of American High School Yearbookscited by 54
  15. 2021Domain Invariant Representation Learning with Domain Density Transformationscited by 53
  16. 2018Multi-component Image Translation for Deep Domain Generalizationcited by 40
  17. 2021Near-Optimal Linear Regression under Distribution Shiftcited by 40
  18. 2019AdaGraph: Unifying Predictive and Continuous Domain Adaptation through Graphscited by 32
  19. 2022Understanding Gradual Domain Adaptation: Improved Analysis, Optimal Path and Beyondcited by 32
  20. 2021Training for the Future: A Simple Gradient Interpolation Loss to Generalize Along Timecited by 27
  21. 2022Gradual Domain Adaptation without Indexed Intermediate Domainscited by 26
  22. 2021Aggregating From Multiple Target-Shifted Sourcescited by 24
  23. 2022Generalizing to Evolving Domains with Latent Structure-Aware Sequential Autoencodercited by 18
  24. 2017Heterogeneous domain adaptation: An unsupervised approachcited by 17
  25. 2021On the benefits of representation regularization in invariance based domain generalizationcited by 17
  26. 2018Exploiting Local Feature Patterns for Unsupervised Domain Adaptationcited by 8
  27. 2021Online Continual Adaptation with Active Self-Trainingcited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 6; 2026: 4.

12 papers.