Meta-Learning for Koopman Spectral Analysis with Short Time-series
Not on the map. Why?
Abstract (arXiv)
Koopman spectral analysis has attracted attention for nonlinear dynamical systems since we can analyze nonlinear dynamics with a linear regime by embedding data into a Koopman space by a nonlinear function. For the analysis, we need to find appropriate embedding functions. Although several neural network-based methods have been proposed for learning embedding functions, existing methods require long time-series for training neural networks. This limitation prohibits performing Koopman spectral analysis in applications where only short time-series are available. In this paper, we propose a meta-learning method for estimating embedding functions from unseen short time-series by exploiting knowledge learned from related but different time-series. With the proposed method, a representation of a given short time-series is obtained by a bidirectional LSTM for extracting its properties. The embedding function of the short time-series is modeled by a neural network that depends on the time-series representation. By sharing the LSTM and neural networks across multiple time-series, we can learn common knowledge from different time-series while modeling time-series-specific embedding functions with the time-series representation. Our model is trained such that the expected test prediction error is minimized with the episodic training framework. We experimentally demonstrate that the proposed method achieves better performance in terms of eigenvalue estimation and future prediction than existing methods.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 61 references that are in the map. First posted on arXiv 9 Feb 2021.
Builds on
28 of 61 references.
References · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 744
- 2016Learning to learn by gradient descent by gradient descentcited by 616
- 2016Deep Transfer Learning with Joint Adaptation Networkscited by 609
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 491
- 2018Conditional Neural Processescited by 421
- 2018A Survey on Deep Transfer Learningcited by 417
- 2018Neural Processescited by 307
- 2018Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesiscited by 280
16 more
- 2019Attentive Neural Processescited by 280
- 2019Episodic Training for Domain Generalizationcited by 245
- 2017Learning Koopman Invariant Subspaces for Dynamic Mode Decompositioncited by 156
- 2018Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networkscited by 129
- 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 125
- 2020Forecasting Sequential Data using Consistent Koopman Autoencoderscited by 114
- 2020Meta-learning framework with applications to zero-shot time-series forecastingcited by 70
- 2018Deep Dynamical Modeling and Control of Unsteady Fluid Flowscited by 67
- 2019Learning Compositional Koopman Operators for Model-Based Controlcited by 67
- 2019MetaFun: Meta-Learning with Iterative Functional Updatescited by 34
- 2017Robust and Efficient Transfer Learning with Hidden-Parameter Markov Decision Processescited by 28
- 2019Recurrent Attentive Neural Process for Sequential Datacited by 15
- 2020Few-shot Learning for Time-series Forecastingcited by 15
- 2019Recurrent Neural Processescited by 10
- 2019Energy Predictive Models with Limited Data using Transfer Learningcited by 7
- 2018Zero-shot Domain Adaptation without Domain Semantic Descriptorscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.