Koopman Learning with Episodic Memory
Not on the map. Why?
Abstract (arXiv)
Koopman operator theory has found significant success in learning models of complex, real-world dynamical systems, enabling prediction and control. The greater interpretability and lower computational costs of these models, compared to traditional machine learning methodologies, make Koopman learning an especially appealing approach. Despite this, little work has been performed on endowing Koopman learning with the ability to leverage its own failures. To address this, we equip Koopman methods -- developed for predicting non-autonomous time-series -- with an episodic memory mechanism, enabling global recall of (or attention to) periods in time where similar dynamics previously occurred. We find that a basic implementation of Koopman learning with episodic memory leads to significant improvements in prediction on synthetic and real-world data. Our framework has considerable potential for expansion, allowing for future advances, and opens exciting new directions for Koopman learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 75 references that are in the map. First posted on arXiv 21 Nov 2023.
Builds on
25 of 75 references.
References · 25
- 2017Attention Is All You Needcited by 60,361
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
- 2022Non-stationary Transformers: Exploring the Stationarity in Time Series Forecastingcited by 391
- 2017Neural Episodic Controlcited by 151
- 2017Linearly-Recurrent Autoencoder Networks for Learning Dynamicscited by 145
- 2016Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive controlcited by 140
- 2014Dynamic mode decomposition with controlcited by 129
- 2017Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systemscited by 127
13 more
- 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 113
- 2020Transformers for Modeling Physical Systemscited by 106
- 2022Learning Dynamical Systems via Koopman Operator Regression in Reproducing Kernel Hilbert Spacescited by 67
- 2016Generalizing Koopman Theory to allow for inputs and controlcited by 53
- 2023Sharp Spectral Rates for Koopman Operator Learningcited by 36
- 2021Non-stationary Online Learning with Memory and Non-stochastic Controlcited by 33
- 2017Online dynamic mode decomposition for time-varying systemscited by 23
- 2019Modeling and Control of Soft Robots Using the Koopman Operator and Model Predictive Controlcited by 23
- 2023Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysiscited by 23
- 2022Algorithmic (Semi-)Conjugacy via Koopman Operator Theorycited by 8
- 2019Geometric Considerations of a Good Dictionary for Koopman Analysis of Dynamical Systems: Cardinality, 'Primary Eigenfunction,' and Efficient Representationcited by 6
- 2020Koopman-based Control of a Soft Continuum Manipulator Under Variable Loading Conditionscited by 4
- 2023Learning Nonautonomous Systems via Dynamic Mode Decompositioncited by 1
Built on by
Not cited yet.