FlowMixer: A Depth-Agnostic Neural Architecture for Interpretable Spatiotemporal Forecasting
Not on the map. Why?
Abstract (arXiv)
We introduce FlowMixer, a single-layer neural architecture that leverages constrained matrix operations to model structured spatiotemporal patterns with enhanced interpretability. FlowMixer incorporates non-negative matrix mixing layers within a reversible mapping framework - applying transforms before mixing and their inverses afterward. This shape-preserving design enables a Kronecker-Koopman eigenmodes framework that bridges statistical learning with dynamical systems theory, providing interpretable spatiotemporal patterns and facilitating direct algebraic manipulation of prediction horizons without retraining. The architecture's semi-group property enables this single layer to mathematically represent any depth through composition, eliminating depth search entirely. Extensive experiments across diverse domains demonstrate FlowMixer's long-horizon forecasting capabilities while effectively modeling physical phenomena such as chaotic attractors and turbulent flows. Our results achieve performance matching state-of-the-art methods while offering superior interpretability through directly extractable eigenmodes. This work suggests that architectural constraints can simultaneously maintain competitive performance and enhance mathematical interpretability in neural forecasting systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 69 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
33 of 69 references.
References · 33
- 2017Attention Is All You Needcited by 60,361
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
- 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
21 more
- 2019Machine Learning for Fluid Mechanicscited by 385
- 2021Modern Koopman Theory for Dynamical Systemscited by 276
- 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
- 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
- 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 204
- 2021Next Generation Reservoir Computingcited by 160
- 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 138
- 2019Backpropagation Algorithms and Reservoir Computing in Recurrent Neural Networks for the Forecasting of Complex Spatiotemporal Dynamicscited by 134
- 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 116
- 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 113
- 2024CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patternscited by 106
- 2021Chaos as an interpretable benchmark for forecasting and data-driven modellingcited by 88
- 2018Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Modelcited by 57
- 2018Reservoir computing approaches for representation and classification of multivariate time seriescited by 38
- 2024Zero-shot forecasting of chaotic systemscited by 28
- 2023Model scale versus domain knowledge in statistical forecasting of chaotic systemscited by 27
- 2024WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecastingcited by 26
- 2024Ada-MSHyper: Adaptive Multi-Scale Hypergraph Transformer for Time Series Forecastingcited by 21
- 2024MSHyper: Multi-Scale Hypergraph Transformer for Long-Range Time Series Forecastingcited by 12
- 2024Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Modelscited by 8
- 2024Urban traffic analysis and forecasting through shared Koopman eigenmodescited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.