mlsanityData to 14 Oct 2026

FlowMixer: A Depth-Agnostic Neural Architecture for Interpretable Spatiotemporal Forecasting

arXiv 2505.16786 ↗First posted 22 May 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

We introduce FlowMixer, a single-layer neural architecture that leverages constrained matrix operations to model structured spatiotemporal patterns with enhanced interpretability. FlowMixer incorporates non-negative matrix mixing layers within a reversible mapping framework - applying transforms before mixing and their inverses afterward. This shape-preserving design enables a Kronecker-Koopman eigenmodes framework that bridges statistical learning with dynamical systems theory, providing interpretable spatiotemporal patterns and facilitating direct algebraic manipulation of prediction horizons without retraining. The architecture's semi-group property enables this single layer to mathematically represent any depth through composition, eliminating depth search entirely. Extensive experiments across diverse domains demonstrate FlowMixer's long-horizon forecasting capabilities while effectively modeling physical phenomena such as chaotic attractors and turbulent flows. Our results achieve performance matching state-of-the-art methods while offering superior interpretability through directly extractable eigenmodes. This work suggests that architectural constraints can simultaneously maintain competitive performance and enhance mathematical interpretability in neural forecasting systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 69 references that are in the map. First posted on arXiv 22 May 2025.

Builds on

33 of 69 references.

References · 33

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018Neural Ordinary Differential Equationscited by 3,779
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  4. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
  5. 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,676
  6. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  7. 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,210
  8. 2017Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networkscited by 879
  9. 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
  10. 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
  11. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
  12. 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
21 more
  1. 2019Machine Learning for Fluid Mechanicscited by 385
  2. 2021Modern Koopman Theory for Dynamical Systemscited by 276
  3. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 240
  4. 2017Hidden Physics Models: Machine Learning of Nonlinear Partial Differential Equationscited by 208
  5. 2019Towards Physics-informed Deep Learning for Turbulent Flow Predictioncited by 204
  6. 2021Next Generation Reservoir Computingcited by 160
  7. 2021Enhancing Computational Fluid Dynamics with Machine Learningcited by 138
  8. 2019Backpropagation Algorithms and Reservoir Computing in Recurrent Neural Networks for the Forecasting of Complex Spatiotemporal Dynamicscited by 134
  9. 2024TimeMixer++: A General Time Series Pattern Machine for Universal Predictive Analysiscited by 116
  10. 2023Koopa: Learning Non-stationary Time Series Dynamics with Koopman Predictorscited by 113
  11. 2024CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patternscited by 106
  12. 2021Chaos as an interpretable benchmark for forecasting and data-driven modellingcited by 88
  13. 2018Hybrid Forecasting of Chaotic Processes: Using Machine Learning in Conjunction with a Knowledge-Based Modelcited by 57
  14. 2018Reservoir computing approaches for representation and classification of multivariate time seriescited by 38
  15. 2024Zero-shot forecasting of chaotic systemscited by 28
  16. 2023Model scale versus domain knowledge in statistical forecasting of chaotic systemscited by 27
  17. 2024WPMixer: Efficient Multi-Resolution Mixing for Long-Term Time Series Forecastingcited by 26
  18. 2024Ada-MSHyper: Adaptive Multi-Scale Hypergraph Transformer for Time Series Forecastingcited by 21
  19. 2024MSHyper: Multi-Scale Hypergraph Transformer for Long-Range Time Series Forecastingcited by 12
  20. 2024Chimera: Effectively Modeling Multivariate Time Series with 2-Dimensional State Space Modelscited by 8
  21. 2024Urban traffic analysis and forecasting through shared Koopman eigenmodescited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.