mlsanityData to 14 Oct 2026

MnemoDyn: Learning Resting State Dynamics from 40K FMRI sequences

arXiv 2608.23936 ↗First posted 25 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a dynamical-systems based model for resting-state functional magnetic resonance imaging (rs-fMRI), trained on a dataset of roughly 40K rs-fMRI sequences covering a wide variety of public and available-by-permission datasets. While most existing proposals use transformer backbones, we utilize multi-resolution temporal modeling of the dynamics across parcellated brain regions. We show that MnemoDyn is compute efficient and generalizes very well across diverse populations and scanning protocols. When benchmarked against current state-of-the-art transformer-based approaches, MnemoDyn consistently delivers superior reconstruction quality. Overall, we find that with such large-scale pre-training on (non-proprietary) rs-fMRI datasets, we get a highly performant model for various downstream tasks. Our results also provide evidence of the efficacy of the model on small sample size studies which has implications for neuroimaging studies at large where resting state fMRI is a commonly acquired imaging modality.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 84 references that are in the map. First posted on arXiv 25 Aug 2026.

Builds on

33 of 84 references.

References · 33

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  6. 2018Neural Ordinary Differential Equationscited by 3,779
  7. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  8. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  9. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  10. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  11. 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
  12. 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
21 more
  1. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
  2. 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 506
  3. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
  4. 2022Long Range Language Modeling via Gated State Spacescited by 265
  5. 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
  6. 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 168
  7. 2020Neural Rough Differential Equations for Long Time Seriescited by 143
  8. 2022Liquid Structural State-Space Modelscited by 136
  9. 2023Large Language Models are Few-Shot Health Learnerscited by 118
  10. 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
  11. 2022Brain Network Transformercited by 94
  12. 2024Operator Learning: Algorithms and Analysiscited by 85
  13. 2023A Mathematical Guide to Operator Learningcited by 76
  14. 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 65
  15. 2024DPLM-2: A Multimodal Diffusion Protein Language Modelcited by 64
  16. 2023SwiFT: Swin 4D fMRI Transformercited by 36
  17. 2024Specialized Foundation Models Struggle to Beat Supervised Baselinescited by 24
  18. 2022Neural Integral Equationscited by 23
  19. 2024Are Self-Attentions Effective for Time Series Forecasting?cited by 19
  20. 2025Operator Learning: A Statistical Perspectivecited by 17
  21. 2023Sparse Binary Transformers for Multivariate Time Series Modelingcited by 8

Built on by

Not cited yet.