MnemoDyn: Learning Resting State Dynamics from 40K FMRI sequences
Not on the map. Why?
Abstract (arXiv)
We present a dynamical-systems based model for resting-state functional magnetic resonance imaging (rs-fMRI), trained on a dataset of roughly 40K rs-fMRI sequences covering a wide variety of public and available-by-permission datasets. While most existing proposals use transformer backbones, we utilize multi-resolution temporal modeling of the dynamics across parcellated brain regions. We show that MnemoDyn is compute efficient and generalizes very well across diverse populations and scanning protocols. When benchmarked against current state-of-the-art transformer-based approaches, MnemoDyn consistently delivers superior reconstruction quality. Overall, we find that with such large-scale pre-training on (non-proprietary) rs-fMRI datasets, we get a highly performant model for various downstream tasks. Our results also provide evidence of the efficacy of the model on small sample size studies which has implications for neuroimaging studies at large where resting state fMRI is a commonly acquired imaging modality.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 84 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
33 of 84 references.
References · 33
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
- 2022Are Transformers Effective for Time Series Forecasting?cited by 1,424
- 2020HiPPO: Recurrent Memory with Optimal Polynomial Projectionscited by 605
21 more
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2020Neural Controlled Differential Equations for Irregular Time Seriescited by 506
- 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
- 2022Long Range Language Modeling via Gated State Spacescited by 265
- 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
- 2024Are Language Models Actually Useful for Time Series Forecasting?cited by 168
- 2020Neural Rough Differential Equations for Long Time Seriescited by 143
- 2022Liquid Structural State-Space Modelscited by 136
- 2023Large Language Models are Few-Shot Health Learnerscited by 118
- 2021Transformer-based Spatial-Temporal Feature Learning for EEG Decodingcited by 97
- 2022Brain Network Transformercited by 94
- 2024Operator Learning: Algorithms and Analysiscited by 85
- 2023A Mathematical Guide to Operator Learningcited by 76
- 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 65
- 2024DPLM-2: A Multimodal Diffusion Protein Language Modelcited by 64
- 2023SwiFT: Swin 4D fMRI Transformercited by 36
- 2024Specialized Foundation Models Struggle to Beat Supervised Baselinescited by 24
- 2022Neural Integral Equationscited by 23
- 2024Are Self-Attentions Effective for Time Series Forecasting?cited by 19
- 2025Operator Learning: A Statistical Perspectivecited by 17
- 2023Sparse Binary Transformers for Multivariate Time Series Modelingcited by 8
Built on by
Not cited yet.