BrainWorld: A Structural-Prior-Conditioned Generative Model for Whole-Brain 4D fMRI Dynamics
Not on the map. Why?
Abstract (arXiv)
Whole-brain 4D fMRI generation is valuable for modeling functional brain dynamics, yet existing fMRI foundation models mainly target representation learning and downstream prediction rather than conditional predictive generation. We introduce BrainWorld, a structural-prior-conditioned generative model for whole-brain 4D fMRI dynamics. BrainWorld uses sMRI as subject-level anatomical context to guide future fMRI generation, integrating structural information into the denoising process rather than treating it as a parallel modality. Evaluated on 22 datasets spanning diverse cohorts and brain states, BrainWorld generates stable 4D fMRI trajectories up to 400 frames, improves downstream performance through generated-example augmentation, and learns transferable multimodal representations that outperform baselines. Together, these results establish BrainWorld as a condition-aware generative framework for long-horizon brain dynamics modeling and multimodal representation learning.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 33 of its 67 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
33 of 67 references.
References · 33
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2017Axiomatic Attribution for Deep Networkscited by 3,384
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2018World Modelscited by 1,513
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 471
- 2023Seamless: Multilingual Expressive and Streaming Speech Translationcited by 192
- 2023Diffusion Model as Representation Learnercited by 95
21 more
- 2023Generative AI for Medical Imaging: extending the MONAI Frameworkcited by 68
- 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 65
- 2024WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Modelcited by 57
- 2023SwiFT: Swin 4D fMRI Transformercited by 36
- 2023Do text-free diffusion models learn discriminative visual representations?cited by 33
- 2024BrainMass: Advancing Brain Network Analysis for Diagnosis with Large-scale Self-Supervised Learningcited by 32
- 2025Towards a general-purpose foundation model for fMRI analysiscited by 15
- 2025Brain Harmony: A Multimodal Foundation Model Unifying Morphology and Function into 1D Tokenscited by 15
- 2025CineBrain: A Large-Scale Multi-Modal Brain Dataset During Naturalistic Audiovisual Narrative Processingcited by 11
- 2026Omni-fMRI: A Universal Atlas-Free fMRI Foundation Modelcited by 11
- 2026Brain-DiT: A Universal Multi-state fMRI Foundation Model with Metadata-Conditioned Pretrainingcited by 11
- 2025SLIM-Brain: A Data- and Training-Efficient Foundation Model for fMRI Data Analysiscited by 9
- 2024Uncovering cognitive taskonomy through transfer learning in masked autoencoder-based fMRI reconstructioncited by 7
- 2025fMRI-LM: Towards a Universal Foundation Model for Language-Aligned fMRI Understandingcited by 7
- 2026FlexiBrain: Resolution-Agnostic Voxel-Level Encoding for Native fMRIcited by 6
- 2025Voxel-Level Brain States Prediction Using Swin Transformercited by 5
- 2024A Demographic-Conditioned Variational Autoencoder for fMRI Distribution Sampling and Removal of Confoundscited by 3
- 20254D Multimodal Co-attention Fusion Network with Latent Contrastive Alignment for Alzheimer's Diagnosiscited by 3
- 2025Diffusion-Based Cross-Modal Feature Extraction for Multi-Label Classificationcited by 3
- 2025Scalable Diffusion Transformer for Conditional 4D fMRI Synthesiscited by 2
- 2025EEGDM: Learning EEG Representation with Latent Diffusion Modelcited by 1
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Beyond Single-Source Cognitive Taskonomy:Multi-Source Task Relations through fMRI Transfer Learningcited by 1
- 2026BrainTaskonomy: Learning How to Pretrain and What to Transfer in fMRI Foundation Modelscited by 1
- 2026Omni-Sleep: A Sleep Foundation Model via Hierarchical Contrastive Learning of CNS-ANS Dynamicscited by 0
- 2026A Scaling Study for fMRI Foundation Modelscited by 0
- 2026FlatClip: Reusing Image Foundation Models for fMRI Representation Learning via Cortical Flatmapscited by 0
- 2026FlatClip: Reusing Image Foundation Models for fMRI Representation Learning via Cortical Flatmaps25 Sep 2026
- 2026A Scaling Study for fMRI Foundation Models23 Sep 2026
- 2026BrainTaskonomy: Learning How to Pretrain and What to Transfer in fMRI Foundation Models9 Sep 2026
- 2026Omni-Sleep: A Sleep Foundation Model via Hierarchical Contrastive Learning of CNS-ANS Dynamics4 Jul 2026
- 2026Beyond Single-Source Cognitive Taskonomy:Multi-Source Task Relations through fMRI Transfer Learning24 Jun 2026