mlsanityData to 14 Oct 2026

Flow Matching with In-Context Priors for Out-of-Distribution Brain Dynamics

arXiv 2606.11833 ↗First posted 10 Jun 2026cs.LG q-bio.NCcited by 1

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Flow matching and diffusion models enable conditional generation across domains ranging from images to proteins, with recent extensions to out-of-distribution contexts. Yet generative models of neural time series have largely remained restricted to categorical conditioning, precluding compositional and zero-shot generalization. In this work, we propose a per-timestep conditioned diffusion transformer for generating realistic fMRI brain dynamics during unseen cognitive tasks by injecting both compositional language and optional spatial priors in-context. Such zero-shot generation could enable counterfactual neuroscience by supporting in-silico design and evaluation of novel cognitive experiments before empirical validation. Leveraging this model, we evaluate across hundreds of held-out task conditions and characterize predictive performance in relation to the training manifold. From language alone, the model recovers region-specific recruitment across tasks and held-out spatial activation patterns. Spatial priors, when available, complement the text pathway by anchoring generation in regions of task space where language alone degrades, while retaining the compositional structure needed for counterfactual task specification. To our knowledge this is the first generative model of whole-cortex fMRI dynamics for unseen cognitive tasks, advancing counterfactual neuroscience and data-driven experimental design.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 25 of its 61 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

25 of 61 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Brain-DiT: A Universal Multi-state fMRI Foundation Model with Metadata-Conditioned Pretraining14 Apr
  2. 2025Scalable Diffusion Transformer for Conditional 4D fMRI Synthesis28 Nov
  3. 2025T2I-Diff: fMRI Signal Generation via Time-Frequency Image Transform and Classifier-Free Denoising Diffusion Models25 Sep
  4. 2023Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priors29 May
  5. 2023Natural scene reconstruction from fMRI signals using generative latent diffusion9 Mar

Other references · 20

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2022Scalable Diffusion Models with Transformerscited by 6,054
  6. 2022Classifier-Free Diffusion Guidancecited by 5,847
  7. 2022Flow Matching for Generative Modelingcited by 5,702
  8. 2022Equivariant Diffusion for Molecule Generation in 3Dcited by 677
  9. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  10. 2022Structure-based Drug Design with Equivariant Diffusion Modelscited by 217
  11. 2022Equivariant 3D-Conditional Diffusion Models for Molecular Linker Designcited by 122
  12. 2022Exploring Chemical Space with Score-based Out-of-distribution Generationcited by 95
8 more
  1. 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 65
  2. 2026A foundation model of vision, audition, and language for in-silico neurosciencecited by 13
  3. 2025fMRI-LM: Towards a Universal Foundation Model for Language-Aligned fMRI Understandingcited by 7
  4. 2024EEG-Language Pretraining for Highly Label-Efficient Clinical Phenotypingcited by 6
  5. 2025Scaling Vision Transformers for Functional MRI with Flat Mapscited by 5
  6. 2025Brain-Semantoks: Learning Semantic Tokens of Brain Dynamics with a Self-Distilled Foundation Modelcited by 4
  7. 2025Brain-language fusion enables interactive neural readout and in-silico experimentationcited by 3
  8. 2026BrainCast: A Spatio-Temporal Forecasting Model for Whole-Brain fMRI Time Series Predictioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026FM-fMRI: Event Conditioned Flow Matching for Rest-to-Task fMRI Time-Series Synthesis
  2. 2026MultiFlow: Vision-Driven Multimodal fMRI Encoding via Stimulus-Informed Source Flow Matching
  3. 2026Probabilistic Prediction of Neural Dynamics via Autoregressive Flow Matching
  4. 2025Diff2Flow: Training Flow Matching Models via Diffusion Model Alignment
  5. 2026StimFlow: Synthesizing Brain Activity from Images via Stimulus-conditioned Flow Matching
  6. 2023DreaMR: Diffusion-driven Counterfactual Explanation for Functional MRI
  7. 2026Mechanism Shift During Post-training from Autoregressive to Masked Diffusion Language Models
  8. 2025Multitask Learning with Stochastic Interpolants