Cross-Subject Modeling for Widefield Calcium Imaging via Atlas-Aligned Spatiotemporal Tokenization
Not on the map. Why?
Abstract (arXiv)
Large-scale, multi-subject widefield calcium imaging provides unprecedented access to brain-wide cortical dynamics. However, the high dimensionality, complex spatiotemporal structure, and substantial task-irrelevant activity in widefield recordings have largely restricted modeling efforts to single-session analyses, limiting scalability and generalization. While multi-subject pretrained models have been explored for some neural modalities, multi-subject models for widefield calcium imaging have not yet been demonstrated; further, subject-invariant zero-shot behavior decoding remains elusive for multi-subject models across neural modalities more broadly. As a first step toward foundation modeling of widefield data, we introduce WiCAT, a multi-subject model that leverages self-supervised pretraining to both outperform single-session models and enable zero-shot behavior decoding on unseen subjects. WiCAT introduces an atlas-grounded tokenization scheme without session-specific components and learns globally shared spatiotemporal representations. Across multiple widefield datasets, the pretrained model supports lightweight downstream decoding, transfers across subjects, tasks, and datasets, and outperforms baseline models. Notably, the model also achieves robust zero-shot continuous behavior decoding and left-out brain region reconstruction on unseen subjects.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 59 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
25 of 59 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,492
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2022Learnable latent embeddings for joint behavioral and neural analysiscited by 117
- 2023BrainBERT: Self-supervised representation learning for intracranial recordingscited by 72
- 2024Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Maskingcited by 65
- 2023A Unified, Scalable Framework for Neural Population Decodingcited by 61
13 more
- 2024Towards a "universal translator" for neural dynamics at single-cell, single-spike resolutioncited by 28
- 2024Population Transformer: Learning Population-level Representations of Neural Activitycited by 26
- 2025Neural Encoding and Decoding at Scalecited by 20
- 2024Neural decoding from stereotactic EEG: accounting for electrode variability across subjectscited by 17
- 2021Challenges for machine learning in clinical translation of big data imaging studiescited by 15
- 2024Du-IN: Discrete units-guided mask modeling for decoding speech from Intracranial Neural signalscited by 12
- 2024Exploring Behavior-Relevant and Disentangled Neural Dynamics with Generative Diffusion Modelscited by 9
- 2025BRAID: Input-Driven Nonlinear Dynamical Modeling of Neural-Behavioral Datacited by 8
- 2025BaRISTA: Brain Scale Informed Spatiotemporal Representation of Human Intracranial Neural Activitycited by 7
- 2025Dynamical Modeling of Behaviorally Relevant Spatiotemporal Patterns in Neural Imaging Datacited by 6
- 2025Cross-Modal Representational Knowledge Distillation for Enhanced Spike-Informed LFP Modelingcited by 3
- 2025Dynamical modeling of nonlinear latent factors in multiscale neural activity with real-time inferencecited by 2
- 2020Chronic, cortex-wide imaging of specific cell populations during behaviorcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.