CalM: A Self-Supervised Foundation Model for Population Dynamics in Calcium Imaging Data
Not on the map. Why?
Abstract (arXiv)
Recent work suggests that large-scale, multi-animal modeling can significantly improve neural recording analysis. However, for functional calcium traces, existing approaches remain task-specific, limiting transfer across common neuroscience objectives. To address this challenge, we propose CalM, a self-supervised neural foundation model trained solely on neuronal calcium traces and adaptable to multiple downstream tasks, including forecasting and decoding. Our key contribution is a pretraining framework, composed of a high-performance tokenizer mapping single-neuron traces into a shared discrete vocabulary, and a dual-axis autoregressive transformer modeling dependencies along both the neural and the temporal axis. We evaluate CalM on a large-scale, multi-animal, multi-session dataset. On the neural population dynamics forecasting task, CalM achieves competitive performance against strong specialized baselines after pretraining. With a task-specific head, CalM further adapts to the behavior decoding task and achieves superior results compared with supervised decoding models. Moreover, linear analyses of CalM representations reveal interpretable functional structures beyond predictive accuracy. Taken together, we propose a novel and effective self-supervised pretraining paradigm for foundation models based on calcium traces, paving the way for scalable pretraining and broad applications in functional neural analysis. Code is released at https://github.com/TSuXinH/CalM.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 52 references that are in the map. First posted on arXiv 3 Apr 2026.
Builds on
22 of 52 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 2,039
- 2020GLU Variants Improve Transformercited by 1,804
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2025OpenAI GPT-5 System Cardcited by 989
- 2023iTransformer: Inverted Transformers Are Effective for Time Series Forecastingcited by 931
- 2022Learnable latent embeddings for joint behavioral and neural analysiscited by 117
10 more
- 2021Representation learning for neural population activity with Neural Data Transformerscited by 50
- 2017Machine learning for neural decodingcited by 45
- 2016Recurrent switching linear dynamical systemscited by 35
- 2016LFADS - Latent Factor Analysis via Dynamical Systemscited by 30
- 2024Towards a "universal translator" for neural dynamics at single-cell, single-spike resolutioncited by 28
- 2025Neural Encoding and Decoding at Scalecited by 20
- 2022Seeing the forest and the tree: Building representations of both individual and collective dynamics with transformerscited by 18
- 2023Neuroformer: Multimodal and Multitask Generative Pretraining for Brain Datacited by 11
- 2025POCO: Scalable Neural Forecasting through Population Conditioningcited by 7
- 2025Inpainting the Neural Picture: Inferring Unrecorded Brain Area Dynamics from Multi-Animal Datasetscited by 4
Built on by
Not cited yet.