TokaMind for Power Grid: Cross-Domain Transfer from Fusion Plasma
Not on the map. Why?
Abstract (arXiv)
TokaMind is a multi-modal transformer (MMT) foundation model pre-trained on tokamak plasma diagnostics data from MAST, where it was shown to outperform CNN-based approaches on fusion benchmarks. We investigate whether its learned representations generalize to physically distinct but structurally analogous domains. Through systematic experimentation across four domains-industrial bearing degradation, NASA CMAPSS turbofan degradation, and two independent power grid PMU datasets-we identify four transfer-favoring characteristics that help explain where TokaMind's pretrained representations are most effective. Power grid synchrophasor data matches this target-domain profile most directly, while industrial degradation datasets demonstrate that TokaMind can still yield useful performance under partial alignment, especially when task design and feature construction expose physically meaningful degradation structure. On the GESL/PNNL 500-event benchmark with provider-aware evaluation, TokaMind achieves test F1 = 0.837 ± 0.040 (3~seeds) for severe event classification. Our central finding, however, is not the aggregate score: classification difficulty is structurally determined by provider-level grid topology, not model capacity. In the single-window early-warning regime, TokaMind outperforms a CNN baseline (F1~0.889 vs.~0.878)--a reversal that disappears as more event windows are provided. Furthermore, Critical Slowing Down (CSD) indicators, used as a confidence gate rather than a classification label, improve F1 from 0.696 to 0.750 at 63% coverage-outperforming the CNN baseline (0.636) at any coverage level. These results establish the first cross-domain validation of TokaMind outside nuclear fusion and propose a transferability framework and revised evaluation protocol for multi-source PMU datasets.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 40 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
11 of 40 references.
References · 11
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,058
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2022A Generalist Agentcited by 808
- 2023Time-LLM: Time Series Forecasting by Reprogramming Large Language Modelscited by 700
- 2022Scientific Machine Learning through Physics-Informed Neural Networks: Where we are and What's nextcited by 608
- 2017Predict Responsibly: Improving Fairness and Accuracy by Learning to Defercited by 233
- 2023Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer Behaviorcited by 131
- 2026TokaMind: A Multi-Modal Transformer Foundation Model for Tokamak Plasma Dynamicscited by 4
Built on by
Not cited yet.