Multimodal Super-Resolution: Discovering hidden physics and its application to fusion plasmas
Not on the map. Why?
Abstract (arXiv)
A non-linear system governed by multi-spatial and multi-temporal physics scales cannot be fully understood with a single diagnostic, as each provides only a partial view, leading to information loss. Combining multiple diagnostics may also result in incomplete projections of the system's physics. By identifying hidden inter-correlations between diagnostics, we can leverage mutual support to fill in these gaps, but uncovering such correlations analytically is too complex. We introduce a machine learning methodology to address this issue. Unlike traditional methods, our multimodal approach does not rely on the target diagnostic's direct measurements to generate its super-resolution version. Instead, it uses other diagnostics to produce super-resolution data, capturing detailed structural evolution and responses to perturbations previously unobservable. This not only enhances the resolution of a diagnostic for deeper insights but also reconstructs the target diagnostic, providing a valuable tool to mitigate diagnostic failure. This methodology addresses a key challenge in fusion plasmas: the Edge Localized Mode (ELM), a plasma instability that can cause significant erosion of plasma-facing materials. A method to stabilize ELM is using resonant magnetic perturbation (RMP) to trigger magnetic islands. However, limited spatial and temporal resolution restricts analysis of these islands due to their small size, rapid dynamics, and complex plasma interactions. With super-resolution diagnostics, we can experimentally verify theoretical models of magnetic islands for the first time, providing insights into their role in ELM stabilization. This advancement supports the development of effective ELM suppression strategies for future fusion reactors like ITER and has broader applications, potentially revolutionizing diagnostics in fields such as astronomy, astrophysics, and medical imaging.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 14 of its 92 references that are in the map. First posted on arXiv 9 May 2024.
Builds on
14 of 92 references.
References · 14
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2017Video Enhancement with Task-Oriented Flowcited by 612
- 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
- 2019Depth-Aware Video Frame Interpolationcited by 232
- 2018Adversarial Audio Synthesiscited by 222
- 2017SEGAN: Speech Enhancement Generative Adversarial Networkcited by 165
- 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
- 2017Estimating Missing Data in Temporal Data Streams Using Multi-directional Recurrent Neural Networkscited by 86
- 2023Super-Resolution Analysis via Machine Learning: A Survey for Fluid Flowscited by 30
- 2021Deep-Learning-Based Single-Image Height Reconstruction from Very-High-Resolution SAR Intensity Datacited by 6
2 more
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026TokaMind: A Multi-Modal Transformer Foundation Model for Tokamak Plasma Dynamicscited by 3
- 2025Improving ideal MHD equilibrium accuracy with physics-informed neural networkscited by 1
- 2026Energy-based models for diagnostic reconstruction and analysis in a laboratory plasma devicecited by 0
- 2026Benchmarking Sensor Robustness in Plasma Diagnostic Models: A Systematic Evaluation on TokaMarkcited by 0
- 2026Towards Large-Scale Heterogeneous Data Organization for Scientific Foundation Models: A Nuclear Fusion Case Studycited by 0
- 2026Towards Large-Scale Heterogeneous Data Organization for Scientific Foundation Models: A Nuclear Fusion Case Study27 Aug 2026
- 2026Benchmarking Sensor Robustness in Plasma Diagnostic Models: A Systematic Evaluation on TokaMark5 Jul 2026
- 2026Energy-based models for diagnostic reconstruction and analysis in a laboratory plasma device9 May 2026
- 2026TokaMind: A Multi-Modal Transformer Foundation Model for Tokamak Plasma Dynamics16 Feb 2026
- 2025Improving ideal MHD equilibrium accuracy with physics-informed neural networks3 Jul 2025