mlsanityData to 7 Oct 2026

Multimodal Super-Resolution: Discovering hidden physics and its application to fusion plasmas

arXiv 2405.05908 ↗First posted 9 May 2024physics.plasm-ph cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

A non-linear system governed by multi-spatial and multi-temporal physics scales cannot be fully understood with a single diagnostic, as each provides only a partial view, leading to information loss. Combining multiple diagnostics may also result in incomplete projections of the system's physics. By identifying hidden inter-correlations between diagnostics, we can leverage mutual support to fill in these gaps, but uncovering such correlations analytically is too complex. We introduce a machine learning methodology to address this issue. Unlike traditional methods, our multimodal approach does not rely on the target diagnostic's direct measurements to generate its super-resolution version. Instead, it uses other diagnostics to produce super-resolution data, capturing detailed structural evolution and responses to perturbations previously unobservable. This not only enhances the resolution of a diagnostic for deeper insights but also reconstructs the target diagnostic, providing a valuable tool to mitigate diagnostic failure. This methodology addresses a key challenge in fusion plasmas: the Edge Localized Mode (ELM), a plasma instability that can cause significant erosion of plasma-facing materials. A method to stabilize ELM is using resonant magnetic perturbation (RMP) to trigger magnetic islands. However, limited spatial and temporal resolution restricts analysis of these islands due to their small size, rapid dynamics, and complex plasma interactions. With super-resolution diagnostics, we can experimentally verify theoretical models of magnetic islands for the first time, providing insights into their role in ELM stabilization. This advancement supports the development of effective ELM suppression strategies for future fusion reactors like ITER and has broader applications, potentially revolutionizing diagnostics in fields such as astronomy, astrophysics, and medical imaging.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 14 of its 92 references that are in the map. First posted on arXiv 9 May 2024.

Builds on

14 of 92 references.

References · 14

  1. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
  2. 2016Variational Inference: A Review for Statisticianscited by 1,466
  3. 2017Video Enhancement with Task-Oriented Flowcited by 612
  4. 2019MelGAN: Generative Adversarial Networks for Conditional Waveform Synthesiscited by 351
  5. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 321
  6. 2019Depth-Aware Video Frame Interpolationcited by 232
  7. 2018Adversarial Audio Synthesiscited by 222
  8. 2017SEGAN: Speech Enhancement Generative Adversarial Networkcited by 165
  9. 2018Context-aware Synthesis for Video Frame Interpolationcited by 153
  10. 2017Estimating Missing Data in Temporal Data Streams Using Multi-directional Recurrent Neural Networkscited by 86
  11. 2023Super-Resolution Analysis via Machine Learning: A Survey for Fluid Flowscited by 30
  12. 2021Deep-Learning-Based Single-Image Height Reconstruction from Very-High-Resolution SAR Intensity Datacited by 6
2 more
  1. 2019From Here to There: Video Inbetweening Using Direct 3D Convolutionscited by 3
  2. 2024Single-sample image-fusion upsampling of fluorescence lifetime imagescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 4.

5 papers.