Contrastive Heliophysical Image Pretraining for Solar Dynamics Observatory Records
Not on the map. Why?
Abstract (arXiv)
Deep learning has revolutionized solar image analysis, yet most approaches train task-specific encoders from scratch or rely on natural-image pretraining that ignores the unique characteristics of Solar Dynamics Observatory (SDO) data. We introduce SolarCHIP, a family of contrastively pretrained visual backbones tailored to multi-instrument SDO observations. SolarCHIP addresses three key challenges in solar imaging: multimodal sensing across AIA and HMI instruments, weak inter-class separability due to slow temporal evolution, and strong intra-class variability with sparse activity signals. Our pretraining framework employs a multi-granularity contrastive objective that jointly aligns (1) global class tokens across co-temporal AIA-HMI pairs to enhance temporal discrimination, (2) local patch tokens at fixed spatial indices to enforce position-consistent, modality-invariant features, and (3) intra-sample patches across different spatial locations to preserve fine-grained spatial structure. We train both CNN- and Vision Transformer-based autoencoders and demonstrate their effectiveness on two downstream tasks: cross-modal translation between HMI and AIA passbands via ControlNet, and full-disk flare classification. Experimental results show that SolarCHIP achieves state-of-the-art performance across both tasks, with particularly strong gains in low-resource settings where labeled data is limited. Ablation studies confirm that each contrastive component contributes essential discriminative capacity at different granularities. By publicly releasing pretrained weights and training code, we provide the heliophysics community with a practical, plug-and-play feature extractor that reduces computational requirements, improves label efficiency, and establishes a reusable foundation for diverse solar imaging applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 62 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
33 of 62 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
21 more
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2025DINOv3cited by 1,414
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 577
- 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
- 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
- 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2021Self-Supervised Learning with Swin Transformerscited by 122
- 2021How to Train Your Flare Prediction Model: Revisiting Robust Sampling of Rare Eventscited by 26
- 2022Deep transfer learning for image classification: a surveycited by 13
- 2023Explaining Full-disk Deep Learning Model for Solar Flare Prediction using Attribution Methodscited by 12
- 2017Enhancing SDO/HMI images using deep learningcited by 11
- 2022Exploring the Limits of Synthetic Creation of Solar EUV Images via Image-to-Image Translationcited by 6
- 2025Surya: Foundation Model for Heliophysicscited by 6
- 2024Advancing Solar Flare Prediction using Deep Learning with Active Region Patchescited by 4
- 2024Solaris: A Foundation Model of the Suncited by 4
- 2024A Foundation Model for the Solar Dynamics Observatorycited by 3
- 2024AI Foundation Model for Heliophysics: Applications, Design, and Implementationcited by 3
- 2022Image Processing Methods for Coronal Hole Segmentation, Matching, and Map Classificationcited by 2
Built on by
Not cited yet.