mlsanityData to 14 Oct 2026

SARATR-X-v2: Scale-Aware Structural Pre-Training for SAR Foundation Models

arXiv 2607.23238 ↗First posted 25 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Masked image modeling has become a dominant paradigm for SAR pre-training, yet the design of the reconstruction target remains fundamentally unsettled. This article argues that a SAR pre-training target should satisfy two conditions to produce transferable representations: (i) physics-grounded stability, i.e., approximate invariance of the target operator to multiplicative speckle inherent in coherent imaging; and (ii) semantic scale compatibility, i.e., coverage of the heterogeneous spatial scales that downstream tasks demand. These two conditions are individually achievable but jointly difficult: physics-grounded stability favors fixed operators, while semantic scale compatibility favors data-driven composition. To this end, SARATR-X-v2 reconciles both within a single design. The target is constructed through fixed structural extractors spanning six receptive fields, from blind-spot local aggregation to directional log-ratio region contrast, and fused via learnable weights into one unified supervision signal for masked reconstruction. On twelve SAR benchmarks across classification, detection, and segmentation, SARATR-X-v2 achieves state-of-the-art transfer performance. Under synthetic speckle variation, the proposed target reduces perturbation drift in the learned supervision by nearly two orders of magnitude relative to pixel-space supervision. Taken together, these results support physics-grounded stability and semantic scale compatibility as a principled framework for pre-training target design under coherent imaging, and suggest that effective SAR pre-training is not about reconstructing more signal, but about reconstructing the right structural target.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 118 references that are in the map. First posted on arXiv 25 Jul 2026.

Builds on

13 of 118 references.

References · 13

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
  3. 2024VMamba: Visual State Space Modelcited by 969
  4. 2025M4-SAR: A Multi-Resolution, Multi-Polarization, Multi-Scene, Multi-Source Dataset and Benchmark for optical-SAR Object Detectioncited by 10
  5. 2025Visual Instruction Pretraining for Domain-Specific Foundation Modelscited by 9
  6. 2025SARMAE: Masked Autoencoder for SAR Representation Learningcited by 8
  7. 2025A Complex-valued SAR Foundation Model Based on Physically Inspired Representation Learningcited by 5
  8. 2026CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentationcited by 4
  9. 2025On the Status of Foundation Models for SAR Imagerycited by 3
  10. 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensingcited by 3
  11. 2026HuiYanEarth-SAR: A Foundation Model for High-Fidelity and Low-Cost Global Remote Sensing Imagery Generationcited by 2
  12. 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagerycited by 1
1 more
  1. 2026SAMBA: A Scatter-Guided Masked Bidirectional Mamba Foundation Model for SAR Target Recognitioncited by 1

Built on by

Not cited yet.