mlsanityData to 14 Oct 2026

Cross-modal learning for SAR target recognition using optical vision foundation models

arXiv 2609.07753 ↗First posted 7 Sep 2026cs.CV cs.LG eess.IVcited by 0

Not on the map. Why?

Abstract (arXiv)

Synthetic Aperture Radar (SAR) is an important modality in a wide range of imaging applications due to its versatile, long range and near all weather operating capabilities. However, Automatic Target Recognition (ATR) remains a challenging problem due to limited labelled data, the strong speckle in SAR images and the significant domain gap between SAR and more abundant optical imagery. In contrast, electro-optical (EO) imagery benefits from massive datasets, clearer visual structure and powerful foundation models. In this work, we investigate how vision foundation models trained on optical data can provide class level supervision for SAR classification. We propose a cross-modal EO to SAR prototype alignment framework in which a frozen EO encoder, based on a DINOv3 vision foundation model, is used to construct class level optical prototypes without requiring strict EO/SAR pairs. A SAR model is then trained to classify SAR images while aligning its embeddings to the corresponding EO class prototype. At inference time, the SAR model operates independently, without access to optical imagery. We evaluate our approach on the UNICORNv2 dataset, an EO and SAR dataset of civilian vehicles with heavily speckled images and severe class imbalance. EO prototype alignment improves SAR classification accuracy over frozen DINOv3, SAR only finetuning and unpaired distribution alignment baselines, and t-SNE visualizations provide qualitative evidence of clearer separation among classes in the trained SAR embedding space. These results suggest that optical vision foundation models, despite being trained on visible spectrum imagery, provide transferable information for SAR image classification, offering a practical method for using large scale pretrained vision foundation models across challenging sensing modalities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 7 Sep 2026.

Builds on

12 of 22 references.

References · 12

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  2. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  3. 2025DINOv3cited by 1,414
  4. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,329
  5. 2013Zero-Shot Learning Through Cross-Modal Transfercited by 237
  6. 2023Identifiability Results for Multimodal Contrastive Learningcited by 61
  7. 2024SARATR-X: Toward Building A Foundation Model for SAR Target Recognitioncited by 25
  8. 2020Deep Learning Methods For Synthetic Aperture Radar Image Despeckling: An Overview Of Trends And Perspectivescited by 13
  9. 2025ATRNet-STAR: A Large Dataset and Benchmark Towards Remote Sensing Object Recognition in the Wildcited by 12
  10. 2025Fifty Years of SAR Automatic Target Recognition: The Road Forwardcited by 6
  11. 2024Identifiable Shared Component Analysis of Unpaired Multimodal Mixturescited by 3
  12. 2025On the Status of Foundation Models for SAR Imagerycited by 3

Built on by

Not cited yet.