MOS: Mitigating Optical-SAR Modality Gap for Cross-Modal Ship Re-Identification
Not on the map. Why?
Abstract (arXiv)
Cross-modal ship re-identification (ReID) between optical and synthetic aperture radar (SAR) imagery has recently emerged as a critical yet underexplored task in maritime intelligence and surveillance. However, the substantial modality gap between optical and SAR images poses a major challenge for robust identification. To address this issue, we propose MOS, a novel framework designed to mitigate the optical-SAR modality gap and achieve modality-consistent feature learning for optical-SAR cross-modal ship ReID. MOS consists of two core components: (1) Modality-Consistent Representation Learning (MCRL) applies denoise SAR image procession and a class-wise modality alignment loss to align intra-identity feature distributions across modalities. (2) Cross-modal Data Generation and Feature fusion (CDGF) leverages a brownian bridge diffusion model to synthesize cross-modal samples, which are subsequently fused with original features during inference to enhance alignment and discriminability. Extensive experiments on the HOSS ReID dataset demonstrate that MOS significantly surpasses state-of-the-art methods across all evaluation protocols, achieving notable improvements of +3.0%, +6.2%, and +16.4% in R1 accuracy under the ALL to ALL, Optical to SAR, and SAR to Optical settings, respectively. The code and trained models will be released upon publication.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 31 of its 59 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
31 of 59 references.
References · 31
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Generative Adversarial Networkscited by 5,627
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 786
- 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 549
- 2021TransReID: Transformer-based Object Re-Identificationcited by 435
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2023Beyond Appearance: a Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Taskscited by 96
19 more
- 2023Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identificationcited by 79
- 2024Dual Diffusion for Unified Image Generation and Understandingcited by 76
- 2021Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondencescited by 66
- 2023Instruct-ReID: A Multi-purpose Person Re-identification Task with Instructionscited by 46
- 2021CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identificationcited by 38
- 2021The QXS-SAROPT Dataset for Deep Learning in SAR-Optical Data Fusioncited by 27
- 2025From Poses to Identity: Training-Free Person Re-Identification via Feature Centralizationcited by 17
- 2024A Versatile Framework for Multi-scene Person Re-identificationcited by 14
- 2023Exploring Fine-Grained Representation and Recomposition for Cloth-Changing Person Re-Identificationcited by 12
- 2023Bridging the Gap: Multi-Level Cross-Modality Joint Alignment for Visible-Infrared Person Re-Identificationcited by 8
- 2024DLCR: A Generative Data Expansion Framework via Diffusion for Clothes-Changing Person Re-IDcited by 8
- 2025Identity-aware Feature Decoupling Learning for Clothing-change Person Re-identificationcited by 8
- 2025Cross-modal Ship Re-Identification via Optical and SAR Imagery: A Novel Dataset and Methodcited by 8
- 2023Identity-Guided Collaborative Learning for Cloth-Changing Person Reidentificationcited by 7
- 2023Automatic Synthetic Data and Fine-grained Adaptive Feature Alignment for Composed Person Retrievalcited by 6
- 2024CCUP: A Controllable Synthetic Data Generation Pipeline for Pretraining Cloth-Changing Person Re-Identification Modelscited by 6
- 2025Try Harder: Hard Sample Generation and Learning for Clothes-Changing Person Re-IDcited by 5
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysiscited by 3
- 2025Resolution as a Direction: Vector-Panning Feature Alignment for Cross-Resolution Re-Identificationcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Better with Less: Tackling Heterogeneous Multi-Modal Image Joint Pretraining via Conditioned and Degraded Masked Autoencoder
- 2026SARES-DEIM: Sparse Mixture-of-Experts Meets DETR for Robust SAR Ship Detection
- 2025PromptMID: Modal Invariant Descriptors Based on Diffusion and Vision Foundation Models for Optical-SAR Image Matching
- 2023Cross Modal Distillation for Flood Extent Mapping
- 2026MM-OVSeg:Multimodal Optical-SAR Fusion for Open-Vocabulary Segmentation in Remote Sensing
- 2025Multi-Expert Learning Framework with the State Space Model for Optical and SAR Image Registration
- 2025RingMoE: Mixture-of-Modality-Experts Multi-Modal Foundation Models for Universal Remote Sensing Image Interpretation
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagery