Dual-Space Modality Consistency Learning for Universal Cross-Modal Re-Identification
Not on the map. Why?
Abstract (arXiv)
Cross-modal Re-Identification (ReID) aims to retrieve the same identity across heterogeneous imaging modalities and has been widely studied in visible-infrared person ReID and cross-modal ship ReID. Existing methods have achieved promising performance by learning modality consistency in the spatial embedding space, yet often overlook frequency-domain modality discrepancy, particularly in high-frequency representations that are both highly discriminative and modality-sensitive. In addition, most approaches are tailored to specific modality settings, limiting their applicability across diverse cross-modal scenarios. To address these challenges, we propose a Dual-Space Modality Consistency Learning (DSMCL) framework for universal cross-modal ReID. Specifically, DSMCL jointly models spatial feature distribution consistency and frequency-domain discriminative consistency. A Spatial Modality Consistency Learning (SMCL) branch performs Gaussian-based feature alignment, while a Frequency-aware Discriminative Consistency Learning (FDCL) strategy regularizes high-frequency representations through identity-aware cross-modal contrastive learning. By jointly capturing modality-specific characteristics and modality-shared identity cues, DSMCL learns robust representations and establishes a unified framework capable of accommodating diverse heterogeneous modality settings. Moreover, DSMCL is a plug-and-play framework that can be readily integrated into existing cross-modal ReID architectures. Extensive experiments on SYSU-MM01, RegDB, LLCM, HOSS-ReID, and CMShipReID across seventeen evaluation protocols show that DSMCL consistently improves multiple representative baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 77 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
39 of 77 references.
References · 39
- 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 549
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2021TransReID: Transformer-based Object Re-Identificationcited by 435
- 2020Learning in the Frequency Domaincited by 198
- 2022CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labelscited by 181
- 2023Beyond Appearance: a Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Taskscited by 96
- 2023Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identificationcited by 79
- 2021Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularizationcited by 69
- 2021Neural Feature Search for RGB-Infrared Person Re-Identificationcited by 50
- 2023Instruct-ReID: A Multi-purpose Person Re-identification Task with Instructionscited by 46
- 2022Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identificationcited by 40
- 2023Shape-Erased Feature Learning for Visible-Infrared Person Re-Identificationcited by 38
27 more
- 2023Modality Unifying Network for Visible-Infrared Person Re-Identificationcited by 27
- 2024Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identificationcited by 25
- 2024CLIP-Driven Semantic Discovery Network for Visible-Infrared Person Re-Identificationcited by 19
- 2023High-Order Structure Based Middle-Feature Learning for Visible-Infrared Person Re-Identificationcited by 16
- 2024RLE: A Unified Perspective of Data Augmentation for Cross-Spectral Re-identificationcited by 16
- 2024A Versatile Framework for Multi-scene Person Re-identificationcited by 14
- 2019Attend to the Difference: Cross-Modality Person Re-identification via Contrastive Correlationcited by 10
- 2024Adaptive High-Frequency Transformer for Diverse Wildlife Re-Identificationcited by 10
- 2025Diffusion-based Synthetic Data Generation for Visible-Infrared Person Re-Identificationcited by 10
- 2023Bridging the Gap: Multi-Level Cross-Modality Joint Alignment for Visible-Infrared Person Re-Identificationcited by 8
- 2025Cross-modal Ship Re-Identification via Optical and SAR Imagery: A Novel Dataset and Methodcited by 8
- 2024WRIM-Net: Wide-Ranging Information Mining Network for Visible-Infrared Person Re-Identificationcited by 7
- 2023Adaptive Generation of Privileged Intermediate Information for Visible-Infrared Person Re-Identificationcited by 6
- 2024CCUP: A Controllable Synthetic Data Generation Pipeline for Pretraining Cloth-Changing Person Re-Identification Modelscited by 6
- 2025Modality-Transition Representation Learning for Visible-Infrared Person Re-Identificationcited by 6
- 2025Try Harder: Hard Sample Generation and Learning for Clothes-Changing Person Re-IDcited by 5
- 2025X-ReID: Multi-granularity Information Interaction for Video-Based Visible-Infrared Person Re-Identificationcited by 4
- 2022Variational Distillation for Multi-View Learningcited by 3
- 2025Diverse Semantics-Guided Feature Alignment and Decoupling for Visible-Infrared Person Re-Identificationcited by 3
- 2025SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysiscited by 3
- 2025MOS: Mitigating Optical-SAR Modality Gap for Cross-Modal Ship Re-Identificationcited by 3
- 2026BIT: Matching-based Bi-directional Interaction Transformation Network for Visible-Infrared Person Re-Identificationcited by 3
- 2026Towards Robust Text-to-Image Person Retrieval: Multi-View Reformulation for Semantic Compensationcited by 2
- 2026MFEN:Multi-Frequency Expert Network for Visible-Infrared Person Re-IDcited by 2
- 2025FreqCross: A Multi-Modal Frequency-Spatial Fusion Network for Robust Detection of Stable Diffusion 3.5 Generated Imagescited by 1
- 2025Beyond Weight Adaptation: Feature-Space Domain Injection for Cross-Modal Ship Re-Identificationcited by 1
- 2026SDF-Net: Structure-Aware Disentangled Feature Learning for Opticall-SAR Ship Re-identificationcited by 1
Built on by
Not cited yet.