# Dual-Space Modality Consistency Learning for Universal Cross-Modal Re-Identification

arXiv: https://arxiv.org/abs/2608.06943 · HTML: https://mlsanity.com/paper/2608.06943/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 39 of its 77 references that are in the map.
- First posted on arXiv 7 Aug 2026.

## Builds on (most cited first, 30 of 39)

- [Deep Learning for Person Re-identification: A Survey and Outlook](https://mlsanity.com/paper/2001.04193/) (2020)
- [Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Clues](https://mlsanity.com/paper/2007.09355/) (2020)
- [TransReID: Transformer-based Object Re-Identification](https://mlsanity.com/paper/2102.04378/) (2021)
- [Learning in the Frequency Domain](https://mlsanity.com/paper/2002.12416/) (2020)
- [CLIP-ReID: Exploiting Vision-Language Model for Image Re-Identification without Concrete Text Labels](https://mlsanity.com/paper/2211.13977/) (2022)
- [Beyond Appearance: a Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Tasks](https://mlsanity.com/paper/2303.17602/) (2023)
- [Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2303.14481/) (2023)
- [Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization](https://mlsanity.com/paper/2103.15537/) (2021)
- [Neural Feature Search for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2104.02366/) (2021)
- [Instruct-ReID: A Multi-purpose Person Re-identification Task with Instructions](https://mlsanity.com/paper/2306.07520/) (2023)
- [Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2212.00226/) (2022)
- [Shape-Erased Feature Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2304.04205/) (2023)
- [Modality Unifying Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2309.06262/) (2023)
- [Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2403.11708/) (2024)
- [CLIP-Driven Semantic Discovery Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2401.05806/) (2024)
- [High-Order Structure Based Middle-Feature Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2312.07853/) (2023)
- [RLE: A Unified Perspective of Data Augmentation for Cross-Spectral Re-identification](https://mlsanity.com/paper/2411.01225/) (2024)
- [A Versatile Framework for Multi-scene Person Re-identification](https://mlsanity.com/paper/2403.11121/) (2024)
- [Attend to the Difference: Cross-Modality Person Re-identification via Contrastive Correlation](https://mlsanity.com/paper/1910.11656/) (2019)
- [Adaptive High-Frequency Transformer for Diverse Wildlife Re-Identification](https://mlsanity.com/paper/2410.06977/) (2024)
- [Diffusion-based Synthetic Data Generation for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2503.12472/) (2025)
- [Bridging the Gap: Multi-Level Cross-Modality Joint Alignment for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2307.08316/) (2023)
- [Cross-modal Ship Re-Identification via Optical and SAR Imagery: A Novel Dataset and Method](https://mlsanity.com/paper/2506.22027/) (2025)
- [WRIM-Net: Wide-Ranging Information Mining Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2408.10624/) (2024)
- [Adaptive Generation of Privileged Intermediate Information for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2307.03240/) (2023)
- [CCUP: A Controllable Synthetic Data Generation Pipeline for Pretraining Cloth-Changing Person Re-Identification Models](https://mlsanity.com/paper/2410.13567/) (2024)
- [Modality-Transition Representation Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2511.02685/) (2025)
- [Try Harder: Hard Sample Generation and Learning for Clothes-Changing Person Re-ID](https://mlsanity.com/paper/2507.11119/) (2025)
- [X-ReID: Multi-granularity Information Interaction for Video-Based Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2511.17964/) (2025)
- [Variational Distillation for Multi-View Learning](https://mlsanity.com/paper/2206.09548/) (2022)

## Abstract (arXiv)

Cross-modal Re-Identification (ReID) aims to retrieve the same identity across heterogeneous imaging modalities and has been widely studied in visible-infrared person ReID and cross-modal ship ReID. Existing methods have achieved promising performance by learning modality consistency in the spatial embedding space, yet often overlook frequency-domain modality discrepancy, particularly in high-frequency representations that are both highly discriminative and modality-sensitive. In addition, most approaches are tailored to specific modality settings, limiting their applicability across diverse cross-modal scenarios. To address these challenges, we propose a Dual-Space Modality Consistency Learning (DSMCL) framework for universal cross-modal ReID. Specifically, DSMCL jointly models spatial feature distribution consistency and frequency-domain discriminative consistency. A Spatial Modality Consistency Learning (SMCL) branch performs Gaussian-based feature alignment, while a Frequency-aware Discriminative Consistency Learning (FDCL) strategy regularizes high-frequency representations through identity-aware cross-modal contrastive learning. By jointly capturing modality-specific characteristics and modality-shared identity cues, DSMCL learns robust representations and establishes a unified framework capable of accommodating diverse heterogeneous modality settings. Moreover, DSMCL is a plug-and-play framework that can be readily integrated into existing cross-modal ReID architectures. Extensive experiments on SYSU-MM01, RegDB, LLCM, HOSS-ReID, and CMShipReID across seventeen evaluation protocols show that DSMCL consistently improves multiple representative baselines.
