# Cross-Modality Paired-Images Generation for RGB-Infrared Person Re-Identification

arXiv: https://arxiv.org/abs/2002.04114 · HTML: https://mlsanity.com/paper/2002.04114/

## Key facts

- Cited by 71 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 10 Feb 2020.

## Built on by (most cited first, 30 of 71)

- [Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer](https://mlsanity.com/paper/2106.04095/) (2021)
- [Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2303.14481/) (2023)
- [Neural Feature Search for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2104.02366/) (2021)
- [Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification](https://mlsanity.com/paper/2104.02862/) (2021)
- [CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2101.08467/) (2021)
- [Modality Unifying Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2309.06262/) (2023)
- [Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2203.01735/) (2022)
- [Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2403.11708/) (2024)
- [Deep learning-based person re-identification methods: A survey and outlook of recent works](https://mlsanity.com/paper/2110.04764/) (2021)
- [Transformer for Object Re-Identification: A Survey](https://mlsanity.com/paper/2401.06960/) (2024)
- [SFANet: A Spectrum-aware Feature Augmentation Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2102.12137/) (2021)
- [PartMix: Regularization Strategy to Learn Part Discovery for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2304.01537/) (2023)
- [CLIP-Driven Semantic Discovery Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2401.05806/) (2024)
- [MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2110.11264/) (2021)
- [Counterfactual Intervention Feature Transfer for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2208.00967/) (2022)
- [CMTR: Cross-modality Transformer for Visible-infrared Person Re-identification](https://mlsanity.com/paper/2110.08994/) (2021)
- [High-Order Structure Based Middle-Feature Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2312.07853/) (2023)
- [Unsupervised Visible-Infrared Person ReID by Collaborative Learning with Neighbor-Guided Label Refinement](https://mlsanity.com/paper/2305.12711/) (2023)
- [A Versatile Framework for Multi-scene Person Re-identification](https://mlsanity.com/paper/2403.11121/) (2024)
- [Visible-Infrared Person Re-Identification Using Privileged Intermediate Information](https://mlsanity.com/paper/2209.09348/) (2022)
- [MRCN: A Novel Modality Restitution and Compensation Network for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2303.14626/) (2023)
- [Video-based Visible-Infrared Person Re-Identification with Auxiliary Samples](https://mlsanity.com/paper/2311.15571/) (2023)
- [G2DA: Geometry-Guided Dual-Alignment Learning for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2106.07853/) (2021)
- [MMD-ReID: A Simple but Effective Solution for Visible-Thermal Person ReID](https://mlsanity.com/paper/2111.05059/) (2021)
- [Bridging the Gap: Multi-Level Cross-Modality Joint Alignment for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2307.08316/) (2023)
- [Exploring Invariant Representation for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2302.00884/) (2023)
- [Domain shifts in dermoscopic skin cancer datasets: Evaluation of essential limitations for clinical translation](https://mlsanity.com/paper/2304.06968/) (2023)
- [WRIM-Net: Wide-Ranging Information Mining Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2408.10624/) (2024)
- [Adaptive Generation of Privileged Intermediate Information for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2307.03240/) (2023)
- [MMBind: Unleashing the Potential of Distributed and Heterogeneous Data for Multimodal Learning in IoT](https://mlsanity.com/paper/2411.12126/) (2024)

## Abstract (arXiv)

RGB-Infrared (IR) person re-identification is very challenging due to the large cross-modality variations between RGB and IR images. The key solution is to learn aligned features to the bridge RGB and IR modalities. However, due to the lack of correspondence labels between every pair of RGB and IR images, most methods try to alleviate the variations with set-level alignment by reducing the distance between the entire RGB and IR sets. However, this set-level alignment may lead to misalignment of some instances, which limits the performance for RGB-IR Re-ID. Different from existing methods, in this paper, we propose to generate cross-modality paired-images and perform both global set-level and fine-grained instance-level alignments. Our proposed method enjoys several merits. First, our method can perform set-level alignment by disentangling modality-specific and modality-invariant features. Compared with conventional methods, ours can explicitly remove the modality-specific features and the modality variation can be better reduced. Second, given cross-modality unpaired-images of a person, our method can generate cross-modality paired images from exchanged images. With them, we can directly perform instance-level alignment by minimizing distances of every pair of images. Extensive experimental results on two standard benchmarks demonstrate that the proposed model favourably against state-of-the-art methods. Especially, on SYSU-MM01 dataset, our model can achieve a gain of 9.2% and 7.7% in terms of Rank-1 and mAP. Code is available at https://github.com/wangguanan/JSIA-ReID.