# RGB-IR Cross-modality Person ReID based on Teacher-Student GAN Model

arXiv: https://arxiv.org/abs/2007.07452 · HTML: https://mlsanity.com/paper/2007.07452/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Jul 2020.

## Built on by (most cited first, 13 of 13)

- [Neural Feature Search for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2104.02366/) (2021)
- [Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2203.01735/) (2022)
- [CLIP-Driven Semantic Discovery Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2401.05806/) (2024)
- [MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2110.11264/) (2021)
- [CMTR: Cross-modality Transformer for Visible-infrared Person Re-identification](https://mlsanity.com/paper/2110.08994/) (2021)
- [Visible-Infrared Person Re-Identification Using Privileged Intermediate Information](https://mlsanity.com/paper/2209.09348/) (2022)
- [Learning to Disentangle Scenes for Person Re-identification](https://mlsanity.com/paper/2111.05476/) (2021)
- [Exploring Modality-shared Appearance Features and Modality-invariant Relation Features for Cross-modality Person Re-Identification](https://mlsanity.com/paper/2104.11539/) (2021)
- [Adaptive Generation of Privileged Intermediate Information for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2307.03240/) (2023)
- [Adversarial Self-Attack Defense and Spatial-Temporal Relation Mining for Visible-Infrared Video Person Re-Identification](https://mlsanity.com/paper/2307.03903/) (2023)
- [Unsupervised clothing change adaptive person ReID](https://mlsanity.com/paper/2109.03702/) (2021)
- [Cross-modal Local Shortest Path and Global Enhancement for Visible-Thermal Person Re-Identification](https://mlsanity.com/paper/2206.04401/) (2022)
- [YYDS: Visible-Infrared Person Re-Identification with Coarse Descriptions](https://mlsanity.com/paper/2403.04183/) (2024)

## Abstract (arXiv)

RGB-Infrared (RGB-IR) person re-identification (ReID) is a technology where the system can automatically identify the same person appearing at different parts of a video when light is unavailable. The critical challenge of this task is the cross-modality gap of features under different modalities. To solve this challenge, we proposed a Teacher-Student GAN model (TS-GAN) to adopt different domains and guide the ReID backbone to learn better ReID information. (1) In order to get corresponding RGB-IR image pairs, the RGB-IR Generative Adversarial Network (GAN) was used to generate IR images. (2) To kick-start the training of identities, a ReID Teacher module was trained under IR modality person images, which is then used to guide its Student counterpart in training. (3) Likewise, to better adapt different domain features and enhance model ReID performance, three Teacher-Student loss functions were used. Unlike other GAN based models, the proposed model only needs the backbone module at the test stage, making it more efficient and resource-saving. To showcase our model's capability, we did extensive experiments on the newly-released SYSU-MM01 RGB-IR Re-ID benchmark and achieved superior performance to the state-of-the-art with 49.8% Rank-1 and 47.4% mAP.