# RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment

arXiv: https://arxiv.org/abs/1910.05839 · HTML: https://mlsanity.com/paper/1910.05839/

## Key facts

- Cited by 102 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Oct 2019.

## Built on by (most cited first, 30 of 102)

- [Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer](https://mlsanity.com/paper/2106.04095/) (2021)
- [Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration](https://mlsanity.com/paper/2205.11876/) (2022)
- [Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2303.14481/) (2023)
- [Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondences](https://mlsanity.com/paper/2108.07422/) (2021)
- [Neural Feature Search for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2104.02366/) (2021)
- [Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification](https://mlsanity.com/paper/2104.02862/) (2021)
- [Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2212.00226/) (2022)
- [CM-NAS: Cross-Modality Neural Architecture Search for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2101.08467/) (2021)
- [Hierarchical Feature Alignment Network for Unsupervised Video Object Segmentation](https://mlsanity.com/paper/2207.08485/) (2022)
- [Modality Unifying Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2309.06262/) (2023)
- [Multi-Memory Matching for Unsupervised Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2401.06825/) (2024)
- [Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2203.01735/) (2022)
- [Learning Modal-Invariant and Temporal-Memory for Video-based Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2208.02450/) (2022)
- [Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2403.11708/) (2024)
- [Transformer for Object Re-Identification: A Survey](https://mlsanity.com/paper/2401.06960/) (2024)
- [SFANet: A Spectrum-aware Feature Augmentation Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2102.12137/) (2021)
- [PartMix: Regularization Strategy to Learn Part Discovery for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2304.01537/) (2023)
- [CLIP-Driven Semantic Discovery Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2401.05806/) (2024)
- [MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2110.11264/) (2021)
- [Counterfactual Intervention Feature Transfer for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2208.00967/) (2022)
- [Multi-spectral Vehicle Re-identification with Cross-directional Consistency Network and a High-quality Benchmark](https://mlsanity.com/paper/2208.00632/) (2022)
- [Efficient Bilateral Cross-Modality Cluster Matching for Unsupervised Visible-Infrared Person ReID](https://mlsanity.com/paper/2305.12673/) (2023)
- [CMTR: Cross-modality Transformer for Visible-infrared Person Re-identification](https://mlsanity.com/paper/2110.08994/) (2021)
- [High-Order Structure Based Middle-Feature Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2312.07853/) (2023)
- [RLE: A Unified Perspective of Data Augmentation for Cross-Spectral Re-identification](https://mlsanity.com/paper/2411.01225/) (2024)
- [Unsupervised Visible-Infrared Person ReID by Collaborative Learning with Neighbor-Guided Label Refinement](https://mlsanity.com/paper/2305.12711/) (2023)
- [A Versatile Framework for Multi-scene Person Re-identification](https://mlsanity.com/paper/2403.11121/) (2024)
- [Occluded Person Re-Identification with Deep Learning: A Survey and Perspectives](https://mlsanity.com/paper/2311.00603/) (2023)
- [Learning Commonality, Divergence and Variety for Unsupervised Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2402.19026/) (2024)
- [Visible-Infrared Person Re-Identification Using Privileged Intermediate Information](https://mlsanity.com/paper/2209.09348/) (2022)

## Abstract (arXiv)

RGB-Infrared (IR) person re-identification is an important and challenging task due to large cross-modality variations between RGB and IR images. Most conventional approaches aim to bridge the cross-modality gap with feature alignment by feature representation learning. Different from existing methods, in this paper, we propose a novel and end-to-end Alignment Generative Adversarial Network (AlignGAN) for the RGB-IR RE-ID task. The proposed model enjoys several merits. First, it can exploit pixel alignment and feature alignment jointly. To the best of our knowledge, this is the first work to model the two alignment strategies jointly for the RGB-IR RE-ID problem. Second, the proposed model consists of a pixel generator, a feature generator, and a joint discriminator. By playing a min-max game among the three components, our model is able to not only alleviate the cross-modality and intra-modality variations but also learn identity-consistent features. Extensive experimental results on two standard benchmarks demonstrate that the proposed model performs favorably against state-of-the-art methods. Especially, on SYSU-MM01 dataset, our model can achieve an absolute gain of 15.4% and 12.9% in terms of Rank-1 and mAP.