# Visible-Infrared Person Re-Identification via Patch-Mixed Cross-Modality Learning

arXiv: https://arxiv.org/abs/2302.08212 · HTML: https://mlsanity.com/paper/2302.08212/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 56 references that are in the map.
- First posted on arXiv 16 Feb 2023.

## Builds on (most cited first, 19 of 19)

- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [mixup: Beyond Empirical Risk Minimization](https://mlsanity.com/paper/1710.09412/) (2017)
- [CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features](https://mlsanity.com/paper/1905.04899/) (2019)
- [Class-Balanced Loss Based on Effective Number of Samples](https://mlsanity.com/paper/1901.05555/) (2019)
- [Random Erasing Data Augmentation](https://mlsanity.com/paper/1708.04896/) (2017)
- [Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss](https://mlsanity.com/paper/1906.07413/) (2019)
- [In Defense of the Triplet Loss for Person Re-Identification](https://mlsanity.com/paper/1703.07737/) (2017)
- [Deep Learning for Person Re-identification: A Survey and Outlook](https://mlsanity.com/paper/2001.04193/) (2020)
- [Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)](https://mlsanity.com/paper/1711.09349/) (2017)
- [Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2007.09314/) (2020)
- [RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment](https://mlsanity.com/paper/1910.05839/) (2019)
- [Cross-modality Person re-identification with Shared-Specific Feature Transfer](https://mlsanity.com/paper/2002.12489/) (2020)
- [Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/1912.01230/) (2019)
- [Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondences](https://mlsanity.com/paper/2108.07422/) (2021)
- [Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2212.00226/) (2022)
- [Modality-Adaptive Mixup and Invariant Decomposition for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2203.01735/) (2022)
- [Person Re-identification: A Retrospective on Domain Specific Open Challenges and Future Trends](https://mlsanity.com/paper/2202.13121/) (2022)
- [G2DA: Geometry-Guided Dual-Alignment Learning for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2106.07853/) (2021)
- [Exploring Modality-shared Appearance Features and Modality-invariant Relation Features for Cross-modality Person Re-Identification](https://mlsanity.com/paper/2104.11539/) (2021)

## Built on by (most cited first, 8 of 8)

- [CLIP-Driven Semantic Discovery Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2401.05806/) (2024)
- [Efficient Bilateral Cross-Modality Cluster Matching for Unsupervised Visible-Infrared Person ReID](https://mlsanity.com/paper/2305.12673/) (2023)
- [Forecasting When to Forecast: Accelerating Diffusion Models with Confidence-Gated Taylor](https://mlsanity.com/paper/2508.02240/) (2025)
- [From Laboratory to Real World: A New Benchmark Towards Privacy-Preserved Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2503.12232/) (2025)
- [MFEN:Multi-Frequency Expert Network for Visible-Infrared Person Re-ID](https://mlsanity.com/paper/2606.12051/) (2026)
- [Text-guided Feature Disentanglement for Cross-modal Gait Recognition](https://mlsanity.com/paper/2605.30784/) (2026)
- [Transferring Modality-Aware Pedestrian Attentive Learning for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2312.07021/) (2023)
- [Hierarchical Identity Learning for Unsupervised Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2509.11587/) (2025)

## Abstract (arXiv)

Visible-infrared person re-identification (VI-ReID) aims to retrieve images of the same pedestrian from different modalities, where the challenges lie in the significant modality discrepancy. To alleviate the modality gap, recent methods generate intermediate images by GANs, grayscaling, or mixup strategies. However, these methods could introduce extra data distribution, and the semantic correspondence between the two modalities is not well learned. In this paper, we propose a Patch-Mixed Cross-Modality framework (PMCM), where two images of the same person from two modalities are split into patches and stitched into a new one for model learning. A part-alignment loss is introduced to regularize representation learning, and a patch-mixed modality learning loss is proposed to align between the modalities. In this way, the model learns to recognize a person through patches of different styles, thereby the modality semantic correspondence can be inferred. In addition, with the flexible image generation strategy, the patch-mixed images freely adjust the ratio of different modality patches, which could further alleviate the modality imbalance problem. On two VI-ReID datasets, we report new state-of-the-art performance with the proposed method.