# Efficient Bilateral Cross-Modality Cluster Matching for Unsupervised Visible-Infrared Person ReID

arXiv: https://arxiv.org/abs/2305.12673 · HTML: https://mlsanity.com/paper/2305.12673/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- Builds on 32 of its 50 references that are in the map.
- First posted on arXiv 22 May 2023.

## Builds on (most cited first, 30 of 32)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift](https://mlsanity.com/paper/1502.03167/) (2015)
- [Deep Learning for Person Re-identification: A Survey and Outlook](https://mlsanity.com/paper/2001.04193/) (2020)
- [Fine-tuning CNN Image Retrieval with No Human Annotation](https://mlsanity.com/paper/1711.02512/) (2017)
- [Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)](https://mlsanity.com/paper/1711.09349/) (2017)
- [Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identification](https://mlsanity.com/paper/2001.01526/) (2020)
- [Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID](https://mlsanity.com/paper/2006.02713/) (2020)
- [Harmonious Attention Network for Person Re-Identification](https://mlsanity.com/paper/1802.08122/) (2018)
- [Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2007.09314/) (2020)
- [Unsupervised Person Re-identification via Multi-label Classification](https://mlsanity.com/paper/2004.09228/) (2020)
- [RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment](https://mlsanity.com/paper/1910.05839/) (2019)
- [Cluster Contrast for Unsupervised Person Re-Identification](https://mlsanity.com/paper/2103.11568/) (2021)
- [Hierarchical Clustering with Hard-batch Triplet Loss for Person Re-identification](https://mlsanity.com/paper/1910.12278/) (2019)
- [Cross-modality Person re-identification with Shared-Specific Feature Transfer](https://mlsanity.com/paper/2002.12489/) (2020)
- [ICE: Inter-instance Contrastive Encoding for Unsupervised Person Re-identification](https://mlsanity.com/paper/2103.16364/) (2021)
- [Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondences](https://mlsanity.com/paper/2108.07422/) (2021)
- [Camera-aware Proxies for Unsupervised Person Re-Identification](https://mlsanity.com/paper/2012.10674/) (2020)
- [Part-based Pseudo Label Refinement for Unsupervised Person Re-identification](https://mlsanity.com/paper/2203.14675/) (2022)
- [Joint Generative and Contrastive Learning for Unsupervised Person Re-identification](https://mlsanity.com/paper/2012.09071/) (2020)
- [NFormer: Robust Person Re-identification with Neighbor Transformer](https://mlsanity.com/paper/2204.09331/) (2022)
- [VRSTC: Occlusion-Free Video Person Re-Identification](https://mlsanity.com/paper/1907.08427/) (2019)
- [IDM: An Intermediate Domain Module for Domain Adaptive Person Re-ID](https://mlsanity.com/paper/2108.02413/) (2021)
- [Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identification](https://mlsanity.com/paper/2106.06133/) (2021)
- [Implicit Sample Extension for Unsupervised Person Re-Identification](https://mlsanity.com/paper/2204.06892/) (2022)
- [GLAD: Global-Local-Alignment Descriptor for Pedestrian Retrieval](https://mlsanity.com/paper/1709.04329/) (2017)
- [Scalable Person Re-identification on Supervised Smoothed Manifold](https://mlsanity.com/paper/1703.08359/) (2017)
- [Counterfactual Intervention Feature Transfer for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2208.00967/) (2022)
- [Person Re-Identification by Deep Joint Learning of Multi-Loss Classification](https://mlsanity.com/paper/1705.04724/) (2017)
- [Multimodal Data Augmentation for Visual-Infrared Person ReID with Corrupted Data](https://mlsanity.com/paper/2211.11925/) (2022)
- [Camera-Conditioned Stable Feature Generation for Isolated Camera Supervised Person Re-IDentification](https://mlsanity.com/paper/2203.15210/) (2022)

## Built on by (most cited first, 17 of 17)

- [Multi-Memory Matching for Unsupervised Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2401.06825/) (2024)
- [Cross-Platform Video Person ReID: A New Benchmark Dataset and Adaptation Approach](https://mlsanity.com/paper/2408.07500/) (2024)
- [Exploring Homogeneous and Heterogeneous Consistent Label Associations for Unsupervised Visible-Infrared Person ReID](https://mlsanity.com/paper/2402.00672/) (2024)
- [Learning Commonality, Divergence and Variety for Unsupervised Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2402.19026/) (2024)
- [Prompt Disentanglement via Language Guidance and Representation Alignment for Domain Generalization](https://mlsanity.com/paper/2507.02288/) (2025)
- [Semantic-Aligned Learning with Collaborative Refinement for Unsupervised VI-ReID](https://mlsanity.com/paper/2504.19244/) (2025)
- [Without Paired Labeled Data: End-to-End Self-Supervised Learning for Drone-view Geo-Localization](https://mlsanity.com/paper/2502.11381/) (2025)
- [Adversarial Domain Prompt Tuning and Generation for Single Domain Generalization](https://mlsanity.com/paper/2606.21736/) (2026)
- [Weakly Supervised Visible-Infrared Person Re-Identification via Heterogeneous Expert Collaborative Consistency Learning](https://mlsanity.com/paper/2507.12942/) (2025)
- [Mutual Information Guided Optimal Transport for Unsupervised Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2407.12758/) (2024)
- [Generative Adversarial Patches for Physical Attacks on Cross-Modal Pedestrian Re-Identification](https://mlsanity.com/paper/2410.20097/) (2024)
- [Hierarchical Identity Learning for Unsupervised Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2509.11587/) (2025)
- [Domain-Shared Learning and Gradual Alignment for Unsupervised Domain Adaptation Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2511.16184/) (2025)
- [Dual-level Modality Debiasing Learning for Unsupervised Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2512.03745/) (2025)
- [Modality-Aware Bias Mitigation and Invariance Learning for Unsupervised Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2512.07760/) (2025)
- [Bridging Day and Night: Unsupervised Cross-Domain Re-Identification with Synergistic Prompt and Prototype Learning](https://mlsanity.com/paper/2606.12258/) (2026)
- [Semantic Modality Compensation for Unsupervised Visible-Infrared Person Re-identification under Unpaired Settings](https://mlsanity.com/paper/2609.34294/) (2026)

## Abstract (arXiv)

Unsupervised visible-infrared person re-identification (USL-VI-ReID) aims to match pedestrian images of the same identity from different modalities without annotations. Existing works mainly focus on alleviating the modality gap by aligning instance-level features of the unlabeled samples. However, the relationships between cross-modality clusters are not well explored. To this end, we propose a novel bilateral cluster matching-based learning framework to reduce the modality gap by matching cross-modality clusters. Specifically, we design a Many-to-many Bilateral Cross-Modality Cluster Matching (MBCCM) algorithm through optimizing the maximum matching problem in a bipartite graph. Then, the matched pairwise clusters utilize shared visible and infrared pseudo-labels during the model training. Under such a supervisory signal, a Modality-Specific and Modality-Agnostic (MSMA) contrastive learning framework is proposed to align features jointly at a cluster-level. Meanwhile, the cross-modality Consistency Constraint (CC) is proposed to explicitly reduce the large modality discrepancy. Extensive experiments on the public SYSU-MM01 and RegDB datasets demonstrate the effectiveness of the proposed method, surpassing state-of-the-art approaches by a large margin of 8.76% mAP on average.
