# Dynamic Modality-Camera Invariant Clustering for Unsupervised Visible-Infrared Person Re-identification

arXiv: https://arxiv.org/abs/2412.08231 · HTML: https://mlsanity.com/paper/2412.08231/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 26 of its 60 references that are in the map.
- First posted on arXiv 11 Dec 2024.

## Builds on (most cited first, 26 of 26)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Momentum Contrast for Unsupervised Visual Representation Learning](https://mlsanity.com/paper/1911.05722/) (2019)
- [Deep Learning for Person Re-identification: A Survey and Outlook](https://mlsanity.com/paper/2001.04193/) (2020)
- [Re-ranking Person Re-identification with k-reciprocal Encoding](https://mlsanity.com/paper/1701.08398/) (2017)
- [Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identification](https://mlsanity.com/paper/2001.01526/) (2020)
- [Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-ID](https://mlsanity.com/paper/2006.02713/) (2020)
- [Invariance Matters: Exemplar Memory for Domain Adaptive Person Re-identification](https://mlsanity.com/paper/1904.01990/) (2019)
- [Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2007.09314/) (2020)
- [RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment](https://mlsanity.com/paper/1910.05839/) (2019)
- [Cluster Contrast for Unsupervised Person Re-Identification](https://mlsanity.com/paper/2103.11568/) (2021)
- [Diverse Embedding Expansion Network and Low-Light Cross-Modality Benchmark for Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2303.14481/) (2023)
- [Hi-CMD: Hierarchical Cross-Modality Disentanglement for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/1912.01230/) (2019)
- [ICE: Inter-instance Contrastive Encoding for Unsupervised Person Re-identification](https://mlsanity.com/paper/2103.16364/) (2021)
- [Camera-aware Proxies for Unsupervised Person Re-Identification](https://mlsanity.com/paper/2012.10674/) (2020)
- [Part-based Pseudo Label Refinement for Unsupervised Person Re-identification](https://mlsanity.com/paper/2203.14675/) (2022)
- [Intra-Inter Camera Similarity for Unsupervised Person Re-Identification](https://mlsanity.com/paper/2103.11658/) (2021)
- [Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification](https://mlsanity.com/paper/2104.02862/) (2021)
- [Learning to Adapt Invariance in Memory for Person Re-identification](https://mlsanity.com/paper/1908.00485/) (2019)
- [Person Re-Identification by Camera Correlation Aware Feature Augmentation](https://mlsanity.com/paper/1703.08837/) (2017)
- [Implicit Sample Extension for Unsupervised Person Re-Identification](https://mlsanity.com/paper/2204.06892/) (2022)
- [Unsupervised Person Re-identification by Deep Asymmetric Metric Embedding](https://mlsanity.com/paper/1901.10177/) (2019)
- [MSO: Multi-Feature Space Joint Optimization Network for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2110.11264/) (2021)
- [Structured Domain Adaptation with Online Relation Regularization for Unsupervised Person Re-ID](https://mlsanity.com/paper/2003.06650/) (2020)
- [Learning to Purification for Unsupervised Person Re-identification](https://mlsanity.com/paper/2204.09931/) (2022)
- [Camera-aware Style Separation and Contrastive Learning for Unsupervised Person Re-identification](https://mlsanity.com/paper/2112.10089/) (2021)
- [Unsupervised Domain Adaptation on Person Re-Identification via Dual-level Asymmetric Mutual Learning](https://mlsanity.com/paper/2301.12439/) (2023)

## Abstract (arXiv)

Unsupervised learning visible-infrared person re-identification (USL-VI-ReID) offers a more flexible and cost-effective alternative compared to supervised methods. This field has gained increasing attention due to its promising potential. Existing methods simply cluster modality-specific samples and employ strong association techniques to achieve instance-to-cluster or cluster-to-cluster cross-modality associations. However, they ignore cross-camera differences, leading to noticeable issues with excessive splitting of identities. Consequently, this undermines the accuracy and reliability of cross-modal associations. To address these issues, we propose a novel Dynamic Modality-Camera Invariant Clustering (DMIC) framework for USL-VI-ReID. Specifically, our DMIC naturally integrates Modality-Camera Invariant Expansion (MIE), Dynamic Neighborhood Clustering (DNC) and Hybrid Modality Contrastive Learning (HMCL) into a unified framework, which eliminates both the cross-modality and cross-camera discrepancies in clustering. MIE fuses inter-modal and inter-camera distance coding to bridge the gaps between modalities and cameras at the clustering level. DNC employs two dynamic search strategies to refine the network's optimization objective, transitioning from improving discriminability to enhancing cross-modal and cross-camera generalizability. Moreover, HMCL is designed to optimize instance-level and cluster-level distributions. Memories for intra-modality and inter-modality training are updated using randomly selected samples, facilitating real-time exploration of modality-invariant representations. Extensive experiments have demonstrated that our DMIC addresses the limitations present in current clustering approaches and achieve competitive performance, which significantly reduces the performance gap with supervised methods.