# Modality Unifying Network for Visible-Infrared Person Re-Identification

arXiv: https://arxiv.org/abs/2309.06262 · HTML: https://mlsanity.com/paper/2309.06262/

## Key facts

- Cited by 27 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 43 references that are in the map.
- First posted on arXiv 12 Sep 2023.

## Builds on (most cited first, 22 of 22)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization](https://mlsanity.com/paper/1610.02391/) (2016)
- [Layer Normalization](https://mlsanity.com/paper/1607.06450/) (2016)
- [A ConvNet for the 2020s](https://mlsanity.com/paper/2201.03545/) (2022)
- [Gaussian Error Linear Units (GELUs)](https://mlsanity.com/paper/1606.08415/) (2016)
- [Decoupled Weight Decay Regularization](https://mlsanity.com/paper/1711.05101/) (2017)
- [Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning](https://mlsanity.com/paper/1702.03118/) (2017)
- [Deep Learning for Person Re-identification: A Survey and Outlook](https://mlsanity.com/paper/2001.04193/) (2020)
- [Fine-tuning CNN Image Retrieval with No Human Annotation](https://mlsanity.com/paper/1711.02512/) (2017)
- [Bag of Tricks and A Strong Baseline for Deep Person Re-identification](https://mlsanity.com/paper/1903.07071/) (2019)
- [Joint Discriminative and Generative Learning for Person Re-identification](https://mlsanity.com/paper/1904.07223/) (2019)
- [A Strong Baseline and Batch Normalization Neck for Deep Person Re-identification](https://mlsanity.com/paper/1906.08332/) (2019)
- [Dynamic Dual-Attentive Aggregation Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2007.09314/) (2020)
- [RGB-Infrared Cross-Modality Person Re-Identification via Joint Pixel and Feature Alignment](https://mlsanity.com/paper/1910.05839/) (2019)
- [Hierarchical Clustering with Hard-batch Triplet Loss for Person Re-identification](https://mlsanity.com/paper/1910.12278/) (2019)
- [Cross-Modality Paired-Images Generation for RGB-Infrared Person Re-Identification](https://mlsanity.com/paper/2002.04114/) (2020)
- [Learning by Aligning: Visible-Infrared Person Re-identification using Cross-Modal Correspondences](https://mlsanity.com/paper/2108.07422/) (2021)
- [Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2212.00226/) (2022)
- [Graph Sampling Based Deep Metric Learning for Generalizable Person Re-Identification](https://mlsanity.com/paper/2104.01546/) (2021)
- [Beyond Triplet Loss: Person Re-identification with Fine-grained Difference-aware Pairwise Loss](https://mlsanity.com/paper/2009.10295/) (2020)
- [Benchmarks for Corruption Invariant Person Re-identification](https://mlsanity.com/paper/2111.00880/) (2021)
- [MMD-ReID: A Simple but Effective Solution for Visible-Thermal Person ReID](https://mlsanity.com/paper/2111.05059/) (2021)

## Built on by (most cited first, 27 of 27)

- [Large language models in healthcare and medical domain: A review](https://mlsanity.com/paper/2401.06775/) (2023)
- [Implicit Discriminative Knowledge Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2403.11708/) (2024)
- [CLIP-Driven Semantic Discovery Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2401.05806/) (2024)
- [From Poses to Identity: Training-Free Person Re-Identification via Feature Centralization](https://mlsanity.com/paper/2503.00938/) (2025)
- [A Versatile Framework for Multi-scene Person Re-identification](https://mlsanity.com/paper/2403.11121/) (2024)
- [Learning Commonality, Divergence and Variety for Unsupervised Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2402.19026/) (2024)
- [Cross-Modality Gait Recognition: Bridging LiDAR and Camera Modalities for Human Identification](https://mlsanity.com/paper/2404.04120/) (2024)
- [WRIM-Net: Wide-Ranging Information Mining Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2408.10624/) (2024)
- [Modality-Transition Representation Learning for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2511.02685/) (2025)
- [From Laboratory to Real World: A New Benchmark Towards Privacy-Preserved Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2503.12232/) (2025)
- [Diverse Semantics-Guided Feature Alignment and Decoupling for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2505.00619/) (2025)
- [Weakly Supervised Visible-Infrared Person Re-Identification via Heterogeneous Expert Collaborative Consistency Learning](https://mlsanity.com/paper/2507.12942/) (2025)
- [BIT: Matching-based Bi-directional Interaction Transformation Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2603.14243/) (2026)
- [MSCMNet: Multi-scale Semantic Correlation Mining for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2311.14395/) (2023)
- [YYDS: Visible-Infrared Person Re-Identification with Coarse Descriptions](https://mlsanity.com/paper/2403.04183/) (2024)
- [Mutual Information Guided Optimal Transport for Unsupervised Visible-Infrared Person Re-identification](https://mlsanity.com/paper/2407.12758/) (2024)
- [The Role of Language Models in Modern Healthcare: A Comprehensive Review](https://mlsanity.com/paper/2409.16860/) (2024)
- [CMCC-ReID: Cross-Modality Clothing-Change Person Re-Identification](https://mlsanity.com/paper/2604.02808/) (2026)
- [Text-guided Feature Disentanglement for Cross-modal Gait Recognition](https://mlsanity.com/paper/2605.30784/) (2026)
- [Rethinking the Evaluation of Visible and Infrared Image Fusion](https://mlsanity.com/paper/2410.06811/) (2024)
- [Attentive Convolution: Unifying the Expressivity of Self-Attention with Convolutional Efficiency](https://mlsanity.com/paper/2510.20092/) (2025)
- [Dual-level Modality Debiasing Learning for Unsupervised Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2512.03745/) (2025)
- [Identity Clue Refinement and Enhancement for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2512.04522/) (2025)
- [Multi-Sensor Matching with HyperNetworks](https://mlsanity.com/paper/2601.12325/) (2026)
- [Dual-Edged Homogeneous-Modality Similarity: Towards Visible-Infrared Modality-Incomplete Person Re-Identification with Modality Adaptive Matching](https://mlsanity.com/paper/2607.18688/) (2026)
- [Dual-Space Modality Consistency Learning for Universal Cross-Modal Re-Identification](https://mlsanity.com/paper/2608.06943/) (2026)
- [Multi-scale Decomposed Convolution Refinement Network for Visible-Infrared Person Re-Identification](https://mlsanity.com/paper/2608.16015/) (2026)

## Abstract (arXiv)

Visible-infrared person re-identification (VI-ReID) is a challenging task due to large cross-modality discrepancies and intra-class variations. Existing methods mainly focus on learning modality-shared representations by embedding different modalities into the same feature space. As a result, the learned feature emphasizes the common patterns across modalities while suppressing modality-specific and identity-aware information that is valuable for Re-ID. To address these issues, we propose a novel Modality Unifying Network (MUN) to explore a robust auxiliary modality for VI-ReID. First, the auxiliary modality is generated by combining the proposed cross-modality learner and intra-modality learner, which can dynamically model the modality-specific and modality-shared representations to alleviate both cross-modality and intra-modality variations. Second, by aligning identity centres across the three modalities, an identity alignment loss function is proposed to discover the discriminative feature representations. Third, a modality alignment loss is introduced to consistently reduce the distribution distance of visible and infrared images by modality prototype modeling. Extensive experiments on multiple public datasets demonstrate that the proposed method surpasses the current state-of-the-art methods by a significant margin.