# Deep Multimodal Fusion for Generalizable Person Re-identification

arXiv: https://arxiv.org/abs/2211.00933 · HTML: https://mlsanity.com/paper/2211.00933/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 28 of its 37 references that are in the map.
- First posted on arXiv 2 Nov 2022.

## Builds on (most cited first, 28 of 28)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision](https://mlsanity.com/paper/2102.03334/) (2021)
- [In Defense of the Triplet Loss for Person Re-Identification](https://mlsanity.com/paper/1703.07737/) (2017)
- [data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language](https://mlsanity.com/paper/2202.03555/) (2022)
- [Performance Measures and a Data Set for Multi-Target, Multi-Camera Tracking](https://mlsanity.com/paper/1609.01775/) (2016)
- [A Survey on Visual Transformer](https://mlsanity.com/paper/2012.12556/) (2020)
- [Person Transfer GAN to Bridge Domain Gap for Person Re-Identification](https://mlsanity.com/paper/1711.08565/) (2017)
- [Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)](https://mlsanity.com/paper/1711.09349/) (2017)
- [TransReID: Transformer-based Object Re-Identification](https://mlsanity.com/paper/2102.04378/) (2021)
- [Omni-Scale Feature Learning for Person Re-Identification](https://mlsanity.com/paper/1905.00953/) (2019)
- [Learning Discriminative Features with Multiple Granularities for Person Re-Identification](https://mlsanity.com/paper/1804.01438/) (2018)
- [Eigen-CAM: Class Activation Map using Principal Components](https://mlsanity.com/paper/2008.00299/) (2020)
- [Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification](https://mlsanity.com/paper/1711.07027/) (2017)
- [A Strong Baseline and Batch Normalization Neck for Deep Person Re-identification](https://mlsanity.com/paper/1906.08332/) (2019)
- [Style Normalization and Restitution for Generalizable Person Re-identification](https://mlsanity.com/paper/2005.11037/) (2020)
- [Dissecting Person Re-identification from the Viewpoint of Viewpoint](https://mlsanity.com/paper/1812.02162/) (2018)
- [A Discriminatively Learned CNN Embedding for Person Re-identification](https://mlsanity.com/paper/1611.05666/) (2016)
- [Learning Disentangled Representation Implicitly via Transformer for Occluded Person Re-Identification](https://mlsanity.com/paper/2107.02380/) (2021)
- [Surpassing Real-World Source Training Data: Random 3D Characters for Generalizable Person Re-Identification](https://mlsanity.com/paper/2006.12774/) (2020)
- [Graph Sampling Based Deep Metric Learning for Generalizable Person Re-Identification](https://mlsanity.com/paper/2104.01546/) (2021)
- [UnrealPerson: An Adaptive Pipeline towards Costless Person Re-identification](https://mlsanity.com/paper/2012.04268/) (2020)
- [TransMatcher: Deep Image Matching Through Transformers for Generalizable Person Re-identification](https://mlsanity.com/paper/2105.14432/) (2021)
- [Less is More: Learning from Synthetic Data with Fine-grained Attributes for Person Re-Identification](https://mlsanity.com/paper/2109.10498/) (2021)
- [Uncertainty-aware Clustering for Unsupervised Domain Adaptive Object Re-identification](https://mlsanity.com/paper/2108.09682/) (2021)
- [Calibrated Domain-Invariant Learning for Highly Generalizable Large Scale Re-Identification](https://mlsanity.com/paper/1911.11314/) (2019)
- [Learning from Self-Discrepancy via Multiple Co-teaching for Cross-Domain Person Re-Identification](https://mlsanity.com/paper/2104.02265/) (2021)
- [Rethinking Person Re-Identification via Semantic-Based Pretraining](https://mlsanity.com/paper/2110.05074/) (2021)

## Built on by (most cited first, 2 of 2)

- [Unleashing the Potential of Pre-Trained Diffusion Models for Generalizable Person Re-Identification](https://mlsanity.com/paper/2502.06619/) (2025)
- [Learning Robust Visual-Semantic Embedding for Generalizable Person Re-identification](https://mlsanity.com/paper/2304.09498/) (2023)

## Abstract (arXiv)

Person re-identification plays a significant role in realistic scenarios due to its various applications in public security and video surveillance. Recently, leveraging the supervised or semi-unsupervised learning paradigms, which benefits from the large-scale datasets and strong computing performance, has achieved a competitive performance on a specific target domain. However, when Re-ID models are directly deployed in a new domain without target samples, they always suffer from considerable performance degradation and poor domain generalization. To address this challenge, we propose a Deep Multimodal Fusion network to elaborate rich semantic knowledge for assisting in representation learning during the pre-training. Importantly, a multimodal fusion strategy is introduced to translate the features of different modalities into the common space, which can significantly boost generalization capability of Re-ID model. As for the fine-tuning stage, a realistic dataset is adopted to fine-tune the pre-trained model for better distribution alignment with real-world data. Comprehensive experiments on benchmarks demonstrate that our method can significantly outperform previous domain generalization or meta-learning methods with a clear margin. Our source code will also be publicly available at https://github.com/JeremyXSC/DMF.