# A Semantic-aware Attention and Visual Shielding Network for Cloth-changing Person Re-identification

arXiv: https://arxiv.org/abs/2207.08387 · HTML: https://mlsanity.com/paper/2207.08387/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 26 of its 59 references that are in the map.
- First posted on arXiv 18 Jul 2022.

## Builds on (most cited first, 26 of 26)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [Densely Connected Convolutional Networks](https://mlsanity.com/paper/1608.06993/) (2016)
- [Deep Learning for Person Re-identification: A Survey and Outlook](https://mlsanity.com/paper/2001.04193/) (2020)
- [Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)](https://mlsanity.com/paper/1711.09349/) (2017)
- [Circle Loss: A Unified Perspective of Pair Similarity Optimization](https://mlsanity.com/paper/2002.10857/) (2020)
- [Learning Discriminative Features with Multiple Granularities for Person Re-Identification](https://mlsanity.com/paper/1804.01438/) (2018)
- [Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in vitro](https://mlsanity.com/paper/1701.07717/) (2017)
- [Joint Discriminative and Generative Learning for Person Re-identification](https://mlsanity.com/paper/1904.07223/) (2019)
- [Person Re-identification: Past, Present and Future](https://mlsanity.com/paper/1610.02984/) (2016)
- [Self-Correction for Human Parsing](https://mlsanity.com/paper/1910.09777/) (2019)
- [Clothes-Changing Person Re-identification with RGB Modality Only](https://mlsanity.com/paper/2204.06890/) (2022)
- [Improving Person Re-identification by Attribute and Identity Learning](https://mlsanity.com/paper/1703.07220/) (2017)
- [Person Re-identification by Contour Sketch under Moderate Clothing Change](https://mlsanity.com/paper/2002.02295/) (2020)
- [Long-Term Cloth-Changing Person Re-identification](https://mlsanity.com/paper/2005.12633/) (2020)
- [Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization](https://mlsanity.com/paper/2103.15537/) (2021)
- [Deep Representation Learning with Part Loss for Person Re-Identification](https://mlsanity.com/paper/1707.00798/) (2017)
- [COCAS: A Large-Scale Clothes Changing Person Dataset for Re-identification](https://mlsanity.com/paper/2005.07862/) (2020)
- [Parameter-Efficient Person Re-identification in the 3D Space](https://mlsanity.com/paper/2006.04569/) (2020)
- [Pedestrian Alignment Network for Large-scale Person Re-identification](https://mlsanity.com/paper/1707.00408/) (2017)
- [Semantic-guided Pixel Sampling for Cloth-Changing Person Re-identification](https://mlsanity.com/paper/2107.11522/) (2021)
- [Learning to rank in person re-identification with metric ensembles](https://mlsanity.com/paper/1503.01543/) (2015)
- [End-to-End Deep Kronecker-Product Matching for Person Re-identification](https://mlsanity.com/paper/1807.11182/) (2018)
- [Multigranular Visual-Semantic Embedding for Cloth-Changing Person Re-identification](https://mlsanity.com/paper/2108.04527/) (2021)
- [IAUnet: Global Context-Aware Feature Learning for Person Re-Identification](https://mlsanity.com/paper/2009.01035/) (2020)
- [Learning Invariant Color Features for Person Re-Identification](https://mlsanity.com/paper/1410.1035/) (2014)

## Built on by (most cited first, 3 of 3)

- [ShARc: Shape and Appearance Recognition for Person Identification In-the-wild](https://mlsanity.com/paper/2310.15946/) (2023)
- [Masked Attribute Description Embedding for Cloth-Changing Person Re-identification](https://mlsanity.com/paper/2401.05646/) (2024)
- [Multiple Information Prompt Learning for Cloth-Changing Person Re-Identification](https://mlsanity.com/paper/2411.00330/) (2024)

## Abstract (arXiv)

Cloth-changing person reidentification (ReID) is a newly emerging research topic that aims to retrieve pedestrians whose clothes are changed. Since the human appearance with different clothes exhibits large variations, it is very difficult for existing approaches to extract discriminative and robust feature representations. Current works mainly focus on body shape or contour sketches, but the human semantic information and the potential consistency of pedestrian features before and after changing clothes are not fully explored or are ignored. To solve these issues, in this work, a novel semantic-aware attention and visual shielding network for cloth-changing person ReID (abbreviated as SAVS) is proposed where the key idea is to shield clues related to the appearance of clothes and only focus on visual semantic information that is not sensitive to view/posture changes. Specifically, a visual semantic encoder is first employed to locate the human body and clothing regions based on human semantic segmentation information. Then, a human semantic attention module (HSA) is proposed to highlight the human semantic information and reweight the visual feature map. In addition, a visual clothes shielding module (VCS) is also designed to extract a more robust feature representation for the cloth-changing task by covering the clothing regions and focusing the model on the visual semantic information unrelated to the clothes. Most importantly, these two modules are jointly explored in an end-to-end unified framework. Extensive experiments demonstrate that the proposed method can significantly outperform state-of-the-art methods, and more robust features can be extracted for cloth-changing persons. Compared with FSAM (published in CVPR 2021), this method can achieve improvements of 32.7% (16.5%) and 14.9% (-) on the LTCC and PRCC datasets in terms of mAP (rank-1), respectively.
