Generalizable Re-Identification from Videos with Cycle Association
Not on the map. Why?
Abstract (arXiv)
In this paper, we are interested in learning a generalizable person re-identification (re-ID) representation from unlabeled videos. Compared with 1) the popular unsupervised re-ID setting where the training and test sets are typically under the same domain, and 2) the popular domain generalization (DG) re-ID setting where the training samples are labeled, our novel scenario combines their key challenges: the training samples are unlabeled, and collected form various domains which do no align with the test domain. In other words, we aim to learn a representation in an unsupervised manner and directly use the learned representation for re-ID in novel domains. To fulfill this goal, we make two main contributions: First, we propose Cycle Association (CycAs), a scalable self-supervised learning method for re-ID with low training complexity; and second, we construct a large-scale unlabeled re-ID dataset named LMP-video, tailored for the proposed method. Specifically, CycAs learns re-ID features by enforcing cycle consistency of instance association between temporally successive video frame pairs, and the training cost is merely linear to the data size, making large-scale training possible. On the other hand, the LMP-video dataset is extremely large, containing 50 million unlabeled person images cropped from over 10K Youtube videos, therefore is sufficient to serve as fertile soil for self-supervised learning. Trained on LMP-video, we show that CycAs learns good generalization towards novel domains. The achieved results sometimes even outperform supervised domain generalizable models. Remarkably, CycAs achieves 82.2% Rank-1 on Market-1501 and 49.0% Rank-1 on MSMT17 with zero human annotation, surpassing state-of-the-art supervised DG re-ID methods. Moreover, we also demonstrate the superiority of CycAs under the canonical unsupervised re-ID and the pretrain-and-finetune scenarios.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 49 of its 71 references that are in the map. First posted on arXiv 7 Nov 2022.
Builds on
49 of 71 references.
References · 49
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 908
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 621
- 2017Person Transfer GAN to Bridge Domain Gap for Person Re-Identificationcited by 479
37 more
- 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 472
- 2019Bag of Tricks and A Strong Baseline for Deep Person Re-identificationcited by 429
- 2020Circle Loss: A Unified Perspective of Pair Similarity Optimizationcited by 402
- 2018Two at Once: Enhancing Learning and Generalization Capacities via IBN-Netcited by 361
- 2019Towards Real-Time Multi-Object Trackingcited by 311
- 2019Omni-Scale Feature Learning for Person Re-Identificationcited by 292
- 2018Learning Discriminative Features with Multiple Granularities for Person Re-Identificationcited by 290
- 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
- 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
- 2020Mutual Mean-Teaching: Pseudo Label Refinery for Unsupervised Domain Adaptation on Person Re-identificationcited by 214
- 2020Self-paced Contrastive Learning with Hybrid Memory for Domain Adaptive Object Re-IDcited by 212
- 2015The MegaFace Benchmark: 1 Million Faces for Recognition at Scalecited by 199
- 2017Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identificationcited by 168
- 2020Style Normalization and Restitution for Generalizable Person Re-identificationcited by 136
- 2019Invariance Matters: Exemplar Memory for Domain Adaptive Person Re-identificationcited by 133
- 2019Cross-Batch Memory for Embedding Learningcited by 130
- 2019ABD-Net: Attentive but Diverse Person Re-Identificationcited by 126
- 2017Few-Shot Image Recognition by Predicting Parameters from Activationscited by 122
- 2020Identity-Guided Human Semantic Parsing for Person Re-Identificationcited by 118
- 2020Learning to Generalize Unseen Domains via Memory-based Multi-Source Meta-Learning for Person Re-Identificationcited by 110
- 2020Unsupervised Pre-training for Person Re-identificationcited by 94
- 2021Generalizable Person Re-identification with Relevance-aware Mixture of Expertscited by 77
- 2016POI: Multiple Object Tracking with High Performance Detection and Appearance Featurecited by 74
- 2017Unsupervised Person Re-identification: Clustering and Fine-tuningcited by 73
- 2019Mixed High-Order Attention Network for Person Re-Identificationcited by 65
- 2018Transferable Joint Attribute-Identity Deep Learning for Unsupervised Person Re-Identificationcited by 62
- 2017AlignedReID: Surpassing Human-Level Performance in Person Re-Identificationcited by 61
- 2018Densely Semantically Aligned Person Re-Identificationcited by 58
- 2019Unsupervised Tracklet Person Re-Identificationcited by 55
- 2019Frustratingly Easy Person Re-Identification: Generalizing Person Re-ID in Practicecited by 48
- 2018Unsupervised Person Re-identification by Deep Learning Tracklet Associationcited by 45
- 2018Batch DropBlock Network for Person Re-identification and Beyondcited by 45
- 2021Self-Supervised Pre-Training for Transformer-Based Person Re-Identificationcited by 36
- 2019Relation Network for Person Re-identificationcited by 29
- 2017Cross-view Asymmetric Metric Learning for Unsupervised Person Re-identificationcited by 26
- 2017Dynamic Label Graph Matching for Unsupervised Video Re-Identificationcited by 23
- 2021Large-Scale Unsupervised Person Re-Identification with Contrastive Learningcited by 2
Built on by
Citing papers per year: 2023: 1.
1 paper.