Head and Body: Unified Detector and Graph Network for Person Search in Media
Not on the map. Why?
Abstract (arXiv)
Person search in media has seen increasing potential in Internet applications, such as video clipping and character collection. This task is common but overlooked by previous person search works which focus on surveillance scenes. The media scenarios have some different challenges from surveillance scenes. For example, a person may change his clothes frequently. To alleviate this issue, this paper proposes a Unified Detector and Graph Network (UDGNet) for person search in media. UDGNet is the first person search framework to detect and re-identify the human body and head simultaneously. Specifically, it first builds two branches based on a unified network to detect the human body and head, then the detected body and head are used for re-identification. This dual-task approach can significantly enhance discriminative learning. To tackle the cloth-changing issue, UDGNet builds two graphs to explore reliable links among cloth-changing samples and utilizes a graph network to learn better embeddings. This design effectively enhances the robustness of person search to cloth-changing challenges. Besides, we demonstrate that UDGNet can be implemented with both anchor-based and anchor-free person search frameworks and further achieve performance improvement. This paper also contributes a large-scale dataset for Person Search in Media (PSM), which provides both body and head annotations. It is by far the largest dataset for person search in media. Experiments show that UDGNet improves the anchor-free model AlignPS by 12.1% in mAP. Meanwhile, it shows good generalization across surveillance and longterm scenarios. The dataset and code will be available at: https://github.com/shuxjweb/PSM.git.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 39 of its 52 references that are in the map. First posted on arXiv 27 Nov 2021.
Builds on
39 of 52 references.
References · 39
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
- 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
- 2018Object Detection with Deep Learning: A Reviewcited by 528
- 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 473
- 2019MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixingcited by 443
27 more
- 2019Bag of Tricks and A Strong Baseline for Deep Person Re-identificationcited by 430
- 2016Learning Convolutional Neural Networks for Graphscited by 314
- 2019RepPoints: Point Set Representation for Object Detectioncited by 264
- 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
- 2014Learning Fine-grained Image Similarity with Deep Rankingcited by 190
- 2016Joint Detection and Identification Feature Learning for Person Searchcited by 190
- 2016Person Re-identification in the Wildcited by 157
- 2020High-Order Information Matters: Learning Relation and Topology for Occluded Person Re-Identificationcited by 106
- 2020Person Re-identification by Contour Sketch under Moderate Clothing Changecited by 91
- 2020Long-Term Cloth-Changing Person Re-identificationcited by 85
- 2020Revisiting the Sibling Head in Object Detectorcited by 82
- 2019Learning Context Graph for Person Searchcited by 55
- 2018Pose-Guided Multi-Granularity Attention Network for Text-Based Person Searchcited by 52
- 2018Person Re-identification with Deep Similarity-Guided Graph Neural Networkcited by 49
- 2021Large-Scale Spatio-Temporal Person Re-identification: Algorithms and Benchmarkcited by 47
- 2018Person Search via A Mask-Guided Two-Stream CNN Modelcited by 44
- 2021Anchor-Free Person Searchcited by 42
- 2019Re-ID Driven Localization Refinement for Person Searchcited by 41
- 2021Sequential End-to-end Network for Efficient Person Searchcited by 38
- 2018Person Search by Multi-Scale Matchingcited by 36
- 2020COCAS: A Large-Scale Clothes Changing Person Dataset for Re-identificationcited by 35
- 2019Adaptive Graph Representation Learning for Video Person Re-identificationcited by 34
- 2020Robust Partial Matching for Person Search in the Wildcited by 30
- 2021Semantic-guided Pixel Sampling for Cloth-Changing Person Re-identificationcited by 22
- 2020Context-Aware Graph Convolution Network for Target Re-identificationcited by 21
- 2018Unifying Identification and Context Learning for Person Recognitioncited by 10
- 2018Robust and Efficient Graph Correspondence Transfer for Person Re-identificationcited by 1
Built on by
Citing papers per year: 2023: 1.
1 paper.