Data-Driven but Privacy-Conscious: Pedestrian Dataset De-identification via Full-Body Person Synthesis
Not on the map. Why?
Abstract (arXiv)
The advent of data-driven technology solutions is accompanied by an increasing concern with data privacy. This is of particular importance for human-centered image recognition tasks, such as pedestrian detection, re-identification, and tracking. To highlight the importance of privacy issues and motivate future research, we motivate and introduce the Pedestrian Dataset De-Identification (PDI) task. PDI evaluates the degree of de-identification and downstream task training performance for a given de-identification method. As a first baseline, we propose IncogniMOT, a two-stage full-body de-identification pipeline based on image synthesis via generative adversarial networks. The first stage replaces target pedestrians with synthetic identities. To improve downstream task performance, we then apply stage two, which blends and adapts the synthetic image parts into the data. To demonstrate the effectiveness of IncogniMOT, we generate a fully de-identified version of the MOT17 pedestrian tracking dataset and analyze its application as training data for pedestrian re-identification, detection, and tracking models. Furthermore, we show how our data is able to narrow the synthetic-to-real performance gap in a privacy-conscious manner.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 71 references that are in the map. First posted on arXiv 20 Jun 2023.
Builds on
48 of 71 references.
References · 48
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,611
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,849
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2016Least Squares Generative Adversarial Networkscited by 1,001
36 more
- 2016Playing for Data: Ground Truth from Computer Gamescited by 818
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
- 2016MS-Celeb-1M: A Dataset and Benchmark for Large-Scale Face Recognitioncited by 624
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 532
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 490
- 2020Tracking Objects as Pointscited by 483
- 2018Video-to-Video Synthesiscited by 390
- 2019Tracking without bells and whistlescited by 382
- 2017Learning from Synthetic Humanscited by 359
- 2018Everybody Dance Nowcited by 315
- 2018CrowdHuman: A Benchmark for Detecting Human in a Crowdcited by 284
- 2019MOTS: Multi-Object Tracking and Segmentationcited by 223
- 2020Quasi-Dense Similarity Learning for Multiple Object Trackingcited by 220
- 2019Joint Discriminative and Generative Learning for Person Re-identificationcited by 213
- 2021Fake It Till You Make It: Face analysis in the wild using synthetic data alonecited by 200
- 2021Track to Detect and Segment: An Online Multi-Object Trackercited by 156
- 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
- 2020Video Panoptic Segmentationcited by 142
- 2021Learning to Track with Object Permanencecited by 119
- 2020Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Trackingcited by 115
- 2019DeepPrivacy: A Generative Adversarial Network for Face Anonymizationcited by 108
- 2020CIAGAN: Conditional Identity Anonymization Generative Adversarial Networkscited by 88
- 2016A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detectioncited by 83
- 2020Joint Disentangling and Adaptation for Cross-Domain Person Re-Identificationcited by 83
- 2021A Study of Face Obfuscation in ImageNetcited by 83
- 2018Learning to Detect and Track Visible and Occluded Body Joints in a Virtual Worldcited by 82
- 2020TubeTK: Adopting Tubes to Track Multi-Object in a One-Step Training Modelcited by 70
- 2021MOTSynth: How Can Synthetic Data Help Pedestrian Detection and Tracking?cited by 69
- 2021Multiple Object Tracking with Correlation Learningcited by 67
- 2018Learning to Anonymize Faces for Privacy Preserving Action Detectioncited by 63
- 2017Natural and Effective Obfuscation by Head Inpaintingcited by 60
- 2021PASS: An ImageNet replacement for self-supervised pretraining without humanscited by 51
- 2019Live Face De-Identification in Videocited by 48
- 2018A Hybrid Model for Identity Obfuscation by Face Replacementcited by 43
- 2016Faceless Person Recognition; Privacy Implications in Social Mediacited by 27
- 2021Perceptual Indistinguishability-Net (PI-Net): Facial Image Obfuscation with Manipulable Semanticscited by 20
Built on by
Not cited yet.