# Beyond Frontal Faces: Improving Person Recognition Using Multiple Cues

arXiv: https://arxiv.org/abs/1501.05703 · HTML: https://mlsanity.com/paper/1501.05703/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 23 Jan 2015.

## Built on by (most cited first, 20 of 20)

- [Deepfake Generation and Detection: A Benchmark and Survey](https://mlsanity.com/paper/2403.17881/) (2024)
- [Large-Scale Spatio-Temporal Person Re-identification: Algorithms and Benchmark](https://mlsanity.com/paper/2105.15076/) (2021)
- [Face, Body, Voice: Video Person-Clustering with Multiple Modalities](https://mlsanity.com/paper/2105.09939/) (2021)
- [WithAnyone: Towards Controllable and ID Consistent Image Generation](https://mlsanity.com/paper/2510.14975/) (2025)
- [Does Image Anonymization Impact Computer Vision Training?](https://mlsanity.com/paper/2306.05135/) (2023)
- [CapsField: Light Field-based Face and Expression Recognition in the Wild using Capsule Routing](https://mlsanity.com/paper/2101.03503/) (2021)
- [A Review on Visual Privacy Preservation Techniques for Active and Assisted Living](https://mlsanity.com/paper/2112.09422/) (2021)
- [Machine Learning Based Cyber Attacks Targeting on Controlled Information: A Survey](https://mlsanity.com/paper/2102.07969/) (2021)
- [Multiverse Through Deepfakes: The MultiFakeVerse Dataset of Person-Centric Visual and Conceptual Manipulations](https://mlsanity.com/paper/2506.00868/) (2025)
- [Pairwise Emotional Relationship Recognition in Drama Videos: Dataset and Benchmark](https://mlsanity.com/paper/2109.11243/) (2021)
- [MEGA: Multimodal Alignment Aggregation and Distillation For Cinematic Video Segmentation](https://mlsanity.com/paper/2308.11185/) (2023)
- [An Open-World, Diverse, Cross-Spatial-Temporal Benchmark for Dynamic Wild Person Re-Identification](https://mlsanity.com/paper/2403.15119/) (2024)
- [EgoPrivacy: What Your First-Person Camera Says About You?](https://mlsanity.com/paper/2506.12258/) (2025)
- [Safe Fakes: Evaluating Face Anonymizers for Face Detectors](https://mlsanity.com/paper/2104.11721/) (2021)
- [Practical Digital Disguises: Leveraging Face Swaps to Protect Patient Privacy](https://mlsanity.com/paper/2204.03559/) (2022)
- [Refiner: Data Refining against Gradient Leakage Attacks in Federated Learning](https://mlsanity.com/paper/2212.02042/) (2022)
- [Enhancing Social Relation Inference with Concise Interaction Graph and Discriminative Scene Representation](https://mlsanity.com/paper/2107.14425/) (2021)
- [GRITv2: Efficient and Light-weight Social Relation Recognition](https://mlsanity.com/paper/2403.06895/) (2024)
- [From a Social Cognitive Perspective: Context-aware Visual Social Relationship Recognition](https://mlsanity.com/paper/2406.08358/) (2024)
- [Face De-Identification: A Domain-Centric Survey from Capture to Processing](https://mlsanity.com/paper/2607.25926/) (2026)

## Abstract (arXiv)

We explore the task of recognizing peoples' identities in photo albums in an unconstrained setting. To facilitate this, we introduce the new People In Photo Albums (PIPA) dataset, consisting of over 60000 instances of 2000 individuals collected from public Flickr photo albums. With only about half of the person images containing a frontal face, the recognition task is very challenging due to the large variations in pose, clothing, camera viewpoint, image resolution and illumination. We propose the Pose Invariant PErson Recognition (PIPER) method, which accumulates the cues of poselet-level person recognizers trained by deep convolutional networks to discount for the pose variations, combined with a face recognizer and a global recognizer. Experiments on three different settings confirm that in our unconstrained setup PIPER significantly improves on the performance of DeepFace, which is one of the best face recognizers as measured on the LFW dataset.