# Reconstruction-Based Disentanglement for Pose-invariant Face Recognition

arXiv: https://arxiv.org/abs/1702.03041 · HTML: https://mlsanity.com/paper/1702.03041/

## Key facts

- Cited by 19 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 10 Feb 2017.

## Built on by (most cited first, 19 of 19)

- [Deep Gait Recognition: A Survey](https://mlsanity.com/paper/2102.09546/) (2021)
- [StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrieval](https://mlsanity.com/paper/2103.15706/) (2021)
- [Learning Clothing and Pose Invariant 3D Shape Representation for Long-Term Person Re-Identification](https://mlsanity.com/paper/2308.10658/) (2023)
- [Efficient Out-of-Distribution Detection Using Latent Space of β-VAE for Cyber-Physical Systems](https://mlsanity.com/paper/2108.11800/) (2021)
- [Are Data-driven Explanations Robust against Out-of-distribution Data?](https://mlsanity.com/paper/2303.16390/) (2023)
- [Cross-Domain Similarity Learning for Face Recognition in Unseen Domains](https://mlsanity.com/paper/2103.07503/) (2021)
- [Disentangled Lifespan Face Synthesis](https://mlsanity.com/paper/2108.02874/) (2021)
- [Egocentric Videoconferencing](https://mlsanity.com/paper/2107.03109/) (2021)
- [PoseFace: Pose-Invariant Features and Pose-Adaptive Loss for Face Recognition](https://mlsanity.com/paper/2107.11721/) (2021)
- [Recent Advances in Deep Learning Techniques for Face Recognition](https://mlsanity.com/paper/2103.10492/) (2021)
- [Pooling Image Datasets With Multiple Covariate Shift and Imbalance](https://mlsanity.com/paper/2403.02598/) (2024)
- [Modular Machine Learning: An Indispensable Path towards New-Generation Large Language Models](https://mlsanity.com/paper/2504.20020/) (2025)
- [Generating Furry Cars: Disentangling Object Shape & Appearance across Multiple Domains](https://mlsanity.com/paper/2104.02052/) (2021)
- [Attention-guided Progressive Mapping for Profile Face Recognition](https://mlsanity.com/paper/2106.14124/) (2021)
- [Rotated Digit Recognition by Variational Autoencoders with Fixed Output Distributions](https://mlsanity.com/paper/2206.13388/) (2022)
- [A Survey of Face Recognition](https://mlsanity.com/paper/2212.13038/) (2022)
- [Set-Based Face Recognition Beyond Disentanglement: Burstiness Suppression With Variance Vocabulary](https://mlsanity.com/paper/2304.06249/) (2023)
- [Profile to Frontal Face Recognition in the Wild Using Coupled Conditional GAN](https://mlsanity.com/paper/2107.13742/) (2021)
- [Feature Decoupling in Self-supervised Representation Learning for Open Set Recognition](https://mlsanity.com/paper/2209.14385/) (2022)

## Abstract (arXiv)

Deep neural networks (DNNs) trained on large-scale datasets have recently achieved impressive improvements in face recognition. But a persistent challenge remains to develop methods capable of handling large pose variations that are relatively underrepresented in training data. This paper presents a method for learning a feature representation that is invariant to pose, without requiring extensive pose coverage in training data. We first propose to generate non-frontal views from a single frontal face, in order to increase the diversity of training data while preserving accurate facial details that are critical for identity discrimination. Our next contribution is to seek a rich embedding that encodes identity features, as well as non-identity ones such as pose and landmark locations. Finally, we propose a new feature reconstruction metric learning to explicitly disentangle identity and pose, by demanding alignment between the feature reconstructions through various combinations of identity and pose features, which is obtained from two images of the same subject. Experiments on both controlled and in-the-wild face datasets, such as MultiPIE, 300WLP and the profile view database CFP, show that our method consistently outperforms the state-of-the-art, especially on images with large head pose variations. Detail results and resource are referred to https://sites.google.com/site/xipengcshomepage/iccv2017