mlsanityData to 7 Oct 2026

Neural Face Editing with Intrinsic Image Disentangling

arXiv 1704.04131 ↗First posted 13 Apr 2017cs.CVcited by 70

Not on the map. Why?

Abstract (arXiv)

Traditional face editing methods often require a number of sophisticated and task specific algorithms to be applied one after the other --- a process that is tedious, fragile, and computationally intensive. In this paper, we propose an end-to-end generative adversarial network that infers a face-specific disentangled representation of intrinsic face properties, including shape (i.e. normals), albedo, and lighting, and an alpha matte. We show that this network can be trained on "in-the-wild" images by incorporating an in-network physically-based image formation module and appropriate loss functions. Our disentangling latent representation allows for semantically relevant edits, where one aspect of facial appearance can be manipulated while keeping orthogonal properties fixed, and we demonstrate its use for a number of facial editing applications.

Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Apr 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 29; 2022: 17; 2023: 11; 2024: 7; 2025: 4; 2026: 2.

70 papers.

Sort:

By area:

  1. 2022RigNeRF: Fully Controllable Neural 3D Portraitscited by 126
  2. 2024DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generationcited by 93
  3. 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
  4. 2024Neural Gaffer: Relighting Any Object via Diffusioncited by 91
  5. 2021Repurposing GANs for One-shot Semantic Part Segmentationcited by 88
  6. 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
  7. 2021AvatarMe++: Facial Shape and BRDF Inference with Photorealistic Rendering-Aware GANscited by 49
  8. 2021Self-supervised Outdoor Scene Relightingcited by 48
  9. 2021Neural Video Portrait Relighting in Real-time via Consistency Modelingcited by 46
  10. 2022Face Relighting with Geometrically Consistent Shadowscited by 43
  11. 2021Towards High Fidelity Face Relighting with Realistic Shadowscited by 42
  12. 2022Relighting4D: Neural Relightable Human from Videoscited by 41
38 more
  1. 2023FitMe: Deep Photorealistic 3D Morphable Model Avatarscited by 38
  2. 2021A Survey on Intrinsic Images: Delving Deep Into Lambert and Beyondcited by 37
  3. 2023Exploiting Diffusion Prior for Generalizable Dense Predictioncited by 37
  4. 2024A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesiscited by 37
  5. 2021Practical Face Reconstruction via Differentiable Ray Tracingcited by 35
  6. 2024DifFRelight: Diffusion-Based Facial Performance Relightingcited by 35
  7. 2022Geometry-aware Single-image Full-body Human Relightingcited by 34
  8. 2021Fast-GANFIT: Generative Adversarial Network for High Fidelity 3D Face Reconstructioncited by 33
  9. 2021FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animationcited by 33
  10. 2022Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguationcited by 32
  11. 2023EverLight: Indoor-Outdoor Editable HDR Lighting Estimationcited by 32
  12. 2022OutCast: Outdoor Single-image Relighting with Cast Shadowscited by 30
  13. 2022PIE-Net: Photometric Invariant Edge Guided Network for Intrinsic Image Decompositioncited by 26
  14. 2025SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Facescited by 24
  15. 2021Self-Supervised Disentangled Representation Learning for Third-Person Imitation Learningcited by 23
  16. 2022PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenescited by 22
  17. 2021High Resolution Face Editing with Masked GAN Latent Code Optimizationcited by 21
  18. 2021Learning Facial Representations from the Cycle-consistency of Facecited by 20
  19. 2023Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priorscited by 19
  20. 2021Outdoor inverse rendering from a single image using multiview self-supervisioncited by 18
  21. 2021Fully Understanding Generic Objects: Modeling, Segmentation, and Reconstructioncited by 16
  22. 2022GAN-based Facial Attribute Manipulationcited by 16
  23. 2024Rig3DGS: Creating Controllable Portraits from Casual Monocular Videoscited by 16
  24. 2021AGRNet: Adaptive Graph Representation Learning and Reasoning for Face Parsingcited by 15
  25. 2023Weakly-supervised Single-view Image Relightingcited by 14
  26. 2023DiFaReli++: Diffusion Face Relighting with Consistent Cast Shadowscited by 14
  27. 2021Image-to-Video Generation via 3D Facial Dynamicscited by 13
  28. 2022Rotation-Equivariant Conditional Spherical Neural Fields for Learning a Natural Illumination Priorcited by 12
  29. 2022RANA: Relightable Articulated Neural Avatarscited by 12
  30. 2023ReliTalk: Relightable Talking Portrait Generation from a Single Videocited by 12
  31. 2023Parameter Efficient Local Implicit Image Function Network for Face Segmentationcited by 7
  32. 2023RENI++ A Rotation-Equivariant, Scale-Invariant, Natural Illumination Priorcited by 6
  33. 2021Demystifying Inductive Biases for β-VAE Based Architecturescited by 5
  34. 2022Beyond 3DMM: Learning to Capture High-fidelity 3D Face Shapecited by 5
  35. 2025Parametric Shadow Control for Portrait Generation in Text-to-Image Diffusion Modelscited by 5
  36. 2021Generating Diverse 3D Reconstructions from a Single Occluded Face Imagecited by 4
  37. 2021Transferring Unconditional to Conditional GANs with Hyper-Modulationcited by 4
  38. 2022Deep Portrait Delightingcited by 4

50 most cited of 70 All 70 (JSON)