mlsanityData to 7 Oct 2026

Video Face Re-Aging: Toward Temporally Consistent Face Re-Aging

arXiv 2311.11642 ↗First posted 20 Nov 2023cs.CV cs.AI cs.LGcited by 3

Not on the map. Why?

Abstract (arXiv)

Video face re-aging deals with altering the apparent age of a person to the target age in videos. This problem is challenging due to the lack of paired video datasets maintaining temporal consistency in identity and age. Most re-aging methods process each image individually without considering the temporal consistency of videos. While some existing works address the issue of temporal coherence through video facial attribute manipulation in latent space, they often fail to deliver satisfactory performance in age transformation. To tackle the issues, we propose (1) a novel synthetic video dataset that features subjects across a diverse range of age groups; (2) a baseline architecture designed to validate the effectiveness of our proposed dataset, and (3) the development of novel metrics tailored explicitly for evaluating the temporal consistency of video re-aging techniques. Our comprehensive experiments on public datasets, including VFHQ and CelebA-HQ, show that our method outperforms existing approaches in age transformation accuracy and temporal consistency. Notably, in user studies, our method was preferred for temporal consistency by 48.1% of participants for the older direction and by 39.3% for the younger direction.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 43 of its 59 references that are in the map. First posted on arXiv 20 Nov 2023.

Builds on

43 of 59 references.

References · 43

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  4. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  5. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  6. 2014Striving for Simplicity: The All Convolutional Netcited by 983
  7. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
  8. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
  9. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
  10. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 447
  11. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  12. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
31 more
  1. 2016Generating Videos with Scene Dynamicscited by 376
  2. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
  3. 2017Cross-Age LFW: A Database for Studying Cross-Age Face Recognition in Unconstrained Environmentscited by 258
  4. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 246
  5. 2017Geometric GANcited by 232
  6. 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 174
  7. 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
  8. 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 162
  9. 2022FILM: Frame Interpolation for Large Motioncited by 149
  10. 2018Train Sparsely, Generate Densely: Memory-efficient Unsupervised Training of High-resolution Temporal GANcited by 120
  11. 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 97
  12. 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
  13. 2022MetaPortrait: Identity-Preserving Talking Head Generation with Fast Personalized Adaptationcited by 69
  14. 2022Stitch it in Time: GAN-Based Facial Editing of Real Videoscited by 68
  15. 2021A Latent Transformer for Disentangled Face Editing in Images and Videoscited by 67
  16. 2020Lifespan Age Transformation Synthesiscited by 60
  17. 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
  18. 2017Face Aging With Conditional Generative Adversarial Networkscited by 51
  19. 2022Learning Dual Memory Dictionaries for Blind Face Restorationcited by 40
  20. 2022Diffusion Video Autoencoders: Toward Temporally Consistent Face Video Editing via Disentangled Video Encodingcited by 39
  21. 2023Face Aging via Diffusion-based Editingcited by 24
  22. 2020High Resolution Face Age Editingcited by 23
  23. 2022AnimeSR: Learning Real-World Super-Resolution Models for Animation Videoscited by 23
  24. 2022Custom Structure Preservation in Face Agingcited by 19
  25. 2023StyleGANEX: StyleGAN-Based Manipulation Beyond Cropped Aligned Facescited by 19
  26. 2022StyleMask: Disentangling the Style Space of StyleGAN2 for Neural Face Reenactmentcited by 17
  27. 2023Pluralistic Aging Diffusion Autoencodercited by 17
  28. 2018Automatic Face Aging in Videos via Deep Reinforcement Learningcited by 16
  29. 2021Continuous Face Aging via Self-estimated Residual Age Embeddingcited by 8
  30. 2023Video Frame Interpolation with Densely Queried Bilateral Correlationcited by 8
  31. 2023MotionVideoGAN: A Novel Video Generator Based on the Motion Space Learned from Image Pairscited by 5

Built on by

Cited by year

Citing papers per year: 2024: 3.

3 papers.