mlsanityData to 14 Oct 2026

Temporally Consistent Semantic Video Editing

arXiv 2206.10590 ↗First posted 21 Jun 2022cs.CVcited by 28

Not on the map. Why?

Abstract (arXiv)

Generative adversarial networks (GANs) have demonstrated impressive image generation quality and semantic editing capability of real images, e.g., changing object classes, modifying attributes, or transferring styles. However, applying these GAN-based editing to a video independently for each frame inevitably results in temporal flickering artifacts. We present a simple yet effective method to facilitate temporally coherent video editing. Our core idea is to minimize the temporal photometric inconsistency by optimizing both the latent code and the pre-trained generator. We evaluate the quality of our editing on different domains and GAN inversion techniques and show favorable results against the baselines.

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 52 of its 64 references that are in the map. First posted on arXiv 21 Jun 2022.

Builds on

52 of 64 references.

References · 52

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  5. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  7. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  8. 2017Improved Training of Wasserstein GANscited by 2,235
  9. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,636
  10. 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
  11. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  12. 2016Least Squares Generative Adversarial Networkscited by 1,001
38 more
  1. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 991
  2. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  3. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  4. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  5. 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
  6. 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
  7. 2020In-Domain GAN Inversion for Real Image Editingcited by 420
  8. 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
  9. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
  10. 2021GAN Inversion: A Surveycited by 367
  11. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  12. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 349
  13. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  14. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 332
  15. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 268
  16. 2018Learning Blind Video Temporal Consistencycited by 253
  17. 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
  18. 2020Towards Fast, Accurate and Stable 3D Dense Face Alignmentcited by 219
  19. 2019Image Processing Using Multi-Code GAN Priorcited by 185
  20. 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
  21. 2020Semantic Photo Manipulation with a Generative Image Priorcited by 178
  22. 2021Layered Neural Atlases for Consistent Video Editingcited by 137
  23. 2017Coherent Online Video Style Transfercited by 96
  24. 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
  25. 2020StyleGAN2 Distillation for Feed-forward Image Manipulationcited by 78
  26. 2020Transforming and Projecting Images into Class-conditional Generative Networkscited by 76
  27. 2020Blind Video Temporal Consistency via Deep Video Priorcited by 76
  28. 2022Stitch it in Time: GAN-Based Facial Editing of Real Videoscited by 68
  29. 2021A Latent Transformer for Disentangled Face Editing in Images and Videoscited by 67
  30. 2020HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histogramscited by 64
  31. 2021Using latent space regression to analyze and leverage compositionality in GANscited by 55
  32. 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
  33. 2021LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directionscited by 52
  34. 2020Learning to See Through Obstructionscited by 38
  35. 2020Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Networkcited by 36
  36. 2021LOHO: Latent Optimization of Hairstyles via Orthogonalizationcited by 30
  37. 2019Your Local GAN: Designing Two Dimensional Local Attention Mechanisms for Generative Modelscited by 21
  38. 2017Learning Inverse Mapping by Autoencoder based Generative Adversarial Netscited by 17

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 17; 2024: 4; 2025: 3; 2026: 2.

28 papers.

Sort:

By area:

  1. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  2. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
  3. 2023Shape-aware Text-driven Layered Video Editingcited by 54
  4. 2022Diffusion Video Autoencoders: Toward Temporally Consistent Face Video Editing via Disentangled Video Encodingcited by 39
  5. 2022Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generationcited by 32
  6. 2023Blind Video Deflickering by Neural Filtering with a Flawed Atlascited by 27
  7. 2023MEGANE: Morphable Eyeglass and Avatar Networkcited by 24
  8. 2023VIVE3D: Viewpoint-Independent Video Editing using 3D-Aware GANscited by 16
  9. 2023Soundini: Sound-Guided Diffusion for Natural Video Editingcited by 14
  10. 2023RIGID: Recurrent GAN Inversion and Editing of Real Face Videoscited by 13
  11. 2023INVE: Interactive Neural Video Editingcited by 10
  12. 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulationcited by 7
16 more
  1. 2023Text-driven Visual Synthesis with Latent Diffusion Priorcited by 6
  2. 2023DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANscited by 6
  3. 2023Dyn-E: Local Appearance Editing of Dynamic Neural Radiance Fieldscited by 5
  4. 2023Hashing Neural Video Decomposition with Multiplicative Residuals in Space-Timecited by 5
  5. 2023FLAIR: A Conditional Diffusion Framework with Applications to Face Video Restorationcited by 5
  6. 2023In-N-Out: Faithful 3D GAN Inversion with Volumetric Decomposition for Face Editingcited by 4
  7. 2024Stylized Face Sketch Extraction via Generative Prior with Limited Datacited by 4
  8. 2026Learning Spatial-Temporal Coherent Correlations for Speech-Preserving Facial Expression Manipulationcited by 3
  9. 2024FED-NeRF: Achieve High 3D Consistency and Temporal Coherence for Face Video Editing on Dynamic NeRFcited by 2
  10. 2024Analysis and Benchmarking of Extending Blind Face Image Restoration to Videoscited by 2
  11. 2023We never go out of Style: Motion Disentanglement by Subspace Decomposition of Latent Spacecited by 1
  12. 2024S3Editor: A Sparse Semantic-Disentangled Self-Training Framework for Face Video Editingcited by 1
  13. 2025SST-EM: Advanced Metrics for Evaluating Semantic, Spatial and Temporal Aspects in Video Editingcited by 1
  14. 2025FaceEditTalker: Controllable Talking Head Generation with Facial Attribute Editingcited by 1
  15. 2026RS-SSM: Refining Forgotten Specifics in State Space Model for Video Semantic Segmentationcited by 1
  16. 2023Highly Detailed and Temporal Consistent Video Stylization via Synchronized Multi-Frame Diffusioncited by 0