Recycle-GAN: Unsupervised Video Retargeting
Not on the map. Why?
Abstract (arXiv)
We introduce a data-driven approach for unsupervised video retargeting that translates content from one domain to another while preserving the style native to a domain, i.e., if contents of John Oliver's speech were to be transferred to Stephen Colbert, then the generated content/speech should be in Stephen Colbert's style. Our approach combines both spatial and temporal information along with adversarial losses for content translation and style preservation. In this work, we first study the advantages of using spatiotemporal constraints over spatial constraints for effective retargeting. We then demonstrate the proposed approach for the problems where information in both space and time matters such as face-to-face translation, flower-to-flower, wind and cloud synthesis, sunrise and sunset.
Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 36; 2022: 23; 2023: 14; 2024: 14; 2025: 2.
89 papers.
Sort:
By area:
- 2021Motion Representations for Articulated Animationcited by 253
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 162
- 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 148
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2022Self-Supervised Learning for Videos: A Surveycited by 85
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
- 2022Synthetic Data -- what, why and how?cited by 66
- 2022SinFusion: Training Diffusion Models on a Single Image or Videocited by 58
38 more
- 2021Style and Pose Control for Image Synthesis of Humans from a Single Monocular Viewcited by 53
- 2021HumanGAN: A Generative Model of Humans Imagescited by 47
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detectioncited by 45
- 2022Implicit Warping for Animation with Image Setscited by 45
- 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editingcited by 45
- 2021Learned Spatial Representations for Few-shot Talking-Head Synthesiscited by 32
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videoscited by 32
- 2024GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representationscited by 31
- 2023AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatarscited by 29
- 2024MegActor: Harness the Power of Raw Video for Vivid Portrait Animationcited by 27
- 2023LoCoNet: Long-Short Context Network for Active Speaker Detectioncited by 24
- 2021Long-Term Temporally Consistent Unpaired Video Translation from Simulated Surgical 3D Datacited by 21
- 2021Cross-View Exocentric to Egocentric Video Synthesiscited by 20
- 2021Contrastive Learning of Image Representations with Cross-Video Cycle-Consistencycited by 19
- 2021View Generalization for Single Image Textured 3D Modelscited by 19
- 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesiscited by 16
- 2022A survey on GANs for computer vision: Recent research, analysis and taxonomycited by 15
- 2021Behavior-Driven Synthesis of Human Dynamicscited by 14
- 2021Dance In the Wild: Monocular Human Animation with Neural Dynamic Appearance Synthesiscited by 14
- 2023Interactive Conversational Head Generationcited by 14
- 2021Learning Temporal Dynamics from Cycles in Narrated Videocited by 13
- 2021Image-to-Video Generation via 3D Facial Dynamicscited by 13
- 2021Diverse Generation from a Single Video Made Possiblecited by 13
- 2023ToonTalker: Cross-Domain Face Reenactmentcited by 12
- 2021Egocentric Videoconferencingcited by 10
- 2021I2V-GAN: Unpaired Infrared-to-Visible Video Translationcited by 10
- 2022Cross-identity Video Motion Retargeting with Joint Transformation and Synthesiscited by 10
- 2022Compressing Video Calls using Synthetic Talking Headscited by 10
- 2021Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translationcited by 8
- 2024Do As I Do: Pose Guided Human Motion Copycited by 8
- 2022Weakly Supervised Correspondence Learningcited by 7
- 2022Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Reviewcited by 6
- 2022Learning Temporally and Semantically Consistent Unpaired Video-to-video Translation Through Pseudo-Supervision From Synthetic Optical Flowcited by 5
- 2022TemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinatescited by 5
- 2022ROMA: Cross-Domain Region Similarity Matching for Unpaired Nighttime Infrared to Daytime Visible Video Translationcited by 5
- 2021DeepFake MNIST+: A DeepFake Facial Animation Datasetcited by 4
- 2024AnaMoDiff: 2D Analogical Motion Diffusion via Disentangled Denoisingcited by 4
- 2021Video Reenactment as Inductive Bias for Content-Motion Disentanglementcited by 3
50 most cited of 89 All 89 (JSON)
- 2025CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation22 Dec 2025
- 2025Unsupervised Cardiac Video Translation Via Motion Feature Guided Diffusion Model1 Jul 2025
- 2024A comprehensive GeoAI review: Progress, Challenges and Outlooks16 Dec 2024
- 2024Neural-Network-Enhanced Metalens Camera for High-Definition, Dynamic Imaging in the Long-Wave Infrared Spectrum26 Nov 2024
- 2024Video to Video Generative Adversarial Network for Few-shot Learning Based on Policy Gradient28 Oct 2024
- 2024GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representations18 Sep 2024
- 2024TC-PDM: Temporally Consistent Patch Diffusion Models for Infrared-to-Visible Video Translation26 Aug 2024
- 2024Do As I Do: Pose Guided Human Motion Copy24 Jun 2024
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detection13 Jun 2024
- 2024MegActor: Harness the Power of Raw Video for Vivid Portrait Animation31 May 2024
- 2024Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNet19 Apr 2024
- 2024Translation-based Video-to-Video Synthesis3 Apr 2024
38 more
- 2024AniArtAvatar: Animatable 3D Art Avatar from a Single Image26 Mar 2024
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos11 Mar 2024
- 2024AnaMoDiff: 2D Analogical Motion Diffusion via Disentangled Denoising5 Feb 2024
- 2024Personality Perception in Human Videos Altered by Motion Transfer Networks26 Jan 2024
- 2023Expression Domain Translation Network for Cross-domain Head Reenactment16 Oct 2023
- 2023WAIT: Feature Warping for Animation to Illustration video Translation using GANs7 Oct 2023
- 2023RT-GAN: Recurrent Temporal GAN for Adding Lightweight Temporal Consistency to Frame-Based Domain Translation Approaches2 Oct 2023
- 2023FashionFlow: Leveraging Diffusion Models for Dynamic Fashion Video Synthesis from Static Imagery29 Sep 2023
- 2023Semi-supervised 3D Video Information Retrieval with Deep Neural Network and Bi-directional Dynamic-time Warping Algorithm3 Sep 2023
- 2023ToonTalker: Cross-Domain Face Reenactment24 Aug 2023
- 2023Shortcut-V2V: Compression Framework for Video-to-Video Translation based on Temporal Redundancy Reduction15 Aug 2023
- 2023Interactive Conversational Head Generation5 Jul 2023
- 2023IFaceUV: Intuitive Motion Facial Image Generation by Identity Preservation via UV map8 Jun 2023
- 2023AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars1 Jun 2023
- 20233D-Aware Multi-Class Image-to-Image Translation with NeRFs27 Mar 2023
- 2023Anti-Compression Contrastive Facial Forgery Detection13 Feb 2023
- 2023LoCoNet: Long-Short Context Network for Active Speaker Detection19 Jan 2023
- 2023DPE: Disentanglement of Pose and Expression for General Video Portrait Editing16 Jan 2023
- 2022Physically Plausible Animation of Human Upper Body from a Single Image9 Dec 2022
- 2022Deep Fake Detection, Deterrence and Response: Challenges and Opportunities26 Nov 2022
- 2022SinFusion: Training Diffusion Models on a Single Image or Video21 Nov 2022
- 2022Compressing Video Calls using Synthetic Talking Heads7 Oct 2022
- 2022Implicit Warping for Animation with Image Sets4 Oct 2022
- 2022Cross-identity Video Motion Retargeting with Joint Transformation and Synthesis2 Oct 2022
- 2022Knowledge Transfer in Deep Reinforcement Learning via an RL-Specific GAN-Based Correspondence Function14 Sep 2022
- 2022Deepfake: Definitions, Performance Metrics and Standards, Datasets and Benchmarks, and a Meta-Review21 Aug 2022
- 2022Audio Input Generates Continuous Frames to Synthesize Facial Video Using Generative Adiversarial Networks18 Jul 2022
- 2022CTrGAN: Cycle Transformers GAN for Gait Transfer30 Jun 2022
- 2022Self-Supervised Learning for Videos: A Survey18 Jun 2022
- 2022Diverse Video Generation from a Single Video11 May 2022
- 2022Synthetic Data -- what, why and how?6 May 2022
- 2022ROMA: Cross-Domain Region Similarity Matching for Unpaired Nighttime Infrared to Daytime Visible Video Translation26 Apr 2022
- 2022TemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinates7 Apr 2022
- 2022FoV-Net: Field-of-View Extrapolation Using Self-Attention and Uncertainty4 Apr 2022
- 2022Exploring Frequency Adversarial Attacks for Face Forgery Detection29 Mar 2022
- 2022QS-Craft: Learning to Quantize, Scrabble and Craft for Conditional Human Motion Animation22 Mar 2022
- 2022A survey on GANs for computer vision: Recent research, analysis and taxonomy21 Mar 2022
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN8 Mar 2022
50 newest of 89 All 89 (JSON)
- 2022SinFusion: Training Diffusion Models on a Single Image or Videocited by 58
- 2023AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatarscited by 29
- 2025Unsupervised Cardiac Video Translation Via Motion Feature Guided Diffusion Modelcited by 2
- 2023FashionFlow: Leveraging Diffusion Models for Dynamic Fashion Video Synthesis from Static Imagerycited by 1
- 2024TC-PDM: Temporally Consistent Patch Diffusion Models for Infrared-to-Visible Video Translationcited by 0
- 2025Unsupervised Cardiac Video Translation Via Motion Feature Guided Diffusion Model1 Jul 2025
- 2024TC-PDM: Temporally Consistent Patch Diffusion Models for Infrared-to-Visible Video Translation26 Aug 2024
- 2023FashionFlow: Leveraging Diffusion Models for Dynamic Fashion Video Synthesis from Static Imagery29 Sep 2023
- 2023AvatarStudio: Text-driven Editing of 3D Dynamic Human Head Avatars1 Jun 2023
- 2022SinFusion: Training Diffusion Models on a Single Image or Video21 Nov 2022
- 2021Motion Representations for Articulated Animationcited by 253
- 2021PIRenderer: Controllable Portrait Image Generation via Semantic Neural Renderingcited by 202
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 162
- 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 148
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2022Self-Supervised Learning for Videos: A Surveycited by 85
- 2021Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forwardcited by 82
- 2021Explainability of deep vision-based autonomous driving systems: Review and challengescited by 80
- 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
- 2022Synthetic Data -- what, why and how?cited by 66
- 2021Style and Pose Control for Image Synthesis of Humans from a Single Monocular Viewcited by 53
12 most cited of 84 All 84 (JSON)
- 2025CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation22 Dec 2025
- 2024A comprehensive GeoAI review: Progress, Challenges and Outlooks16 Dec 2024
- 2024Neural-Network-Enhanced Metalens Camera for High-Definition, Dynamic Imaging in the Long-Wave Infrared Spectrum26 Nov 2024
- 2024Video to Video Generative Adversarial Network for Few-shot Learning Based on Policy Gradient28 Oct 2024
- 2024GaussianHeads: End-to-End Learning of Drivable Gaussian Head Avatars from Coarse-to-fine Representations18 Sep 2024
- 2024Do As I Do: Pose Guided Human Motion Copy24 Jun 2024
- 2024A Large-scale Universal Evaluation Benchmark For Face Forgery Detection13 Jun 2024
- 2024MegActor: Harness the Power of Raw Video for Vivid Portrait Animation31 May 2024
- 2024Explainable Deepfake Video Detection using Convolutional Neural Network and CapsuleNet19 Apr 2024
- 2024Translation-based Video-to-Video Synthesis3 Apr 2024
- 2024AniArtAvatar: Animatable 3D Art Avatar from a Single Image26 Mar 2024
- 2024Put Myself in Your Shoes: Lifting the Egocentric Perspective from Exocentric Videos11 Mar 2024
12 newest of 84 All 84 (JSON)