StyleGANEX: StyleGAN-Based Manipulation Beyond Cropped Aligned Faces
Not on the map. Why?
Abstract (arXiv)
Recent advances in face manipulation using StyleGAN have produced impressive results. However, StyleGAN is inherently limited to cropped aligned faces at a fixed image resolution it is pre-trained on. In this paper, we propose a simple and effective solution to this limitation by using dilated convolutions to rescale the receptive fields of shallow layers in StyleGAN, without altering any model parameters. This allows fixed-size small features at shallow layers to be extended into larger ones that can accommodate variable resolutions, making them more robust in characterizing unaligned faces. To enable real face inversion and manipulation, we introduce a corresponding encoder that provides the first-layer feature of the extended StyleGAN in addition to the latent style code. We validate the effectiveness of our method using unaligned face inputs of various resolutions in a diverse set of face manipulation tasks, including facial attribute editing, super-resolution, sketch/mask-to-face translation, and face toonification.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 38 of its 46 references that are in the map. First posted on arXiv 10 Mar 2023.
Builds on
38 of 46 references.
References · 38
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
- 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 691
26 more
- 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2020In-Domain GAN Inversion for Real Image Editingcited by 420
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 348
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2020GLEAN: Generative Latent Bank for Large-Factor Image Super-Resolutioncited by 158
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2020Resolution Dependent GAN Interpolation for Controllable Image Synthesis Between Domainscited by 96
- 2021HyperInverter: Improving StyleGAN Inversion via Hypernetworkcited by 85
- 2020StyleGAN2 Distillation for Feed-forward Image Manipulationcited by 78
- 2022Stitch it in Time: GAN-Based Facial Editing of Real Videoscited by 68
- 2020TSIT: A Simple and Versatile Framework for Image-to-Image Translationcited by 64
- 2021GAN Inversion for Out-of-Range Images with Geometric Transformationscited by 55
- 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
- 2021Low-Rank Subspaces in GANscited by 52
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2020PIE: Portrait Image Embedding for Semantic Controlcited by 41
- 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
- 2022VToonify: Controllable High-Resolution Portrait Video Style Transfercited by 20
Built on by
Citing papers per year: 2023: 4; 2024: 6; 2025: 8; 2026: 1.
19 papers.
Sort:
By area:
- 2025Controllable Video Generation: A Surveycited by 93
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2024TextToon: Real-Time Text Toonify Head Avatar from Single Videocited by 21
- 2025Generative AI for Cel-Animation: A Surveycited by 17
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidancecited by 14
- 2023RIGID: Recurrent GAN Inversion and Editing of Real Face Videoscited by 13
- 2024BeautyBank: Encoding Facial Makeup in Latent Spacecited by 4
- 2025Collaboration and Controversy Among Experts: Rumor Early Detection by Tuning a Comment Generatorcited by 4
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detectioncited by 4
- 2023Video Face Re-Aging: Toward Temporally Consistent Face Re-Agingcited by 3
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfercited by 2
- 2025ToonifyGB: StyleGAN-based Gaussian Blendshapes for 3D Stylized Head Avatarscited by 2
7 more
- 2024S3Editor: A Sparse Semantic-Disentangled Self-Training Framework for Face Video Editingcited by 1
- 2023Subjective Face Transform using Human First Impressionscited by 0
- 2024Real Face Video Animation Platformcited by 0
- 2025Geometry-Aware Texture Generation for 3D Head Modeling with Artist-driven Controlcited by 0
- 2025GaitCrafter: Diffusion Model for Biometric Preserving Gait Synthesiscited by 0
- 2025DeepForgeSeal: Latent Space-Driven Semi-Fragile Watermarking for Deepfake Detection Using Adversarial Reinforcement Learningcited by 0
- 2026ReAge3D: Re-Aging 3D Faces with View Consistencycited by 0
- 2026ReAge3D: Re-Aging 3D Faces with View Consistency16 Jun 2026
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection11 Dec 2025
- 2025DeepForgeSeal: Latent Space-Driven Semi-Fragile Watermarking for Deepfake Detection Using Adversarial Reinforcement Learning7 Nov 2025
- 2025GaitCrafter: Diffusion Model for Biometric Preserving Gait Synthesis18 Aug 2025
- 2025Controllable Video Generation: A Survey22 Jul 2025
- 2025ToonifyGB: StyleGAN-based Gaussian Blendshapes for 3D Stylized Head Avatars15 May 2025
- 2025Geometry-Aware Texture Generation for 3D Head Modeling with Artist-driven Control7 May 2025
- 2025Collaboration and Controversy Among Experts: Rumor Early Detection by Tuning a Comment Generator5 Apr 2025
- 2025Generative AI for Cel-Animation: A Survey8 Jan 2025
- 2024BeautyBank: Encoding Facial Makeup in Latent Space18 Nov 2024
- 2024TextToon: Real-Time Text Toonify Head Avatar from Single Video23 Sep 2024
- 2024Real Face Video Animation Platform12 Jul 2024
7 more
- 2024S3Editor: A Sparse Semantic-Disentangled Self-Training Framework for Face Video Editing11 Apr 2024
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidance1 Mar 2024
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfer5 Feb 2024
- 2023Video Face Re-Aging: Toward Temporally Consistent Face Re-Aging20 Nov 2023
- 2023Subjective Face Transform using Human First Impressions27 Sep 2023
- 2023RIGID: Recurrent GAN Inversion and Editing of Real Face Videos11 Aug 2023
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars22 May 2023
- 2025Controllable Video Generation: A Surveycited by 93
- 2023RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatarscited by 45
- 2024TextToon: Real-Time Text Toonify Head Avatar from Single Videocited by 21
- 2025Generative AI for Cel-Animation: A Surveycited by 17
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidancecited by 14
- 2023RIGID: Recurrent GAN Inversion and Editing of Real Face Videoscited by 13
- 2024BeautyBank: Encoding Facial Makeup in Latent Spacecited by 4
- 2025Collaboration and Controversy Among Experts: Rumor Early Detection by Tuning a Comment Generatorcited by 4
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detectioncited by 4
- 2023Video Face Re-Aging: Toward Temporally Consistent Face Re-Agingcited by 3
- 2024ToonAging: Face Re-Aging upon Artistic Portrait Style Transfercited by 2
- 2025ToonifyGB: StyleGAN-based Gaussian Blendshapes for 3D Stylized Head Avatarscited by 2
12 most cited of 17 All 17 (JSON)
- 2026ReAge3D: Re-Aging 3D Faces with View Consistency16 Jun 2026
- 2025TriDF: Evaluating Perception, Detection, and Hallucination for Interpretable DeepFake Detection11 Dec 2025
- 2025Controllable Video Generation: A Survey22 Jul 2025
- 2025ToonifyGB: StyleGAN-based Gaussian Blendshapes for 3D Stylized Head Avatars15 May 2025
- 2025Geometry-Aware Texture Generation for 3D Head Modeling with Artist-driven Control7 May 2025
- 2025Collaboration and Controversy Among Experts: Rumor Early Detection by Tuning a Comment Generator5 Apr 2025
- 2025Generative AI for Cel-Animation: A Survey8 Jan 2025
- 2024BeautyBank: Encoding Facial Makeup in Latent Space18 Nov 2024
- 2024TextToon: Real-Time Text Toonify Head Avatar from Single Video23 Sep 2024
- 2024Real Face Video Animation Platform12 Jul 2024
- 2024S3Editor: A Sparse Semantic-Disentangled Self-Training Framework for Face Video Editing11 Apr 2024
- 2024Deformable One-shot Face Stylization via DINO Semantic Guidance1 Mar 2024
12 newest of 17 All 17 (JSON)