Demystifying Neural Style Transfer
Not on the map. Why?
Abstract (arXiv)
Neural Style Transfer has recently demonstrated very exciting results which catches eyes in both academia and industry. Despite the amazing results, the principle of neural style transfer, especially why the Gram matrices could represent style remains unclear. In this paper, we propose a novel interpretation of neural style transfer by treating it as a domain adaptation problem. Specifically, we theoretically show that matching the Gram matrices of feature maps is equivalent to minimize the Maximum Mean Discrepancy (MMD) with the second order polynomial kernel. Thus, we argue that the essence of neural style transfer is to match the feature distributions between the style images and the generated images. To further support our standpoint, we experiment with several other distribution alignment methods, and achieve appealing results. We believe this novel interpretation connects these two important research fields, and could enlighten future researches.
Key facts. Cited by 152 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jan 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 34; 2022: 37; 2023: 39; 2024: 25; 2025: 11; 2026: 6.
152 papers.
Sort:
By area:
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2022WildNet: Learning Domain Generalized Semantic Segmentation from the Wildcited by 75
- 2022The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matricescited by 62
- 2023AD-CLIP: Adapting Domains in Prompt Space Using CLIPcited by 62
- 2024Gramian Multimodal Representation Learning and Alignmentcited by 52
- 2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
38 more
- 2022Modeling Image Composition for Complex Scene Generationcited by 43
- 2021Rethinking Style Transfer: From Pixels to Parameterized Brushstrokescited by 42
- 2021Context-Aware Layout to Image Generation with Enhanced Object Appearancecited by 41
- 2021DRB-GAN: A Dynamic ResBlock Generative Adversarial Network for Artistic Style Transfercited by 38
- 2023StyLIP: Multi-Scale Style-Conditioned Prompt Learning for CLIP-based Domain Generalizationcited by 36
- 2024Customizing Text-to-Image Models with a Single Image Paircited by 36
- 2021Feature-based Style Randomization for Domain Generalizationcited by 34
- 2022Do better ImageNet classifiers assess perceptual similarity better?cited by 34
- 2024A survey of synthetic data augmentation methods in computer visioncited by 34
- 2022NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fieldscited by 33
- 2021Visualizing Adapted Knowledge in Domain Transfercited by 32
- 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfercited by 32
- 2022FIFO: Learning Fog-invariant Features for Foggy Scene Segmentationcited by 31
- 2021Learning Scene Structure Guidance via Cross-Task Knowledge Transfer for Single Depth Super-Resolutioncited by 30
- 2021Style-Aware Normalized Loss for Improving Arbitrary Style Transfercited by 30
- 2021Aligning Correlation Information for Domain Adaptation in Action Recognitioncited by 30
- 2022Learning Graph Neural Networks for Image Style Transfercited by 29
- 2023DARE-GRAM : Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matricescited by 28
- 2021In the light of feature distributions: moment matching for Neural Style Transfercited by 26
- 2022Generating natural images with direct Patch Distributions Matchingcited by 26
- 2023APPLeNet: Visual Attention Parameterized Prompt Learning for Few-Shot Remote Sensing Image Generalization using CLIPcited by 24
- 2024FreeTuner: Any Subject in Any Style with Training-free Diffusioncited by 24
- 2021Robust Representation Learning via Perceptual Similarity Metricscited by 23
- 2022Neural Neighbor Style Transfercited by 23
- 2023Texture Learning Domain Randomization for Domain Generalized Segmentationcited by 23
- 2022Generalized One-shot Domain Adaptation of Generative Adversarial Networkscited by 19
- 2022StyleFool: Fooling Video Classification Systems via Style Transfercited by 18
- 2021Limitations of Post-Hoc Feature Alignment for Robustnesscited by 14
- 2022S2WAT: Image Style Transfer via Hierarchical Vision Transformer using Strips Window Attentioncited by 14
- 2023Transforming Radiance Field with Lipschitz Network for Photorealistic 3D Scene Stylizationcited by 14
- 2024CoARF: Controllable 3D Artistic Style Transfer for Radiance Fieldscited by 14
- 2023Painterly Image Harmonization using Diffusion Modelcited by 12
- 2021DivSwapper: Towards Diversified Patch-based Arbitrary Style Transfercited by 11
- 2022PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Modelscited by 11
- 2022Mimetic Models: Ethical Implications of AI that Acts Like Youcited by 11
- 2022Painterly Image Harmonization in Dual Domainscited by 11
- 2022A diverse large-scale building dataset and a novel plug-and-play domain generalization method for building extractioncited by 10
- 2022Industrial Style Transfer with Large-scale Geometric Warping and Content Preservationcited by 9
50 most cited of 152 All 152 (JSON)
- 2026Enhancing Multi-Region Stylization with Interior-Guided Boundary Repair7 Oct 2026
- 2026Constructing Predictive Surgical Path for AI-based Capsulorhexis Skill Transfer18 Aug 2026
- 2026Through Van Gogh's Eyes: Global Style Transfer with Diffusion Model12 Aug 2026
- 2026RefGC-SR2: Reference-guided Super-Resolution and Refinement of AI Generated Content13 Jun 2026
- 2026TwistNet-2D: Learning Second-Order Channel Interactions via Spiral Twisting for Texture Recognition6 Feb 2026
- 2026Sissi: Zero-shot Style-guided Image Synthesis via Semantic-style Integration10 Jan 2026
- 2025TRANSPORTER: Transferring Visual Semantics from VLM Manifolds23 Nov 2025
- 2025Stylos: Multi-View 3D Stylization with Single-Forward Gaussian Splatting30 Sep 2025
- 2025Johnson-Lindenstrauss Lemma Guided Network for Efficient 3D Medical Segmentation26 Sep 2025
- 2025Contrastive Desensitization Learning for Cross Domain Face Forgery Detection27 May 2025
- 2025Graph Inverse Style Transfer for Counterfactual Explainability23 May 2025
- 2025Trade-offs in Privacy-Preserving Eye Tracking through Iris Obfuscation: A Benchmarking Study14 Apr 2025
38 more
- 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusion27 Mar 2025
- 2025Adversarial Wear and Tear: Exploiting Natural Damage for Generating Physical-World Adversarial Examples27 Mar 2025
- 2025Let Synthetic Data Shine: Domain Reassembly and Soft-Fusion for Single Domain Generalization17 Mar 2025
- 2025Iris Style Transfer: Enhancing Iris Recognition with Style Features and Privacy Preservation through Neural Style Transfer6 Mar 2025
- 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfer27 Feb 2025
- 2024Gramian Multimodal Representation Learning and Alignment16 Dec 2024
- 2024Decomposed Distribution Matching in Dataset Condensation6 Dec 2024
- 2024A Novel Breast Ultrasound Image Augmentation Method Using Advanced Neural Style Transfer: An Efficient and Explainable Approach31 Oct 2024
- 2024Neural-Polyptych: Content Controllable Painting Recreation for Diverse Genres29 Sep 2024
- 2024MSSDA: Multi-Sub-Source Adaptation for Diabetic Foot Neuropathy Recognition21 Sep 2024
- 2024Style-based Clustering of Visual Artworks and the Play of Neural Style-Representations12 Sep 2024
- 2024Understanding Literary Texts by LLMs: A Case Study of Ancient Chinese Poetry22 Aug 2024
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion18 Aug 2024
- 2024DiffArtist: Towards Structure and Appearance Controllable Image Stylization22 Jul 2024
- 2024Pairwise Distance Distillation for Unsupervised Real-World Image Super-Resolution10 Jul 2024
- 2024A Domain Adaptation Model for Carotid Ultrasound: Image Harmonization, Noise Reduction, and Impact on Cardiovascular Risk Markers6 Jul 2024
- 2024Gene-Level Representation Learning via Interventional Style Transfer in Optical Pooled Screening11 Jun 2024
- 2024Multi-style Neural Radiance Field with AdaIN7 Jun 2024
- 2024FreeTuner: Any Subject in Any Style with Training-free Diffusion23 May 2024
- 2024Customizing Text-to-Image Models with a Single Image Pair2 May 2024
- 2024SRAGAN: Saliency Regularized and Attended Generative Adversarial Network for Chinese Ink-wash Painting Style Transfer24 Apr 2024
- 2024CoARF: Controllable 3D Artistic Style Transfer for Radiance Fields23 Apr 2024
- 2024Gorgeous: Create Your Desired Character Facial Makeup from Any Ideas22 Apr 2024
- 2024RoNet: Rotation-oriented Continuous Image Translation6 Apr 2024
- 2024Enhancing Industrial Transfer Learning with Style Filter: Cost Reduction and Defect-Focus25 Mar 2024
- 2024A survey of synthetic data augmentation methods in computer vision15 Mar 2024
- 2024iCONTRA: Toward Thematic Collection Design Via Interactive Concept Transfer13 Mar 2024
- 2024Navigating Beyond Dropout: An Intriguing Solution Towards Generalizable Image Super Resolution29 Feb 2024
- 2024Evaluation in Neural Style Transfer: A Review30 Jan 2024
- 2024A Class-aware Optimal Transport Approach with Higher-Order Moment Matching for Unsupervised Domain Adaptation29 Jan 2024
- 2023Learning from small data sets: Patch-based regularizers in inverse problems for image reconstruction27 Dec 2023
- 2023SPDGAN: A Generative Adversarial Network based on SPD Manifold Learning for Automatic Image Colorization21 Dec 2023
- 2023Domain Similarity-Perceived Label Assignment for Domain Generalized Underwater Object Detection20 Dec 2023
- 2023Read Between the Layers: Leveraging Multi-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models13 Dec 2023
- 2023Invariant Representation via Decoupling Style and Spurious Features from Images11 Dec 2023
- 2023A Multi-scale Information Integration Framework for Infrared and Visible Image Fusion7 Dec 2023
- 2023SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer2 Dec 2023
- 2023Towards Unsupervised Representation Learning: Learning, Evaluating and Transferring Visual Representations30 Nov 2023
50 newest of 152 All 152 (JSON)
- 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfercited by 32
- 2024FreeTuner: Any Subject in Any Style with Training-free Diffusioncited by 24
- 2023Painterly Image Harmonization using Diffusion Modelcited by 12
- 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusioncited by 7
- 2023ArtFusion: Controllable Arbitrary Style Transfer using Dual Conditional Latent Diffusion Modelscited by 4
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusioncited by 4
- 2026Sissi: Zero-shot Style-guided Image Synthesis via Semantic-style Integrationcited by 0
- 2026Through Van Gogh's Eyes: Global Style Transfer with Diffusion Modelcited by 0
- 2026Through Van Gogh's Eyes: Global Style Transfer with Diffusion Model12 Aug 2026
- 2026Sissi: Zero-shot Style-guided Image Synthesis via Semantic-style Integration10 Jan 2026
- 2025StyleMotif: Multi-Modal Motion Stylization using Style-Content Cross Fusion27 Mar 2025
- 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfer27 Feb 2025
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion18 Aug 2024
- 2024FreeTuner: Any Subject in Any Style with Training-free Diffusion23 May 2024
- 2023Painterly Image Harmonization using Diffusion Model4 Aug 2023
- 2023ArtFusion: Controllable Arbitrary Style Transfer using Dual Conditional Latent Diffusion Models15 Jun 2023
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 353
- 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
- 2021StyTr2: Image Style Transfer with Transformerscited by 186
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2022WildNet: Learning Domain Generalized Semantic Segmentation from the Wildcited by 75
- 2022The "Beatrix'' Resurrections: Robust Backdoor Detection via Gram Matricescited by 62
- 2023AD-CLIP: Adapting Domains in Prompt Space Using CLIPcited by 62
- 2024Gramian Multimodal Representation Learning and Alignmentcited by 52
- 2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
12 most cited of 143 All 143 (JSON)
- 2026Enhancing Multi-Region Stylization with Interior-Guided Boundary Repair7 Oct 2026
- 2026Constructing Predictive Surgical Path for AI-based Capsulorhexis Skill Transfer18 Aug 2026
- 2026RefGC-SR2: Reference-guided Super-Resolution and Refinement of AI Generated Content13 Jun 2026
- 2026TwistNet-2D: Learning Second-Order Channel Interactions via Spiral Twisting for Texture Recognition6 Feb 2026
- 2025TRANSPORTER: Transferring Visual Semantics from VLM Manifolds23 Nov 2025
- 2025Stylos: Multi-View 3D Stylization with Single-Forward Gaussian Splatting30 Sep 2025
- 2025Johnson-Lindenstrauss Lemma Guided Network for Efficient 3D Medical Segmentation26 Sep 2025
- 2025Contrastive Desensitization Learning for Cross Domain Face Forgery Detection27 May 2025
- 2025Graph Inverse Style Transfer for Counterfactual Explainability23 May 2025
- 2025Trade-offs in Privacy-Preserving Eye Tracking through Iris Obfuscation: A Benchmarking Study14 Apr 2025
- 2025Adversarial Wear and Tear: Exploiting Natural Damage for Generating Physical-World Adversarial Examples27 Mar 2025
- 2025Let Synthetic Data Shine: Domain Reassembly and Soft-Fusion for Single Domain Generalization17 Mar 2025
12 newest of 143 All 143 (JSON)