Exploring the structure of a real-time, arbitrary neural artistic stylization network
Not on the map. Why?
Abstract (arXiv)
In this paper, we present a method which combines the flexibility of the neural algorithm of artistic style with the speed of fast style transfer networks to allow real-time stylization using any content/style image pair. We build upon recent work leveraging conditional instance normalization for multi-style transfer networks by learning to predict the conditional instance normalization parameters directly from a style image. The model is successfully trained on a corpus of roughly 80,000 paintings and is able to generalize to paintings previously unobserved. We demonstrate that the learned embedding space is smooth and contains a rich structure and organizes semantic information associated with paintings in an entirely unsupervised manner.
Key facts. Cited by 89 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 23; 2023: 22; 2024: 13; 2025: 5; 2026: 2.
89 papers.
Sort:
By area:
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
- 2022EnvEdit: Environment Editing for Vision-and-Language Navigationcited by 83
- 2024Instruct-Imagen: Image Generation with Multi-modal Instructioncited by 65
- 2021Editing a classifier by rewriting its prediction rulescited by 64
- 2021SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gapcited by 57
- 2021Rethinking and Improving the Robustness of Image Style Transfercited by 48
- 20213D Photo Stylization: Learning to Generate Stylized Novel Views from a Single Imagecited by 45
- 2021Self-supervised Monocular Depth Estimation for All Day Images using Domain Separationcited by 44
- 2022Robust Multi-Task Learning and Online Refinement for Spacecraft Pose Estimation across Domain Gapcited by 44
38 more
- 2022UV Volumes for Real-time Rendering of Editable Free-view Human Performancecited by 43
- 2022Federated Domain Generalization for Image Recognition via Cross-Client Style Transfercited by 40
- 2023ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptationcited by 39
- 2021Meta-Learning Dynamics Forecasting Using Task Inferencecited by 37
- 2022TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editingcited by 36
- 2021ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similaritycited by 34
- 2023Progressive Random Convolutions for Single Domain Generalizationcited by 33
- 2021TryOnGAN: Body-Aware Try-On via Layered Interpolationcited by 31
- 2021Style-Aware Normalized Loss for Improving Arbitrary Style Transfercited by 30
- 2024Boosting Neural Representations for Videos with a Conditional Decodercited by 29
- 2021Styleformer: Transformer based Generative Adversarial Networks with Style Vectorcited by 27
- 2022FiLM-Ensemble: Probabilistic Deep Learning via Feature-wise Linear Modulationcited by 24
- 2023Any-to-Any Style Transfer: Making Picasso and Da Vinci Collaboratecited by 17
- 2021Adaptive Denoising via GainTuningcited by 16
- 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Datacited by 15
- 2021An overview of mixing augmentation methods and augmentation strategiescited by 14
- 20223D Segmentation Guided Style-based Generative Adversarial Networks for PET Synthesiscited by 13
- 2022StyleBabel: Artistic Style Tagging and Captioningcited by 12
- 2022PCA-Based Knowledge Distillation Towards Lightweight and Content-Style Balanced Photorealistic Style Transfer Modelscited by 11
- 2023Rapid Network Adaptation: Learning to Adapt Neural Networks Using Test-Time Feedbackcited by 10
- 2021Instagram Filter Removal on Fashionable Imagescited by 8
- 2023Benchmarking Robustness to Adversarial Image Obfuscationscited by 8
- 2023Edit at your own risk: evaluating the robustness of edited models to distribution shiftscited by 8
- 2023Learning Disentangled Prompts for Compositional Image Synthesiscited by 8
- 2021TS-Net: OCR Trained to Switch Between Text Transcription Stylescited by 7
- 2024GRANOLA: Adaptive Normalization for Graph Neural Networkscited by 7
- 2021Deep Learning based Multi-modal Computing with Feature Disentanglement for MRI Image Synthesiscited by 6
- 2022Quality Evaluation of Arbitrary Style Transfer: Subjective Study and Objective Metriccited by 6
- 2022FastCLIPstyler: Optimisation-free Text-based Image Style Transfer Using Style Representationscited by 6
- 2022Modeling the Lighting in Scenes as Style for Auto White-Balance Correctioncited by 6
- 2023Towards Writing Style Adaptation in Handwriting Recognitioncited by 6
- 2023Domain Adaptive Sim-to-Real Segmentation of Oropharyngeal Organs Towards Robot-assisted Intubationcited by 6
- 2024Bridging the Domain Gap for Flight-Ready Spaceborne Visioncited by 6
- 2021SA-GAN: Structure-Aware GAN for Organ-Preserving Synthetic CT Generationcited by 5
- 2021Towards Lightweight Controllable Audio Synthesis with Conditional Implicit Neural Representationscited by 5
- 2022Patch-wise Contrastive Style Learning for Instagram Filter Removalcited by 5
- 2022Feather-Light Fourier Domain Adaptation in Magnetic Resonance Imagingcited by 5
- 2023Substance or Style: What Does Your Image Embedding Know?cited by 5
50 most cited of 89 All 89 (JSON)
- 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesis24 Jun 2026
- 2026CONSTANT: Towards High-Quality One-Shot Handwriting Generation with Patch Contrastive Enhancement and Style-Aware Quantization8 Mar 2026
- 2025Stylized Synthetic Augmentation further improves Corruption Robustness17 Dec 2025
- 2025GANime: Generating Anime and Manga Character Drawings from Sketches with Deep Learning10 Aug 2025
- 2025Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networks14 Jul 2025
- 2025Pluggable Style Representation Learning for Multi-Style Transfer26 Mar 2025
- 2025PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillation24 Feb 2025
- 2024LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Model16 Dec 2024
- 2024The Role of Text-to-Image Models in Advanced Style Transfer Applications: A Case Study with DALL-E 34 Dec 2024
- 2024Revisiting Your Memory: Reconstruction of Affect-Contextualized Memory via EEG-guided Audiovisual Generation24 Nov 2024
- 2024Bridging the Domain Gap for Flight-Ready Spaceborne Vision18 Sep 2024
- 2024ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics11 Sep 2024
38 more
- 2024StyleBrush: Style Extraction and Transfer from a Single Image18 Aug 2024
- 2024SDNIA-YOLO: A Robust Object Detection Model for Extreme Weather Conditions18 Jun 2024
- 2024On the Limits of Multi-modal Meta-Learning with Auxiliary Task Modulation Using Conditional Batch Normalization29 May 2024
- 2024GRANOLA: Adaptive Normalization for Graph Neural Networks20 Apr 2024
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Tasks21 Mar 2024
- 2024Boosting Neural Representations for Videos with a Conditional Decoder28 Feb 2024
- 2024Evaluation in Neural Style Transfer: A Review30 Jan 2024
- 2024Instruct-Imagen: Image Generation with Multi-modal Instruction3 Jan 2024
- 2023AesFA: An Aesthetic Feature-Aware Arbitrary Neural Style Transfer10 Dec 2023
- 2023ArtAdapter: Text-to-Image Style Transfer using Multi-Level Style Encoder and Explicit Adaptation4 Dec 2023
- 2023Coordinate-Aware Modulation for Neural Fields25 Nov 2023
- 2023Neural Style Transfer for Computer Games24 Nov 2023
- 2023DeepIron: Predicting Unwarped Garment Texture from a Single Image24 Oct 2023
- 2023Rapid Network Adaptation: Learning to Adapt Neural Networks Using Test-Time Feedback27 Sep 2023
- 2023Retinex-guided Channel-grouping based Patch Swap for Arbitrary Style Transfer19 Sep 2023
- 2023Divergences in Color Perception between Deep Neural Networks and Humans11 Sep 2023
- 2023WSAM: Visual Explanations from Style Augmentation as Adversarial Attacker and Their Influence in Image Classification29 Aug 2023
- 2023Personal Protective Equipment Detection in Extreme Construction Conditions25 Jul 2023
- 2023Substance or Style: What Does Your Image Embedding Know?10 Jul 2023
- 2023Dequantization and Color Transfer with Diffusion Models6 Jul 2023
- 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Data25 Jun 2023
- 2023ArtFusion: Controllable Arbitrary Style Transfer using Dual Conditional Latent Diffusion Models15 Jun 2023
- 2023Learning Disentangled Prompts for Compositional Image Synthesis1 Jun 2023
- 2023Domain Adaptive Sim-to-Real Segmentation of Oropharyngeal Organs Towards Robot-assisted Intubation19 May 2023
- 2023Domain Adaptive Sim-to-Real Segmentation of Oropharyngeal Organs18 May 2023
- 2023Any-to-Any Style Transfer: Making Picasso and Da Vinci Collaborate19 Apr 2023
- 2023Progressive Random Convolutions for Single Domain Generalization2 Apr 2023
- 2023Edit at your own risk: evaluating the robustness of edited models to distribution shifts28 Feb 2023
- 2023Towards Writing Style Adaptation in Handwriting Recognition13 Feb 2023
- 2023Benchmarking Robustness to Adversarial Image Obfuscations30 Jan 2023
- 2022Face Swapping as A Simple Arithmetic Operation19 Nov 2022
- 2022Modeling the Lighting in Scenes as Style for Auto White-Balance Correction17 Oct 2022
- 2022Reversing Image Signal Processors by Reverse Style Transferring17 Oct 2022
- 2022Sequential Ensembling for Semantic Segmentation8 Oct 2022
- 2022FastCLIPstyler: Optimisation-free Text-based Image Style Transfer Using Style Representations7 Oct 2022
- 2022Federated Domain Generalization for Image Recognition via Cross-Client Style Transfer3 Oct 2022
- 2022Realistic Hair Synthesis with Generative Adversarial Networks13 Sep 2022
- 2022Quality Evaluation of Arbitrary Style Transfer: Subjective Study and Objective Metric1 Aug 2022
50 newest of 89 All 89 (JSON)
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
- 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Datacited by 15
- 2024LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Modelcited by 5
- 2023ArtFusion: Controllable Arbitrary Style Transfer using Dual Conditional Latent Diffusion Modelscited by 4
- 2023Dequantization and Color Transfer with Diffusion Modelscited by 4
- 2026CONSTANT: Towards High-Quality One-Shot Handwriting Generation with Patch Contrastive Enhancement and Style-Aware Quantizationcited by 1
- 2026CONSTANT: Towards High-Quality One-Shot Handwriting Generation with Patch Contrastive Enhancement and Style-Aware Quantization8 Mar 2026
- 2024LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Model16 Dec 2024
- 2023Dequantization and Color Transfer with Diffusion Models6 Jul 2023
- 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Data25 Jun 2023
- 2023ArtFusion: Controllable Arbitrary Style Transfer using Dual Conditional Latent Diffusion Models15 Jun 2023
- 2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Models12 Apr 2021
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2024AnyV2V: A Tuning-Free Framework For Any Video-to-Video Editing Taskscited by 151
- 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
- 2022EnvEdit: Environment Editing for Vision-and-Language Navigationcited by 83
- 2024Instruct-Imagen: Image Generation with Multi-modal Instructioncited by 65
- 2021Editing a classifier by rewriting its prediction rulescited by 64
- 2021SPEED+: Next-Generation Dataset for Spacecraft Pose Estimation across Domain Gapcited by 57
- 2021Rethinking and Improving the Robustness of Image Style Transfercited by 48
- 20213D Photo Stylization: Learning to Generate Stylized Novel Views from a Single Imagecited by 45
- 2021Self-supervised Monocular Depth Estimation for All Day Images using Domain Separationcited by 44
- 2022Robust Multi-Task Learning and Online Refinement for Spacecraft Pose Estimation across Domain Gapcited by 44
- 2022UV Volumes for Real-time Rendering of Editable Free-view Human Performancecited by 43
12 most cited of 83 All 83 (JSON)
- 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesis24 Jun 2026
- 2025Stylized Synthetic Augmentation further improves Corruption Robustness17 Dec 2025
- 2025GANime: Generating Anime and Manga Character Drawings from Sketches with Deep Learning10 Aug 2025
- 2025Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networks14 Jul 2025
- 2025Pluggable Style Representation Learning for Multi-Style Transfer26 Mar 2025
- 2025PQDAST: Depth-Aware Arbitrary Style Transfer for Games via Perceptual Quality-Guided Distillation24 Feb 2025
- 2024The Role of Text-to-Image Models in Advanced Style Transfer Applications: A Case Study with DALL-E 34 Dec 2024
- 2024Revisiting Your Memory: Reconstruction of Affect-Contextualized Memory via EEG-guided Audiovisual Generation24 Nov 2024
- 2024Bridging the Domain Gap for Flight-Ready Spaceborne Vision18 Sep 2024
- 2024ODYSSEE: Oyster Detection Yielded by Sensor Systems on Edge Electronics11 Sep 2024
- 2024StyleBrush: Style Extraction and Transfer from a Single Image18 Aug 2024
- 2024SDNIA-YOLO: A Robust Object Detection Model for Extreme Weather Conditions18 Jun 2024
12 newest of 83 All 83 (JSON)