Deep Photo Style Transfer
Not on the map. Why?
Abstract (arXiv)
This paper introduces a deep-learning approach to photographic style transfer that handles a large variety of image content while faithfully transferring the reference style. Our approach builds upon the recent work on painterly transfer that separates style from the content of an image by considering different layers of a neural network. However, as is, this approach is not suitable for photorealistic style transfer. Even when both the input and reference images are photographs, the output still exhibits distortions reminiscent of a painting. Our contribution is to constrain the transformation from the input to the output to be locally affine in colorspace, and to express this constraint as a custom fully differentiable energy term. We show that this approach successfully suppresses distortion and yields satisfying photorealistic style transfers in a broad variety of scenarios, including transfer of the time of day, weather, season, and artistic edits.
Key facts. Cited by 168 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 49; 2022: 35; 2023: 33; 2024: 23; 2025: 16; 2026: 12.
168 papers.
Sort:
By area:
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2022ARF: Artistic Radiance Fieldscited by 147
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2021NeRF for Outdoor Scene Relightingcited by 114
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2023A Comprehensive Survey on Source-free Domain Adaptationcited by 104
- 2023Expressive Text-to-Image Generation with Rich Textcited by 89
- 2021Enhancing Photorealism Enhancementcited by 74
- 2021The Spatially-Correlative Loss for Various Image Translation Taskscited by 66
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
38 more
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2022MagicMix: Semantic Mixing with Diffusion Modelscited by 63
- 2021High-Resolution Photorealistic Image Translation in Real-Time: A Laplacian Pyramid Translation Networkcited by 61
- 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
- 2022Physical Attack on Monocular Depth Estimation with Optimal Adversarial Patchescited by 57
- 2024LightIt: Illumination Modeling and Control for Diffusion Modelscited by 56
- 2021Enjoy Your Editing: Controllable GANs for Image Editing via Latent Space Navigationcited by 53
- 2021Self-supervised Outdoor Scene Relightingcited by 48
- 2021BlendGAN: Implicitly GAN Blending for Arbitrary Stylized Face Generationcited by 47
- 2022UPST-NeRF: Universal Photorealistic Style Transfer of Neural Radiance Fields for 3D Scenecited by 47
- 2021Multiple Heads are Better than One: Few-shot Font Generation with Multiple Localized Expertscited by 46
- 2022CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfercited by 46
- 2021Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translationcited by 45
- 2022Face Relighting with Geometrically Consistent Shadowscited by 43
- 2021Towards High Fidelity Face Relighting with Realistic Shadowscited by 42
- 2021Domain-Aware Universal Style Transfercited by 40
- 2021Image-Based CLIP-Guided Essence Transfercited by 39
- 2021Language-Driven Image Style Transfercited by 36
- 2023Neural Preset for Color Style Transfercited by 36
- 2024A survey of synthetic data augmentation methods in computer visioncited by 34
- 2021Visualizing Adapted Knowledge in Domain Transfercited by 32
- 2024Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Drivingcited by 32
- 2022FIFO: Learning Fog-invariant Features for Foggy Scene Segmentationcited by 31
- 2021Style-Aware Normalized Loss for Improving Arbitrary Style Transfercited by 30
- 2021PhotoWCT2: Compact Autoencoder for Photorealistic Style Transfer Resulting from Blockwise Training and Skip Connections of High-Frequency Residualscited by 30
- 2025OmniStyle: Filtering High Quality Style Transfer Data at Scalecited by 30
- 2022EleGANt: Exquisite and Locally Editable GAN for Makeup Transfercited by 28
- 2023CAP-VSTNet: Content Affinity Preserved Versatile Style Transfercited by 24
- 2022Neural Neighbor Style Transfercited by 23
- 2022On the Road to Online Adaptation for Semantic Image Segmentationcited by 23
- 2023Locally Stylized Neural Radiance Fieldscited by 20
- 2021Weather GAN: Multi-Domain Weather Translation Using Generative Adversarial Networkscited by 18
- 2021Structure-Preserving Image Super-Resolutioncited by 18
- 2022XMP-Font: Self-Supervised Cross-Modality Pre-training for Few-Shot Font Generationcited by 18
- 2022QuantArt: Quantizing Image Style Transfer Towards High Visual Fidelitycited by 18
- 2024Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approachcited by 18
- 2021PSGAN++: Robust Detail-Preserving Makeup Transfer and Removalcited by 17
- 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
50 most cited of 168 All 168 (JSON)
- 2026The Skin-Restricted Reinhard Transform:Uniqueness under a Lightness-Preserving Constraint23 Sep 2026
- 2026Registration-Free Hyperspectral Reconstruction from RGB via a Permutation-Invariant Gram-Matrix Principle15 Aug 2026
- 2026ColorFM: An Optimization-to-Learning Framework for Color Transfer via Flow Matching8 Jul 2026
- 2026Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset5 Jul 2026
- 2026FreeStyle: Free Control of Style-Content Dual-Reference Generation from Community LoRA Mining18 Jun 2026
- 2026Hist2Style: Histogram-Guided Stylization with Bilateral Grids1 Jun 2026
- 2026Mitigating Content Shift and Hallucination in GenAI Image Editing via Structural Refinement28 May 2026
- 2026Towards In-Context Tone Style Transfer with A Large-Scale Triplet Dataset17 Apr 2026
- 2026AceTone: Bridging Words and Colors for Conditional Image Grading1 Apr 2026
- 2026SemiNFT: Learning to Transfer Presets from Imitation to Appreciation via Hybrid-Sample Reinforcement Learning9 Feb 2026
- 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Loss23 Jan 2026
- 2026Face Normal Estimation from Rags to Riches5 Jan 2026
38 more
- 2025LumiCtrl : Learning Illuminant Prompts for Lighting Control in Personalized Text-to-Image Models19 Dec 2025
- 2025Exploring Object-Aware Attention Guided Frame Association for RGB-D SLAM30 Oct 2025
- 2025DiffStyleTS: Diffusion Model for Style Transfer in Time Series13 Oct 2025
- 2025ReSWD: ReSTIR'd, not shaken. Combining Reservoir Sampling and Sliced Wasserstein Distance for Variance Reduction1 Oct 2025
- 2025Improved 3D Scene Stylization via Text-Guided Generative Image Editing with Region-Based Control4 Sep 2025
- 2025Video Color Grading via Look-Up Table Generation1 Aug 2025
- 2025Domain Generalizable Portrait Style Transfer6 Jul 2025
- 2025synth-dacl: Does Synthetic Defect Data Enhance Segmentation Accuracy and Robustness for Real-World Bridge Inspections?17 Jun 2025
- 2025SA-LUT: Spatial Adaptive 4D Look-Up Table for Photorealistic Style Transfer16 Jun 2025
- 2025Multi-StyleGS: Stylizing Gaussian Splatting with Multiple Styles7 Jun 2025
- 2025OmniStyle: Filtering High Quality Style Transfer Data at Scale20 May 2025
- 2025Color Transfer with Modulated Flows24 Mar 2025
- 2025Color Conditional Generation with Sliced Wasserstein Guidance24 Mar 2025
- 2025UStyle: Waterbody Style Transfer of Underwater Scenes by Depth-Guided Feature Synthesis14 Mar 2025
- 2025FPGS: Feed-Forward Semantic-aware Photorealistic Style Transfer of Large-Scale Gaussian Splatting11 Mar 2025
- 2025Modality-Agnostic Style Transfer for Holistic Feature Imputation3 Mar 2025
- 2024IntroStyle: Training-Free Introspective Style Attribution using Diffusion Features19 Dec 2024
- 2024INRetouch: Context Aware Implicit Neural Representation for Photography Retouching5 Dec 2024
- 2024GIST: Towards Photorealistic Style Transfer via Multiscale Geometric Representations3 Dec 2024
- 2024CNNs for Style Transfer of Digital to Film Photography24 Nov 2024
- 2024NCST: Neural-based Color Style Transfer for Video Retouching1 Nov 2024
- 2024MRStyle: A Unified Framework for Color Style Transfer with Multi-Modality Reference9 Sep 2024
- 2024Bridging the Gap between Real-world and Synthetic Images for Testing Autonomous Driving Systems25 Aug 2024
- 2024FDWST: Fingerphoto Deblurring using Wavelet Style Transfer22 Jul 2024
- 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Images19 Jun 2024
- 2024StyleCity: Large-Scale 3D Urban Scenes Stylization16 Apr 2024
- 2024RoNet: Rotation-oriented Continuous Image Translation6 Apr 2024
- 2024Measuring Style Similarity in Diffusion Models1 Apr 2024
- 2024Physical 3D Adversarial Attacks against Monocular Depth Estimation in Autonomous Driving26 Mar 2024
- 2024Style-Extracting Diffusion Models for Semi-Supervised Histopathology Segmentation21 Mar 2024
- 2024LocalStyleFool: Regional Video Style Transfer Attack Using Segment Anything Model18 Mar 2024
- 2024LightIt: Illumination Modeling and Control for Diffusion Models15 Mar 2024
- 2024A survey of synthetic data augmentation methods in computer vision15 Mar 2024
- 2024ConRF: Zero-shot Stylization of 3D Scenes with Conditioned Radiation Fields2 Feb 2024
- 2024Geometry Transfer for Stylizing Radiance Fields1 Feb 2024
- 2024Evaluation in Neural Style Transfer: A Review30 Jan 2024
- 2024Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approach28 Jan 2024
- 2024Artwork Protection Against Neural Style Transfer Using Locally Adaptive Adversarial Color Attack18 Jan 2024
50 newest of 168 All 168 (JSON)
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Modelscited by 154
- 2024Measuring Style Similarity in Diffusion Modelscited by 106
- 2022MagicMix: Semantic Mixing with Diffusion Modelscited by 63
- 2024LightIt: Illumination Modeling and Control for Diffusion Modelscited by 56
- 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Imagescited by 16
- 2023DiFaReli++: Diffusion Face Relighting with Consistent Cast Shadowscited by 14
- 2025Color Transfer with Modulated Flowscited by 7
- 2023Dequantization and Color Transfer with Diffusion Modelscited by 4
- 2024Style-Extracting Diffusion Models for Semi-Supervised Histopathology Segmentationcited by 3
- 2025DiffStyleTS: Diffusion Model for Style Transfer in Time Seriescited by 1
- 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Losscited by 0
12 most cited of 13 All 13 (JSON)
- 2026ColorFM: An Optimization-to-Learning Framework for Color Transfer via Flow Matching8 Jul 2026
- 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Loss23 Jan 2026
- 2025DiffStyleTS: Diffusion Model for Style Transfer in Time Series13 Oct 2025
- 2025Color Transfer with Modulated Flows24 Mar 2025
- 2024Style-NeRF2NeRF: 3D Style Transfer From Style-Aligned Multi-View Images19 Jun 2024
- 2024Measuring Style Similarity in Diffusion Models1 Apr 2024
- 2024Style-Extracting Diffusion Models for Semi-Supervised Histopathology Segmentation21 Mar 2024
- 2024LightIt: Illumination Modeling and Control for Diffusion Models15 Mar 2024
- 2023StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models15 Aug 2023
- 2023Dequantization and Color Transfer with Diffusion Models6 Jul 2023
- 2023DiFaReli++: Diffusion Face Relighting with Consistent Cast Shadows19 Apr 2023
- 2022MagicMix: Semantic Mixing with Diffusion Models28 Oct 2022
12 newest of 13 All 13 (JSON)
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2022ARF: Artistic Radiance Fieldscited by 147
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2021NeRF for Outdoor Scene Relightingcited by 114
- 2023A Comprehensive Survey on Source-free Domain Adaptationcited by 104
- 2023Expressive Text-to-Image Generation with Rich Textcited by 89
- 2021Enhancing Photorealism Enhancementcited by 74
- 2021The Spatially-Correlative Loss for Various Image Translation Taskscited by 66
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2021High-Resolution Photorealistic Image Translation in Real-Time: A Laplacian Pyramid Translation Networkcited by 61
- 2021SSH: A Self-Supervised Framework for Image Harmonizationcited by 60
12 most cited of 155 All 155 (JSON)
- 2026The Skin-Restricted Reinhard Transform:Uniqueness under a Lightness-Preserving Constraint23 Sep 2026
- 2026Registration-Free Hyperspectral Reconstruction from RGB via a Permutation-Invariant Gram-Matrix Principle15 Aug 2026
- 2026Perceiving Better Moments: Cover Frame Reselection and Enhancement for Live Photos with the Live2K Dataset5 Jul 2026
- 2026FreeStyle: Free Control of Style-Content Dual-Reference Generation from Community LoRA Mining18 Jun 2026
- 2026Hist2Style: Histogram-Guided Stylization with Bilateral Grids1 Jun 2026
- 2026Mitigating Content Shift and Hallucination in GenAI Image Editing via Structural Refinement28 May 2026
- 2026Towards In-Context Tone Style Transfer with A Large-Scale Triplet Dataset17 Apr 2026
- 2026AceTone: Bridging Words and Colors for Conditional Image Grading1 Apr 2026
- 2026SemiNFT: Learning to Transfer Presets from Imitation to Appreciation via Hybrid-Sample Reinforcement Learning9 Feb 2026
- 2026Face Normal Estimation from Rags to Riches5 Jan 2026
- 2025LumiCtrl : Learning Illuminant Prompts for Lighting Control in Personalized Text-to-Image Models19 Dec 2025
- 2025Exploring Object-Aware Attention Guided Frame Association for RGB-D SLAM30 Oct 2025
12 newest of 155 All 155 (JSON)