Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
Not on the map. Why?
Abstract (arXiv)
This paper studies a combination of generative Markov random field (MRF) models and discriminatively trained deep convolutional neural networks (dCNNs) for synthesizing 2D images. The generative MRF acts on higher-levels of a dCNN feature pyramid, controling the image layout at an abstract level. We apply the method to both photographic and non-photo-realistic (artwork) synthesis tasks. The MRF regularizer prevents over-excitation artifacts and reduces implausible feature mixtures common to previous dCNN inversion approaches, permitting synthezing photographic content with increased visual plausibility. Unlike standard MRF-based texture synthesis, the combined system can both match and adapt local features with considerable variability, yielding results far out of reach of classic generative MRF methods.
Key facts. Cited by 102 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Jan 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 30; 2023: 24; 2024: 12; 2025: 5; 2026: 6.
102 papers.
Sort:
By area:
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2022ARF: Artistic Radiance Fieldscited by 147
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
- 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58
- 2021Drafting and Revision: Laplacian Pyramid Network for Fast High-Quality Artistic Style Transfercited by 41
- 2023Neural Preset for Color Style Transfercited by 36
- 2021Feature-based Style Randomization for Domain Generalizationcited by 34
- 2022NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fieldscited by 33
- 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Modelscited by 33
- 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfercited by 32
38 more
- 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Trainingcited by 29
- 2022Learning Graph Neural Networks for Image Style Transfercited by 29
- 2021In the light of feature distributions: moment matching for Neural Style Transfercited by 26
- 2022Generating natural images with direct Patch Distributions Matchingcited by 26
- 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmarkcited by 24
- 2022Semantic Segmentation in Art Paintingscited by 23
- 2022Neural Neighbor Style Transfercited by 23
- 2021Exemplar-Based 3D Portrait Stylizationcited by 21
- 2022AesUST: Towards Aesthetic-Enhanced Universal Style Transfercited by 21
- 2021SOUP-GAN: Super-Resolution MRI Using Generative Adversarial Networkscited by 18
- 2022Improving Nighttime Driving-Scene Segmentation via Dual Image-adaptive Learnable Filterscited by 17
- 2021Training a Task-Specific Image Reconstruction Losscited by 16
- 2022All-to-key Attention for Arbitrary Style Transfercited by 16
- 2024Geometry Transfer for Stylizing Radiance Fieldscited by 16
- 2022Spatial Mixture-of-Expertscited by 14
- 2024CoARF: Controllable 3D Artistic Style Transfer for Radiance Fieldscited by 14
- 2021Texture Reformer: Towards Fast and Universal Interactive Texture Transfercited by 12
- 2024Reference-based Controllable Scene Stylization with Gaussian Splattingcited by 12
- 2021DivSwapper: Towards Diversified Patch-based Arbitrary Style Transfercited by 11
- 2022Neural Graphical Modelscited by 11
- 2025Video Color Grading via Look-Up Table Generationcited by 9
- 2021dualFace:Two-Stage Drawing Guidance for Freehand Portrait Sketchingcited by 8
- 2021Deep Translation Prior: Test-time Training for Photorealistic Style Transfercited by 8
- 2022Controllable Style Transfer via Test-time Training of Implicit Neural Representationcited by 8
- 2023Advances in 3D Neural Stylization: A Surveycited by 8
- 2021Rethinking Content and Style: Exploring Bias for Unsupervised Disentanglementcited by 7
- 2021Meta Internal Learningcited by 7
- 2024Creativity in AI: Progresses and Challengescited by 7
- 2025ABC-GS: Alignment-Based Controllable Style Transfer for 3D Gaussian Splattingcited by 7
- 2021DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesiscited by 6
- 2021How Deep Are the Fakes? Focusing on Audio Deepfake: A Surveycited by 6
- 2021A-ESRGAN: Training Real-World Blind Super-Resolution with Attention U-Net Discriminatorscited by 6
- 2023Instruct-Video2Avatar: Video-to-Avatar Generation with Instructionscited by 6
- 2022Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Datacited by 5
- 2022Learning to Incorporate Texture Saliency Adaptive Attention to Image Cartoonizationcited by 5
- 2022Vision-Language Matching for Text-to-Image Synthesis via Generative Adversarial Networkscited by 5
- 2023Disentangling Structure and Appearance in ViT Feature Spacecited by 5
- 2024G-Style: Stylized Gaussian Splattingcited by 5
50 most cited of 102 All 102 (JSON)
- 2026Capacity-Controlled Multi-View Stylization of 3D Gaussian Splatting25 Jun 2026
- 2026Boosting Zero-Shot 3D Style Transfer with 2D Pre-trained Priors28 May 2026
- 2026Image-Guided Geometric Stylization of 3D Meshes9 Apr 2026
- 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfer16 Feb 2026
- 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Loss23 Jan 2026
- 2026FaceRefiner: High-Fidelity Facial Texture Refinement with Differentiable Rendering-based Style Transfer8 Jan 2026
- 2025Video Color Grading via Look-Up Table Generation1 Aug 2025
- 2025GT2-GS: Geometry-aware Texture Transfer for Gaussian Splatting21 May 2025
- 2025ABC-GS: Alignment-Based Controllable Style Transfer for 3D Gaussian Splatting28 Mar 2025
- 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfer27 Feb 2025
- 2025Coarse-to-Fine Structure-Aware Artistic Style Transfer8 Feb 2025
- 2024Style Transfer Dataset: What Makes A Good Stylization?22 Dec 2024
38 more
- 2024Creativity in AI: Progresses and Challenges22 Oct 2024
- 2024WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians26 Sep 2024
- 2024G-Style: Stylized Gaussian Splatting28 Aug 2024
- 2024Generating Automatically Print/Scan Textures for Morphing Attack Detection Applications18 Aug 2024
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion18 Aug 2024
- 2024Reference-based Controllable Scene Stylization with Gaussian Splatting9 Jul 2024
- 2024Multi-style Neural Radiance Field with AdaIN7 Jun 2024
- 2024CoARF: Controllable 3D Artistic Style Transfer for Radiance Fields23 Apr 2024
- 2024Geometry Transfer for Stylizing Radiance Fields1 Feb 2024
- 2024Evaluation in Neural Style Transfer: A Review30 Jan 2024
- 2024Evaluating Data Augmentation Techniques for Coffee Leaf Disease Classification11 Jan 2024
- 2023Domain Similarity-Perceived Label Assignment for Domain Generalized Underwater Object Detection20 Dec 2023
- 2023Painterly Image Harmonization by Learning from Painterly Objects15 Dec 2023
- 2023MuVieCAST: Multi-View Consistent Artistic Style Transfer8 Dec 2023
- 2023Neural Network Characterization and Entropy Regulated Data Balancing through Principal Component Analysis3 Dec 2023
- 2023Advances in 3D Neural Stylization: A Survey30 Nov 2023
- 2023High-Quality Face Caricature via Style Translation22 Nov 2023
- 2023Disentangling Structure and Appearance in ViT Feature Space20 Nov 2023
- 2023ARTEMIS: Using GANs with Multiple Discriminators to Generate Art14 Nov 2023
- 2023Dual Pipeline Style Transfer with Input Distribution Differentiation9 Nov 2023
- 2023Color and Texture Dual Pipeline Lightweight Style Transfer2 Oct 2023
- 2023MOSAIC: Multi-Object Segmented Arbitrary Stylization Using CLIP24 Sep 2023
- 2023Masked Discriminators for Content-Consistent Unpaired Image-to-Image Translation22 Sep 2023
- 2023TSSAT: Two-Stage Statistics-Aware Transformation for Artistic Style Transfer12 Sep 2023
- 2023Generating Modern Persian Carpet Map by Style-transfer8 Aug 2023
- 2023Semi-supervised Cycle-GAN for face photo-sketch translation in the wild18 Jul 2023
- 2023FISTNet: FusIon of STyle-path generative Networks for Facial Style Transfer18 Jul 2023
- 2023Lightweight texture transfer based on texture feature preset29 Jun 2023
- 2023Instruct-Video2Avatar: Video-to-Avatar Generation with Instructions5 Jun 2023
- 2023AlteredAvatar: Stylizing Dynamic 3D Avatars with Fast Style Adaptation30 May 2023
- 2023Instant Photorealistic Neural Radiance Fields Stylization29 Mar 2023
- 2023Neural Preset for Color Style Transfer23 Mar 2023
- 2023Neural Style Transfer for Vector Graphics6 Mar 2023
- 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Models14 Feb 2023
- 2023Mimicking non-ideal instrument behavior for hologram processing using neural style translation7 Jan 2023
- 2022Deep Image Style Transfer from Freeform Text13 Dec 2022
- 2022All-to-key Attention for Arbitrary Style Transfer8 Dec 2022
- 2022Spatial Mixture-of-Experts24 Nov 2022
50 newest of 102 All 102 (JSON)
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
- 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Modelscited by 33
- 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfercited by 32
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusioncited by 4
- 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfercited by 1
- 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Losscited by 0
- 2026CoCoDiff: Correspondence-Consistent Diffusion Model for Fine-grained Style Transfer16 Feb 2026
- 2026Edge-Aware Image Manipulation via Diffusion Models with a Novel Structure-Preservation Loss23 Jan 2026
- 2025Attention Distillation: A Unified Approach to Visual Characteristics Transfer27 Feb 2025
- 2024Unpaired Volumetric Harmonization of Brain MRI with Conditional Latent Diffusion18 Aug 2024
- 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Models14 Feb 2023
- 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidance10 Dec 2021
- 2022Spatial Mixture-of-Expertscited by 14
- 2022Spatial Mixture-of-Experts24 Nov 2022
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2022ARF: Artistic Radiance Fieldscited by 147
- 2021ArtFlow: Unbiased Image Style Transfer via Reversible Neural Flowscited by 113
- 2022Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfercited by 66
- 2021StyleMesh: Style Transfer for Indoor 3D Scene Reconstructionscited by 58
- 2021Drafting and Revision: Laplacian Pyramid Network for Fast High-Quality Artistic Style Transfercited by 41
- 2023Neural Preset for Color Style Transfercited by 36
- 2021Feature-based Style Randomization for Domain Generalizationcited by 34
- 2022NeRFFaceEditing: Disentangled Face Editing in Neural Radiance Fieldscited by 33
- 2022Learning to Generate Realistic Noisy Images via Pixel-level Noise-aware Adversarial Trainingcited by 29
- 2022Learning Graph Neural Networks for Image Style Transfercited by 29
- 2021In the light of feature distributions: moment matching for Neural Style Transfercited by 26
12 most cited of 95 All 95 (JSON)
- 2026Capacity-Controlled Multi-View Stylization of 3D Gaussian Splatting25 Jun 2026
- 2026Boosting Zero-Shot 3D Style Transfer with 2D Pre-trained Priors28 May 2026
- 2026Image-Guided Geometric Stylization of 3D Meshes9 Apr 2026
- 2026FaceRefiner: High-Fidelity Facial Texture Refinement with Differentiable Rendering-based Style Transfer8 Jan 2026
- 2025Video Color Grading via Look-Up Table Generation1 Aug 2025
- 2025GT2-GS: Geometry-aware Texture Transfer for Gaussian Splatting21 May 2025
- 2025ABC-GS: Alignment-Based Controllable Style Transfer for 3D Gaussian Splatting28 Mar 2025
- 2025Coarse-to-Fine Structure-Aware Artistic Style Transfer8 Feb 2025
- 2024Style Transfer Dataset: What Makes A Good Stylization?22 Dec 2024
- 2024Creativity in AI: Progresses and Challenges22 Oct 2024
- 2024WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians26 Sep 2024
- 2024G-Style: Stylized Gaussian Splatting28 Aug 2024
12 newest of 95 All 95 (JSON)