Controllable Style Transfer via Test-time Training of Implicit Neural Representation
Not on the map. Why?
Abstract (arXiv)
We propose a controllable style transfer framework based on Implicit Neural Representation that pixel-wisely controls the stylized output via test-time training. Unlike traditional image optimization methods that often suffer from unstable convergence and learning-based methods that require intensive training and have limited generalization ability, we present a model optimization framework that optimizes the neural networks during test-time with explicit loss functions for style transfer. After being test-time trained once, thanks to the flexibility of the INR-based model, our framework can precisely control the stylized images in a pixel-wise manner and freely adjust image resolution without further optimization or training. We demonstrate several applications.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 40 of its 62 references that are in the map. First posted on arXiv 14 Oct 2022.
Builds on
40 of 62 references.
References · 40
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Convolutional Occupancy Networkscited by 761
28 more
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
- 2020Local Implicit Grid Representations for 3D Scenescited by 373
- 2017Universal Style Transfer via Feature Transformscited by 354
- 2016A Learned Representation For Artistic Stylecited by 341
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
- 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
- 2018Arbitrary Style Transfer with Style-Attentional Networkscited by 198
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 174
- 2019Style Transfer by Relaxed Optimal Transport and Self-Similaritycited by 168
- 2017Demystifying Neural Style Transfercited by 152
- 2018The Contextual Loss for Image Transformation with Non-Aligned Datacited by 135
- 2020Adversarial Generation of Continuous Imagescited by 135
- 2018A Closed-form Solution to Photorealistic Image Stylizationcited by 133
- 2016Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesiscited by 102
- 2016Controlling Perceptual Factors in Neural Style Transfercited by 100
- 2022Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learningcited by 93
- 2016Fast Patch-based Style Transfer of Arbitrary Stylecited by 92
- 2018Arbitrary Style Transfer with Deep Feature Reshufflecited by 75
- 2017Stable and Controllable Neural Texture Synthesis and Style Transfer Using Histogram Lossescited by 69
- 2017Diversified Texture Synthesis with Feed-forward Networkscited by 59
- 2021Towards Ultra-Resolution Neural Style Transfer via Thumbnail Instance Normalizationcited by 15
- 2021SinIR: Efficient General Image Manipulation with Single Image Reconstructioncited by 13
- 2021Deep Translation Prior: Test-time Training for Photorealistic Style Transfercited by 8
- 2018Uncorrelated Feature Encoding for Faster Image Style Transfercited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 2; 2026: 2.
8 papers.
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shiftscited by 359
- 2024FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Modelscited by 22
- 2024CoARF: Controllable 3D Artistic Style Transfer for Radiance Fieldscited by 14
- 2025Advances in Artificial Intelligence: A Review for the Creative Industriescited by 2
- 2025Bias for Action: Video Implicit Neural Representations with Bias Modulationcited by 2
- 2024Selective Test-Time Adaptation for Unsupervised Anomaly Detection using Neural Implicit Representationscited by 1
- 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfercited by 0
- 2026Coarse-to-fine Framework for Generative MEF via Implicit Neural Representationcited by 0
- 2026Coarse-to-fine Framework for Generative MEF via Implicit Neural Representation20 Jul 2026
- 2026MAST: Mask-Guided Attention Control for Training-Free Regional-Multi Style Transfer14 Apr 2026
- 2025Bias for Action: Video Implicit Neural Representations with Bias Modulation16 Jan 2025
- 2025Advances in Artificial Intelligence: A Review for the Creative Industries6 Jan 2025
- 2024Selective Test-Time Adaptation for Unsupervised Anomaly Detection using Neural Implicit Representations4 Oct 2024
- 2024CoARF: Controllable 3D Artistic Style Transfer for Radiance Fields23 Apr 2024
- 2024FreeStyle: Free Lunch for Text-guided Style Transfer using Diffusion Models28 Jan 2024
- 2023A Comprehensive Survey on Test-Time Adaptation under Distribution Shifts27 Mar 2023