Deep Network Interpolation for Continuous Imagery Effect Transition
Not on the map. Why?
Abstract (arXiv)
Deep convolutional neural network has demonstrated its capability of learning a deterministic mapping for the desired imagery effect. However, the large variety of user flavors motivates the possibility of continuous transition among different output effects. Unlike existing methods that require a specific design to achieve one particular transition (e.g., style transfer), we propose a simple yet universal approach to attain a smooth control of diverse imagery effects in many low-level vision tasks, including image restoration, image-to-image translation, and style transfer. Specifically, our method, namely Deep Network Interpolation (DNI), applies linear interpolation in the parameter space of two or more correlated networks. A smooth control of imagery effects can be achieved by tweaking the interpolation coefficients. In addition to DNI and its broad applications, we also investigate the mechanism of network interpolation from the perspective of learned filters.
Key facts. Cited by 47 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 12; 2023: 6; 2024: 6; 2025: 6; 2026: 1.
47 papers.
Sort:
By area:
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 97
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
- 2021A Theory of the Distortion-Perception Tradeoff in Wasserstein Spacecited by 52
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2022MM-RealSR: Metric Learning based Interactive Modulation for Real-World Super-Resolutioncited by 33
- 2021CoMoGAN: continuous model-guided image-to-image translationcited by 27
- 2021Finding Discriminative Filters for Specific Degradations in Blind Super-Resolutioncited by 26
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 25
- 2021A Comprehensive Review of Deep Learning-based Single Image Super-resolutioncited by 23
- 2022Perception-Oriented Single Image Super-Resolution using Optimal Objective Estimationcited by 21
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositingcited by 19
35 more
- 2021Toward Interactive Modulation for Photo-Realistic Image Restorationcited by 15
- 2021Very Lightweight Photo Retouching Network with Conditional Sequential Modulationcited by 14
- 2023EGIC: Enhanced Low-Bit-Rate Generative Image Compression Guided by Semantic Segmentationcited by 14
- 2022Learning Mutual Modulation for Self-Supervised Cross-Modal Super-Resolutioncited by 11
- 2023Perception-Distortion Balanced Super-Resolution: A Multi-Objective Optimization Perspectivecited by 11
- 2021Deep Neural Network-based Enhancement for Image and Video Streaming Systems: A Survey and Future Directionscited by 9
- 2021Functional Neural Networks for Parametric Image Restoration Problemscited by 9
- 2022Flexible Style Image Super-Resolution using Conditional Objectivecited by 9
- 2023Real-time Controllable Denoising for Image and Videocited by 9
- 2022Hypernetwork-Based Adaptive Image Restorationcited by 8
- 2021ManiFest: Manifold Deformation for Few-shot Image Translationcited by 6
- 2021Transitional Learning: Exploring the Transition States of Degradation for Blind Super-resolutioncited by 4
- 2023Tunable Convolutions with Parametric Multi-Loss Optimizationcited by 4
- 2023Improving Out-of-Distribution Robustness of Classifiers via Generative Interpolationcited by 4
- 2025YOND: Practical Blind Raw Image Denoising Free from Camera-Specific Data Dependencycited by 4
- 2025LAMP: Data-Efficient Linear Affine Weight-Space Models for Parameter-Controlled 3D Shape Generation and Extrapolationcited by 4
- 2021Statistical inference for generative adversarial networks and other minimax problemscited by 3
- 2022Adaptive Network Combination for Single-Image Reflection Removal: A Domain Generalization Perspectivecited by 3
- 2022Polymorphic-GAN: Generating Aligned Samples across Multiple Domains with Learned Morph Mapscited by 3
- 2024Perceptual-Distortion Balanced Image Super-Resolution is a Multi-Objective Optimization Problemcited by 3
- 2021Test-Time Adaptation for Super-Resolution: You Only Need to Overfit on a Few More Imagescited by 2
- 2022Beyond a Video Frame Interpolator: A Space Decoupled Learning Approach to Continuous Image Transitioncited by 2
- 2022Contrastive Monotonic Pixel-Level Modulationcited by 2
- 2025A Complete Loss Landscape Analysis of Regularized Deep Matrix Factorizationcited by 2
- 2021Leveraging Local Domains for Image-to-Image Translationcited by 1
- 2022A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restorationcited by 1
- 2024Generative Quanta Color Imagingcited by 1
- 2024QueryCDR: Query-Based Controllable Distortion Rectification Network for Fisheye Imagescited by 1
- 2025TimeNeRF: Building Generalizable Neural Radiance Fields across Time from Few-Shot Input Viewscited by 1
- 2025Deep Parameter Interpolation for Scalar Conditioningcited by 1
- 2022Controllable Image Enhancementcited by 0
- 2022Single MR Image Super-Resolution using Generative Adversarial Networkcited by 0
- 2023Deep Conditional Measure Quantizationcited by 0
- 2024RoNet: Rotation-oriented Continuous Image Translationcited by 0
- 2026AlloSR2: Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flowscited by 0
- 2026AlloSR2: Rectifying One-Step Super-Resolution to Stay Real via Allomorphic Generative Flows21 Apr 2026
- 2025Deep Parameter Interpolation for Scalar Conditioning26 Nov 2025
- 2025LAMP: Data-Efficient Linear Affine Weight-Space Models for Parameter-Controlled 3D Shape Generation and Extrapolation26 Oct 2025
- 2025TimeNeRF: Building Generalizable Neural Radiance Fields across Time from Few-Shot Input Views18 Jul 2025
- 2025A Complete Loss Landscape Analysis of Regularized Deep Matrix Factorization25 Jun 2025
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignment9 Jun 2025
- 2025YOND: Practical Blind Raw Image Denoising Free from Camera-Specific Data Dependency4 Jun 2025
- 2024QueryCDR: Query-Based Controllable Distortion Rectification Network for Fisheye Images18 Dec 2024
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach4 Dec 2024
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositing6 Sep 2024
- 2024Perceptual-Distortion Balanced Image Super-Resolution is a Multi-Objective Optimization Problem5 Sep 2024
- 2024RoNet: Rotation-oriented Continuous Image Translation6 Apr 2024
35 more
- 2024Generative Quanta Color Imaging28 Mar 2024
- 2023Perception-Distortion Balanced Super-Resolution: A Multi-Objective Optimization Perspective24 Dec 2023
- 2023EGIC: Enhanced Low-Bit-Rate Generative Image Compression Guided by Semantic Segmentation6 Sep 2023
- 2023Improving Out-of-Distribution Robustness of Classifiers via Generative Interpolation23 Jul 2023
- 2023Tunable Convolutions with Parametric Multi-Loss Optimization3 Apr 2023
- 2023Real-time Controllable Denoising for Image and Video29 Mar 2023
- 2023Deep Conditional Measure Quantization17 Jan 2023
- 2022Perception-Oriented Single Image Super-Resolution using Optimal Objective Estimation24 Nov 2022
- 2022Contrastive Monotonic Pixel-Level Modulation23 Jul 2022
- 2022A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restoration21 Jul 2022
- 2022Learning Mutual Modulation for Self-Supervised Cross-Modal Super-Resolution19 Jul 2022
- 2022Single MR Image Super-Resolution using Generative Adversarial Network16 Jul 2022
- 2022Controllable Image Enhancement16 Jun 2022
- 2022Hypernetwork-Based Adaptive Image Restoration13 Jun 2022
- 2022Polymorphic-GAN: Generating Aligned Samples across Multiple Domains with Learned Morph Maps6 Jun 2022
- 2022MM-RealSR: Metric Learning based Interactive Modulation for Real-World Super-Resolution10 May 2022
- 2022Adaptive Network Combination for Single-Image Reflection Removal: A Domain Generalization Perspective4 Apr 2022
- 2022Beyond a Video Frame Interpolator: A Space Decoupled Learning Approach to Continuous Image Transition18 Mar 2022
- 2022Flexible Style Image Super-Resolution using Conditional Objective13 Jan 2022
- 2021ManiFest: Manifold Deformation for Few-shot Image Translation26 Nov 2021
- 2021Functional Neural Networks for Parametric Image Restoration Problems30 Oct 2021
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Models21 Oct 2021
- 2021Leveraging Local Domains for Image-to-Image Translation9 Sep 2021
- 2021Finding Discriminative Filters for Specific Degradations in Blind Super-Resolution2 Aug 2021
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators2 Aug 2021
- 2021A Theory of the Distortion-Perception Tradeoff in Wasserstein Space6 Jul 2021
- 2021Deep Neural Network-based Enhancement for Image and Video Streaming Systems: A Survey and Future Directions7 Jun 2021
- 2021Toward Interactive Modulation for Photo-Realistic Image Restoration7 May 2021
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolution21 Apr 2021
- 2021Statistical inference for generative adversarial networks and other minimax problems21 Apr 2021
- 2021Very Lightweight Photo Retouching Network with Conditional Sequential Modulation13 Apr 2021
- 2021Test-Time Adaptation for Super-Resolution: You Only Need to Overfit on a Few More Images6 Apr 2021
- 2021Transitional Learning: Exploring the Transition States of Degradation for Blind Super-resolution29 Mar 2021
- 2021CoMoGAN: continuous model-guided image-to-image translation11 Mar 2021
- 2021A Comprehensive Review of Deep Learning-based Single Image Super-resolution18 Feb 2021
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
- 2021A Theory of the Distortion-Perception Tradeoff in Wasserstein Spacecited by 52
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2022MM-RealSR: Metric Learning based Interactive Modulation for Real-World Super-Resolutioncited by 33
- 2021CoMoGAN: continuous model-guided image-to-image translationcited by 27
- 2021Finding Discriminative Filters for Specific Degradations in Blind Super-Resolutioncited by 26
- 2021A Comprehensive Review of Deep Learning-based Single Image Super-resolutioncited by 23
- 2022Perception-Oriented Single Image Super-Resolution using Optimal Objective Estimationcited by 21
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositingcited by 19
- 2021Toward Interactive Modulation for Photo-Realistic Image Restorationcited by 15
- 2021Very Lightweight Photo Retouching Network with Conditional Sequential Modulationcited by 14
12 most cited of 43 All 43 (JSON)
- 2025LAMP: Data-Efficient Linear Affine Weight-Space Models for Parameter-Controlled 3D Shape Generation and Extrapolation26 Oct 2025
- 2025TimeNeRF: Building Generalizable Neural Radiance Fields across Time from Few-Shot Input Views18 Jul 2025
- 2025A Complete Loss Landscape Analysis of Regularized Deep Matrix Factorization25 Jun 2025
- 2025YOND: Practical Blind Raw Image Denoising Free from Camera-Specific Data Dependency4 Jun 2025
- 2024QueryCDR: Query-Based Controllable Distortion Rectification Network for Fisheye Images18 Dec 2024
- 2024Thinking Outside the BBox: Unconstrained Generative Object Compositing6 Sep 2024
- 2024Perceptual-Distortion Balanced Image Super-Resolution is a Multi-Objective Optimization Problem5 Sep 2024
- 2024RoNet: Rotation-oriented Continuous Image Translation6 Apr 2024
- 2024Generative Quanta Color Imaging28 Mar 2024
- 2023Perception-Distortion Balanced Super-Resolution: A Multi-Objective Optimization Perspective24 Dec 2023
- 2023EGIC: Enhanced Low-Bit-Rate Generative Image Compression Guided by Semantic Segmentation6 Sep 2023
- 2023Improving Out-of-Distribution Robustness of Classifiers via Generative Interpolation23 Jul 2023
12 newest of 43 All 43 (JSON)