Enhancing Multi-Scale Implicit Learning in Image Super-Resolution with Integrated Positional Encoding
Not on the map. Why?
Abstract (arXiv)
Is the center position fully capable of representing a pixel? There is nothing wrong to represent pixels with their centers in a discrete image representation, but it makes more sense to consider each pixel as the aggregation of signals from a local area in an image super-resolution (SR) context. Despite the great capability of coordinate-based implicit representation in the field of arbitrary-scale image SR, this area's nature of pixels is not fully considered. To this end, we propose integrated positional encoding (IPE), extending traditional positional encoding by aggregating frequency information over the pixel area. We apply IPE to the state-of-the-art arbitrary-scale image super-resolution method: local implicit image function (LIIF), presenting IPE-LIIF. We show the effectiveness of IPE-LIIF by quantitative and qualitative evaluations, and further demonstrate the generalization ability of IPE to larger image scales and multiple implicit-based methods. Code will be released.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 39 of its 53 references that are in the map. First posted on arXiv 10 Dec 2021.
Builds on
39 of 53 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
27 more
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2020Neural Sparse Voxel Fieldscited by 959
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
- 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 452
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2020Deep Unfolding Network for Image Super-Resolutioncited by 253
- 2017MemNet: A Persistent Memory Network for Image Restorationcited by 244
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2018Deep Back-Projection Networks For Super-Resolutioncited by 224
- 2019BSP-Net: Generating Compact Meshes via Binary Space Partitioningcited by 205
- 2019Meta-SR: A Magnification-Arbitrary Network for Super-Resolutioncited by 180
- 2016EnhanceNet: Single Image Super-Resolution Through Automated Texture Synthesiscited by 177
- 2020Structure-Preserving Super Resolution with Gradient Guidancecited by 116
- 2021UltraSR: Spatial Encoding is a Missing Key for Implicit Image Function-based Arbitrary-Scale Super-Resolutioncited by 56
- 2019Progressive Perception-Oriented Network for Single Image Super-Resolutioncited by 7
Built on by
Citing papers per year: 2023: 3; 2024: 5; 2025: 2; 2026: 2.
12 papers.
- 2023Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolutioncited by 51
- 2023Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-Resolutioncited by 34
- 2023Continuous Remote Sensing Image Super-Resolution based on Context Interaction in Implicit Function Spacecited by 17
- 2024CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Datacited by 15
- 2025BF-STVSR: B-Splines and Fourier-Best Friends for High Fidelity Spatial-Temporal Video Super-Resolutioncited by 9
- 2024Local Implicit Wavelet Transformer for Arbitrary-Scale Super-Resolutioncited by 5
- 2025Scale-Invariant Adversarial Attack against Arbitrary-scale Super-resolutioncited by 3
- 2024Test-time Cost-and-Quality Controllable Arbitrary-Scale Super-Resolution with Variable Fourier Componentscited by 1
- 2024Multi-Scale Implicit Transformer with Re-parameterize for Arbitrary-Scale Super-Resolutioncited by 0
- 2024FreqINR: Frequency Consistency for Implicit Neural Representation with Adaptive DCT Frequency Losscited by 0
- 2026Fidelity- and Perception-Aware Local Implicit Attention for Arbitrary-Scale Image Super-Resolutioncited by 0
- 2026Aperture: Merge-Consistent Rotary States for Compressed Tokenscited by 0
- 2026Aperture: Merge-Consistent Rotary States for Compressed Tokens29 Sep 2026
- 2026Fidelity- and Perception-Aware Local Implicit Attention for Arbitrary-Scale Image Super-Resolution20 Jun 2026
- 2025Scale-Invariant Adversarial Attack against Arbitrary-scale Super-resolution6 Mar 2025
- 2025BF-STVSR: B-Splines and Fourier-Best Friends for High Fidelity Spatial-Temporal Video Super-Resolution19 Jan 2025
- 2024Test-time Cost-and-Quality Controllable Arbitrary-Scale Super-Resolution with Variable Fourier Components7 Dec 2024
- 2024Local Implicit Wavelet Transformer for Arbitrary-Scale Super-Resolution10 Nov 2024
- 2024FreqINR: Frequency Consistency for Implicit Neural Representation with Adaptive DCT Frequency Loss25 Aug 2024
- 2024CycleINR: Cycle Implicit Neural Representation for Arbitrary-Scale Volumetric Super-Resolution of Medical Data7 Apr 2024
- 2024Multi-Scale Implicit Transformer with Re-parameterize for Arbitrary-Scale Super-Resolution11 Mar 2024
- 2023Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution29 Mar 2023
- 2023Local Implicit Normalizing Flow for Arbitrary-Scale Image Super-Resolution9 Mar 2023
- 2023Continuous Remote Sensing Image Super-Resolution based on Context Interaction in Implicit Function Space16 Feb 2023