mlsanityData to 7 Oct 2026

Learning Local Implicit Fourier Representation for Image Warping

arXiv 2207.01831 ↗First posted 5 Jul 2022cs.CVcited by 14

Not on the map. Why?

Abstract (arXiv)

Image warping aims to reshape images defined on rectangular grids into arbitrary shapes. Recently, implicit neural functions have shown remarkable performances in representing images in a continuous manner. However, a standalone multi-layer perceptron suffers from learning high-frequency Fourier coefficients. In this paper, we propose a local texture estimator for image warping (LTEW) followed by an implicit neural representation to deform images into continuous shapes. Local textures estimated from a deep super-resolution (SR) backbone are multiplied by locally-varying Jacobian matrices of a coordinate transformation to predict Fourier responses of a warped image. Our LTEW-based neural function outperforms existing warping methods for asymmetric-scale SR and homography transform. Furthermore, our algorithm well generalizes arbitrary coordinate transformations, such as homography transform with a large magnification factor and equirectangular projection (ERP) perspective transform, which are not provided in training.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 39 of its 60 references that are in the map. First posted on arXiv 5 Jul 2022.

Builds on

39 of 60 references.

References · 39

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  7. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  8. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  9. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  10. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  11. 2015Spatial Transformer Networkscited by 1,423
  12. 2018On the Spectral Bias of Neural Networkscited by 1,321
27 more
  1. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  2. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  3. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  4. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 966
  5. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  6. 2020Pre-Trained Image Processing Transformercited by 891
  7. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  8. 2018Residual Dense Network for Image Super-Resolutioncited by 796
  9. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
  10. 2020Local Implicit Grid Representations for 3D Scenescited by 372
  11. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 303
  12. 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
  13. 2021NeRV: Neural Representations for Videoscited by 255
  14. 2020How Neural Networks Extrapolate: From Feedforward to Graph Neural Networkscited by 218
  15. 2021COTR: Correspondence Transformer for Matching Across Imagescited by 182
  16. 2019Meta-SR: A Magnification-Arbitrary Network for Super-Resolutioncited by 180
  17. 2018Frame-Recurrent Video Super-Resolutioncited by 160
  18. 2021Local Texture Estimator for Implicit Representation Functioncited by 126
  19. 2018Learning to Navigate in Cities Without a Mapcited by 103
  20. 2020Learning A Single Network for Scale-Arbitrary Super-Resolutioncited by 65
  21. 2021Seeing Implicit Neural Representations as Fourier Seriescited by 50
  22. 2021Implicit Transformer Network for Screen Content Image Continuous Super-Resolutioncited by 46
  23. 2018SpherePHD: Applying CNNs on a Spherical PolyHeDron Representation of 360 degree Imagescited by 40
  24. 2019Learning To Follow Directions in Street Viewcited by 29
  25. 2021SRWarp: Generalized Image Super-Resolution under Arbitrary Transformationcited by 26
  26. 2021Spline Positional Encoding for Learning 3D Implicit Signed Distance Fieldscited by 21
  27. 2019Cross-View Policy Learning for Street Navigationcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 5; 2025: 4; 2026: 1.

14 papers.

Sort:

By area:

  1. 2023Implicit Neural Representation for Cooperative Low-light Image Enhancementcited by 92
  2. 2024Learning A Physical-aware Diffusion Model Based on Transformer for Underwater Image Enhancementcited by 24
  3. 2024Fast Context-Based Low-Light Image Enhancement via Neural Implicit Representationscited by 21
  4. 2025BF-STVSR: B-Splines and Fourier-Best Friends for High Fidelity Spatial-Temporal Video Super-Resolutioncited by 9
  5. 2023OmniZoomer: Learning to Move and Zoom in on Sphere at High-Resolutioncited by 7
  6. 2024JDEC: JPEG Decoding via Enhanced Continuous Cosine Coefficientscited by 7
  7. 2023Scene Matters: Model-based Deep Video Compressioncited by 6
  8. 2024ResVR: Joint Rescaling and Viewport Rendering of Omnidirectional Imagescited by 6
  9. 2025Towards Lossless Implicit Neural Representation via Bit Plane Decompositioncited by 5
  10. 2023Implicit Neural Image Stitchingcited by 4
  11. 2024LeRF: Learning Resampling Function for Adaptive and Efficient Image Interpolationcited by 1
  12. 2025Unwarping Screen Content Images via Structure-texture Enhancement Network and Transformation Self-estimationcited by 0
2 more
  1. 2025JPEG Processing Neural Operator for Backward-Compatible Codingcited by 0
  2. 2026D2R2OSR: Degradation-Disentangled Representation for Real-World Omnidirectional Image Super-Resolutioncited by 0