Learning Continuous Image Representation with Local Implicit Image Function
Not on the map. Why?
Cited by 49 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
How to represent an image? While the visual world is presented in a continuous manner, machines store and see the images in a discrete way with 2D arrays of pixels. In this paper, we seek to learn a continuous representation for images. Inspired by the recent progress in 3D reconstruction with implicit neural representation, we propose Local Implicit Image Function (LIIF), which takes an image coordinate and the 2D deep features around the coordinate as inputs, predicts the RGB value at a given coordinate as an output. Since the coordinates are continuous, LIIF can be presented in arbitrary resolution. To generate the continuous representation for images, we train an encoder with LIIF representation via a self-supervised task with super-resolution. The learned continuous representation can be presented in arbitrary resolution even extrapolate to x30 higher resolution, where the training tasks are not provided. We further show that LIIF representation builds a bridge between discrete and continuous representation in 2D, it naturally supports the learning tasks with size-varied image ground-truths and significantly outperforms the method with resizing the ground-truths.
Key facts. Cited by 552 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 48; 2022: 77; 2023: 113; 2024: 120; 2025: 113; 2026: 81.
552 papers.
Sort:
By area:
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
- 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 218
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 209
- 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
38 more
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restorationcited by 165
- 2021Implicit Neural Representations for Image Compressioncited by 162
- 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2021Layered Neural Atlases for Consistent Video Editingcited by 137
- 2021Local Texture Estimator for Implicit Representation Functioncited by 127
- 2022NeuRIS: Neural Reconstruction of Indoor Scenes Using Normal Priorscited by 125
- 2022Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generationcited by 119
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 116
- 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2021A Structured Dictionary Perspective on Implicit Neural Representationscited by 100
- 2023GNFactor: Multi-Task Real Robot Learning with Generalizable Neural Feature Fieldscited by 99
- 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 99
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
- 2023Implicit Neural Representation for Cooperative Low-light Image Enhancementcited by 92
- 2021Generative Models as Distributions of Functionscited by 89
- 2022ReLU Fields: The Little Non-linearity That Couldcited by 87
- 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
- 2023Score-based Diffusion Models in Function Spacecited by 82
- 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
- 2022E-NeRV: Expedite Neural Video Representation with Disentangled Spatial-Temporal Contextcited by 76
- 2022GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifoldscited by 73
- 2022Any-resolution Training for High-resolution Image Synthesiscited by 72
- 2023HiNeRV: Video Compression with Hierarchical Encoding-based Neural Representationcited by 71
- 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
- 2022CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolutioncited by 70
- 2022Unified Implicit Neural Stylizationcited by 67
- 2023How Deep Learning Sees the World: A Survey on Adversarial Attacks & Defensescited by 66
- 2021ACORN: Adaptive Coordinate Networks for Neural Scene Representationcited by 65
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functionscited by 65
- 2023AntifakePrompt: Prompt-Tuned Vision-Language Models are Fake Image Detectorscited by 64
- 2021CAPRI-Net: Learning Compact CAD Shapes with Adaptive Primitive Assemblycited by 62
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
- 2021Geometry-Consistent Neural Shape Representation with Implicit Displacement Fieldscited by 60
- 2021On the Frequency Bias of Generative Modelscited by 60
- 2022Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fieldscited by 58
50 most cited of 552 All 552 (JSON)
- 2026Any-scale Object Detection using Arbitrary-scaled Images3 Oct 2026
- 2026Scale-Recursive Rectified Flows for Few-Step Precipitation Ensembles2 Oct 2026
- 2026WARP: A Unified Benchmark for Invisible Image Watermarking -- Robustness and Protection Against Attacks30 Sep 2026
- 2026Super-Resolving Unseen Hyperspectral Sensors at Any Scale via Spatial Operators30 Sep 2026
- 2026Function-Space Transformer with Adaptive Anchors29 Sep 2026
- 2026Atelier: Learning Local Self-Supervised Features for CryoEM Volumes via Hypernetworks24 Sep 2026
- 2026Efficient Continuous DEM Reconstruction under Limited Target-Resolution Supervision24 Sep 2026
- 2026ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding24 Sep 2026
- 2026Directional Total Variation-Regularized Implicit Neural Representations (DTV-INR) for Continuous Super-Resolution in Degraded Imaging Domains21 Sep 2026
- 2026Direct Topology Tracking in Continuous Implicit Models10 Sep 2026
- 2026OracleZoom: On-Policy Self-Distillation Inspired Reference-Constrained Recursive Image Super Resolution6 Sep 2026
- 2026Prior-Guided Implicit Neural Representations for Single-Subject Diffusion MRI Super-Resolution1 Sep 2026
38 more
- 2026Tissue-Mixture Entropy-Weighted Reconstruction for Partial-Volume-Aware Brain MRI Super-Resolution27 Aug 2026
- 2026Supervising the Path to Fine Scales: GalerkinFlow for Scientific-Field and Image Super-Resolution17 Aug 2026
- 2026CoANeRV: Coordinate-Aware Token-Space Neural Video Representation14 Aug 2026
- 2026CoQui: A Coordinate-Conditioned Quantum Implicit Generative Adversarial Network for End-to-End Image Generation12 Aug 2026
- 2026Inductive Graph Layout with Implicit Neural Fields9 Aug 2026
- 2026Towards Adaptive Super-Resolution and Quality Assessment via Test-Time Adaptation9 Aug 2026
- 2026SLED: Scalable Location Encoding via Distillation6 Aug 2026
- 2026Morphology-Aware Implicit Super-Resolution Network for Pathological Images4 Aug 2026
- 2026InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis3 Aug 2026
- 2026PixelSR: Efficient Screen Content Super-Resolution via Pixel Classification1 Aug 2026
- 2026Collaborative Feature Aggregation for Face Super-Resolution and Robust Re-Identification30 Jul 2026
- 2026Recurrent Sinusoidal INRs for Efficient High-Fidelity Representation23 Jul 2026
- 2026Coarse-to-fine Framework for Generative MEF via Implicit Neural Representation20 Jul 2026
- 2026DRIFT: Difficulty-aware Rectified Flows for Through-plane MRI Super-Resolution18 Jul 2026
- 2026OmniStyle-INR: Universal and Multimodal Style Transfer for INRs17 Jul 2026
- 2026PhyMRI-SR: Toward Physics-Aware MRI Image Super-Resolution7 Jul 2026
- 2026Geometric Causal Models6 Jul 2026
- 2026AVSR-Diff: Scale-Agnostic Diffusion Priors for Temporally Consistent Arbitrary-Scale Video Super-Resolution1 Jul 2026
- 2026Towards Voxel Spacing Consistency for Medical Image Segmentation30 Jun 2026
- 2026Resonant Brane Splatting for Arbitrary-Scale Super-Resolution28 Jun 2026
- 2026Adaptive Densification for High-Fidelity and Efficient Sparse Gaussian Splatting in Arbitrary-Scale Super-Resolution28 Jun 2026
- 2026D2R2OSR: Degradation-Disentangled Representation for Real-World Omnidirectional Image Super-Resolution28 Jun 2026
- 2026Dual-Prior Guided Null-Space Learning with Mixture-of-Splines for Arbitrary Medical Slice Super-Resolution25 Jun 2026
- 2026Fidelity- and Perception-Aware Local Implicit Attention for Arbitrary-Scale Image Super-Resolution20 Jun 2026
- 2026GB-LSR: Local Spectral Decoding with a Learned Global Bandwidth for Arbitrary-Scale Super-Resolution17 Jun 2026
- 2026GSPan: A Continuous Gaussian Primitive Representation for Arbitrary-Scale Pansharpening16 Jun 2026
- 2026CRIS: Cross-Plane Self-Supervised Isotropic Restoration for Anisotropic Volumetric Imaging Across Modalities14 Jun 2026
- 2026ViT-Up: Faithful Feature Upsampling for Vision Transformers12 Jun 2026
- 2026Frequency Decoupled Framework for Screen Content Image Super-Resolution8 Jun 2026
- 2026Neural Field Tokenizations with Hierarchy and Spatial Locality Priors6 Jun 2026
- 2026SRT: Super-Resolution for Time Series via Disentangled Rectified Flow29 May 2026
- 2026Flow-based Gaussian Splatting for Continuous-Scale Remote Sensing Image Super-Resolution21 May 2026
- 2026AIR: Amortized Image Reconstruction Framework for Self-Supervised Feed-Forward 2D Gaussian Splatting20 May 2026
- 2026RaPD: Resolution-Agnostic Pixel Diffusion via Semantics-Enriched Implicit Representations15 May 2026
- 2026Generative Motion In-betweening by Diffusion over Continuous Implicit Representations12 May 2026
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Model12 May 2026
- 2026PolarVSR: A Unified Framework and Benchmark for Continuous Space-Time Polarization Video Reconstruction11 May 2026
- 2026WindINR: Latent-State INR for Fast Local Wind Query and Correction in Complex Terrain10 May 2026
50 newest of 552 All 552 (JSON)
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 218
- 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restorationcited by 165
- 2023Score-based Diffusion Models in Function Spacecited by 82
- 2023Training-free Diffusion Model Adaptation for Variable-Sized Text-to-Image Synthesiscited by 56
- 2024Attacks and Defenses for Generative Diffusion Models: A Comprehensive Surveycited by 32
- 2024Learning A Physical-aware Diffusion Model Based on Transformer for Underwater Image Enhancementcited by 25
- 2024Arbitrary-Scale Image Generation and Upsampling using Latent Diffusion Model and Implicit Neural Decodercited by 25
- 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Modelscited by 25
- 2023Generated Distributions Are All You Need for Membership Inference Attacks Against Generative Modelscited by 22
- 2023Enhancing Perceptual Quality in Video Super-Resolution through Temporally-Consistent Detail Synthesis using Diffusion Modelscited by 18
- 2024NIVeL: Neural Implicit Vector Layers for Text-to-Vector Generationcited by 17
12 most cited of 48 All 48 (JSON)
- 2026Scale-Recursive Rectified Flows for Few-Step Precipitation Ensembles2 Oct 2026
- 2026DRIFT: Difficulty-aware Rectified Flows for Through-plane MRI Super-Resolution18 Jul 2026
- 2026AVSR-Diff: Scale-Agnostic Diffusion Priors for Temporally Consistent Arbitrary-Scale Video Super-Resolution1 Jul 2026
- 2026SRT: Super-Resolution for Time Series via Disentangled Rectified Flow29 May 2026
- 2026Flow-based Gaussian Splatting for Continuous-Scale Remote Sensing Image Super-Resolution21 May 2026
- 2026Generative Motion In-betweening by Diffusion over Continuous Implicit Representations12 May 2026
- 2026LUVE : Latent-Cascaded Ultra-High-Resolution Video Generation with Dual Frequency Experts12 Feb 2026
- 2026Continuous Degradation Modeling via Latent Flow Matching for Real-World Super-Resolution4 Feb 2026
- 2025OmniScaleSR: Unleashing Scale-Controlled Diffusion Prior for Faithful and Realistic Arbitrary-Scale Image Super-Resolution4 Dec 2025
- 2025One Small Step in Latent, One Giant Leap for Pixels: Fast Latent Upscale Adapter for Your Diffusion Models13 Nov 2025
- 2025Diffusion Transformer meets Multi-level Wavelet Spectrum for Single Image Super-Resolution3 Nov 2025
- 2025NeRV-Diffusion: Diffuse Implicit Neural Representations for Video Synthesis29 Sep 2025
12 newest of 48 All 48 (JSON)
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2023Tri-Perspective View for Vision-Based 3D Semantic Occupancy Predictioncited by 409
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 308
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 209
- 2022Generating Videos with Dynamics-aware Implicit Generative Adversarial Networkscited by 186
- 2021Implicit Neural Representations for Image Compressioncited by 162
- 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
12 most cited of 497 All 497 (JSON)
- 2026Any-scale Object Detection using Arbitrary-scaled Images3 Oct 2026
- 2026WARP: A Unified Benchmark for Invisible Image Watermarking -- Robustness and Protection Against Attacks30 Sep 2026
- 2026Super-Resolving Unseen Hyperspectral Sensors at Any Scale via Spatial Operators30 Sep 2026
- 2026Function-Space Transformer with Adaptive Anchors29 Sep 2026
- 2026Atelier: Learning Local Self-Supervised Features for CryoEM Volumes via Hypernetworks24 Sep 2026
- 2026Efficient Continuous DEM Reconstruction under Limited Target-Resolution Supervision24 Sep 2026
- 2026ImCorr: Sub-pixel Semantic Correspondence via Implicit Feature Decoding24 Sep 2026
- 2026Directional Total Variation-Regularized Implicit Neural Representations (DTV-INR) for Continuous Super-Resolution in Degraded Imaging Domains21 Sep 2026
- 2026Direct Topology Tracking in Continuous Implicit Models10 Sep 2026
- 2026Prior-Guided Implicit Neural Representations for Single-Subject Diffusion MRI Super-Resolution1 Sep 2026
- 2026Tissue-Mixture Entropy-Weighted Reconstruction for Partial-Volume-Aware Brain MRI Super-Resolution27 Aug 2026
- 2026Supervising the Path to Fine Scales: GalerkinFlow for Scientific-Field and Image Super-Resolution17 Aug 2026
12 newest of 497 All 497 (JSON)