mlsanityData to 14 Oct 2026

VIINTER: View Interpolation with Implicit Neural Representations of Images

arXiv 2211.00722 ↗First posted 1 Nov 2022cs.CV cs.GR cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

We present VIINTER, a method for view interpolation by interpolating the implicit neural representation (INR) of the captured images. We leverage the learned code vector associated with each image and interpolate between these codes to achieve viewpoint transitions. We propose several techniques that significantly enhance the interpolation quality. VIINTER signifies a new way to achieve view interpolation without constructing 3D structure, estimating camera poses, or computing pixel correspondence. We validate the effectiveness of VIINTER on several multi-view scenes with different types of camera layout and scene composition. As the development of INR of images (as opposed to surface or volume) has centered around tasks like image fitting and super-resolution, with VIINTER, we show its capability for view interpolation and offer a promising outlook on using INR for image manipulation tasks.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 33 of its 58 references that are in the map. First posted on arXiv 1 Nov 2022.

Builds on

33 of 58 references.

References · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  4. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  5. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  8. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  9. 2020Neural Sparse Voxel Fieldscited by 959
  10. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  11. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 703
  12. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
21 more
  1. 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
  2. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
  3. 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
  4. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  5. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
  6. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
  7. 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
  8. 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 242
  9. 2020Free View Synthesiscited by 231
  10. 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
  11. 2022FILM: Frame Interpolation for Large Motioncited by 153
  12. 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
  13. 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
  14. 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
  15. 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 100
  16. 2020Deep Reflectance Volumes: Relightable Reconstructions from Multi-View Photometric Imagescited by 98
  17. 2021ACORN: Adaptive Coordinate Networks for Neural Scene Representationcited by 65
  18. 2020X-Fields: Implicit Neural View-, Light- and Time-Image Interpolationcited by 31
  19. 2021Fast Training of Neural Lumigraph Representations using Meta Learningcited by 29
  20. 2022MINER: Multiscale Implicit Neural Representationscited by 20
  21. 2022PRIF: Primary Ray-based Implicit Functioncited by 17

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 2.

5 papers.

  1. 2024VividDream: Generating 3D Scene with Ambient Dynamicscited by 21
  2. 2024DRAGON: Drone and Ground Gaussian Splatting for 3D Building Reconstructioncited by 10
  3. 20233D Motion Magnification: Visualizing Subtle Motions with Time Varying Radiance Fieldscited by 7
  4. 2023Continuous Levels of Detail for Light Field Networkscited by 1
  5. 2023ConVRT: Consistent Video Restoration Through Turbulence with Test-time Optimization of Neural Video Representationscited by 0