Eikonal Fields for Refractive Novel-View Synthesis
Not on the map. Why?
Abstract (arXiv)
We tackle the problem of generating novel-view images from collections of 2D images showing refractive and reflective objects. Current solutions assume opaque or transparent light transport along straight paths following the emission-absorption model. Instead, we optimize for a field of 3D-varying Index of Refraction (IoR) and trace light through it that bends toward the spatial gradients of said IoR according to the laws of eikonal light transport.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 25 of its 67 references that are in the map. First posted on arXiv 2 Feb 2022.
Builds on
25 of 67 references.
References · 25
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 446
- 2021Advances in Neural Renderingcited by 365
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
- 2020State of the Art on Neural Renderingcited by 276
- 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
- 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
- 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
13 more
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
- 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 121
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2020EikoNet: Solving the Eikonal equation with Deep Neural Networkscited by 50
- 2021Learning Neural Light Fields with Ray-Space Embedding Networkscited by 49
- 2020Through the Looking Glass: Neural 3D Reconstruction of Transparent Shapescited by 32
- 2020X-Fields: Implicit Neural View-, Light- and Time-Image Interpolationcited by 31
- 2018Full 3D Reconstruction of Transparent Objectscited by 24
- 2020Differentiable Refraction-Tracing for Mesh Reconstruction of Transparent Objectscited by 23
- 2020TRANSPR: Transparency Ray-Accumulating Neural 3D Scene Point Renderercited by 9
- 2021MirrorNeRF: One-shot Neural Portrait Radiance Field from Multi-mirror Catadioptric Imagingcited by 9
- 2020Computing Light Transport Gradients using the Adjoint Methodcited by 4
- 2019Learning Transparent Object Mattingcited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 11; 2024: 10; 2025: 2; 2026: 5.
30 papers.
Sort:
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2024Ref-GS: Directional Factorization for 2D Gaussian Splattingcited by 27
- 2024Rip-NeRF: Anti-aliasing Radiance Fields with Ripmap-Encoded Platonic Solidscited by 23
- 2023NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fieldscited by 16
- 2025TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussianscited by 16
- 2023NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objectscited by 14
- 2023OmnimatteRF: Robust Omnimatte with 3D Background Modelingcited by 14
- 2024Generative Multiview Relighting for 3D Reconstruction under Extreme Illumination Variationcited by 13
- 2023SpectralNeRF: Physically Based Spectral Rendering with Neural Radiance Fieldcited by 12
- 2022Plateau-reduced Differentiable Path Tracingcited by 10
- 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracingcited by 9
18 more
- 2024NeISF++: Neural Incident Stokes Field for Polarized Inverse Rendering of Conductors and Dielectricscited by 9
- 2023Single View Refractive Index Tomography with Neural Fieldscited by 8
- 2024Flying with Photons: Rendering Novel Views of Propagating Lightcited by 7
- 2022Sampling Neural Radiance Fields for Refractive Objectscited by 6
- 2023MS-NeRF: Multi-Space Neural Radiance Fieldscited by 5
- 2023SeamlessNeRF: Stitching Part NeRFs with Gradient Propagationcited by 4
- 2024NeuroPump: Simultaneous Geometric and Color Rectification for Underwater Imagescited by 4
- 2023Inferring Fluid Dynamics via Inverse Renderingcited by 3
- 2024PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularizationcited by 2
- 2024Surf-NeRF: Surface Regularised Neural Radiance Fieldscited by 2
- 2026RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splattingcited by 2
- 2023Neural Radiance Fields for Transparent Object Using Visual Hullcited by 1
- 2025RefRef: A Dataset and Benchmark for Reconstructing Refractive and Reflective Objectscited by 1
- 2024Through the Curved Cover: Synthesizing Cover Aberrated Scenes with Refractive Fieldcited by 0
- 2026DiffTrans: Differentiable Geometry-Materials Decomposition for Reconstructing Transparent Objectscited by 0
- 2026RefracGS: Novel View Synthesis Through Refractive Water Surfaces with 3D Gaussian Ray Tracingcited by 0
- 2026GLINT: Modeling Scene-Scale Transparency via Gaussian Radiance Transportcited by 0
- 2026Light Field Primitive for Novel View Synthesiscited by 0
- 2026Light Field Primitive for Novel View Synthesis25 Sep 2026
- 2026RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting18 May 2026
- 2026GLINT: Modeling Scene-Scale Transparency via Gaussian Radiance Transport27 Mar 2026
- 2026RefracGS: Novel View Synthesis Through Refractive Water Surfaces with 3D Gaussian Ray Tracing23 Mar 2026
- 2026DiffTrans: Differentiable Geometry-Materials Decomposition for Reconstructing Transparent Objects28 Feb 2026
- 2025RefRef: A Dataset and Benchmark for Reconstructing Refractive and Reflective Objects9 May 2025
- 2025TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussians26 Apr 2025
- 2024NeuroPump: Simultaneous Geometric and Color Rectification for Underwater Images20 Dec 2024
- 2024Generative Multiview Relighting for 3D Reconstruction under Extreme Illumination Variation19 Dec 2024
- 2024Ref-GS: Directional Factorization for 2D Gaussian Splatting1 Dec 2024
- 2024Surf-NeRF: Surface Regularised Neural Radiance Fields27 Nov 2024
- 2024NeISF++: Neural Incident Stokes Field for Polarized Inverse Rendering of Conductors and Dielectrics15 Nov 2024
18 more
- 2024Through the Curved Cover: Synthesizing Cover Aberrated Scenes with Refractive Field10 Nov 2024
- 2024PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularization13 Aug 2024
- 2024Rip-NeRF: Anti-aliasing Radiance Fields with Ripmap-Encoded Platonic Solids3 May 2024
- 2024Flying with Photons: Rendering Novel Views of Propagating Light9 Apr 2024
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenes5 Feb 2024
- 2023SpectralNeRF: Physically Based Spectral Rendering with Neural Radiance Field14 Dec 2023
- 2023Neural Radiance Fields for Transparent Object Using Visual Hull13 Dec 2023
- 2023SeamlessNeRF: Stitching Part NeRFs with Gradient Propagation30 Oct 2023
- 2023NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fields22 Sep 2023
- 2023OmnimatteRF: Robust Omnimatte with 3D Background Modeling14 Sep 2023
- 2023Single View Refractive Index Tomography with Neural Fields8 Sep 2023
- 2023MS-NeRF: Multi-Space Neural Radiance Fields7 May 2023
- 2023Inferring Fluid Dynamics via Inverse Rendering10 Apr 2023
- 2023NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objects21 Mar 2023
- 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracing20 Mar 2023
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling5 Jan 2023
- 2022Plateau-reduced Differentiable Path Tracing30 Nov 2022
- 2022Sampling Neural Radiance Fields for Refractive Objects27 Nov 2022
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2024Ref-GS: Directional Factorization for 2D Gaussian Splattingcited by 27
- 2024Rip-NeRF: Anti-aliasing Radiance Fields with Ripmap-Encoded Platonic Solidscited by 23
- 2023NeRRF: 3D Reconstruction and View Synthesis for Transparent and Specular Objects with Neural Refractive-Reflective Fieldscited by 16
- 2025TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussianscited by 16
- 2023NEMTO: Neural Environment Matting for Novel View and Relighting Synthesis of Transparent Objectscited by 14
- 2023OmnimatteRF: Robust Omnimatte with 3D Background Modelingcited by 14
- 2024Generative Multiview Relighting for 3D Reconstruction under Extreme Illumination Variationcited by 13
- 2023SpectralNeRF: Physically Based Spectral Rendering with Neural Radiance Fieldcited by 12
- 2022Plateau-reduced Differentiable Path Tracingcited by 10
- 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracingcited by 9
12 most cited of 30 All 30 (JSON)
- 2026Light Field Primitive for Novel View Synthesis25 Sep 2026
- 2026RT-Splatting: Joint Reflection-Transmission Modeling with Gaussian Splatting18 May 2026
- 2026GLINT: Modeling Scene-Scale Transparency via Gaussian Radiance Transport27 Mar 2026
- 2026RefracGS: Novel View Synthesis Through Refractive Water Surfaces with 3D Gaussian Ray Tracing23 Mar 2026
- 2026DiffTrans: Differentiable Geometry-Materials Decomposition for Reconstructing Transparent Objects28 Feb 2026
- 2025RefRef: A Dataset and Benchmark for Reconstructing Refractive and Reflective Objects9 May 2025
- 2025TransparentGS: Fast Inverse Rendering of Transparent Objects with Gaussians26 Apr 2025
- 2024NeuroPump: Simultaneous Geometric and Color Rectification for Underwater Images20 Dec 2024
- 2024Generative Multiview Relighting for 3D Reconstruction under Extreme Illumination Variation19 Dec 2024
- 2024Ref-GS: Directional Factorization for 2D Gaussian Splatting1 Dec 2024
- 2024Surf-NeRF: Surface Regularised Neural Radiance Fields27 Nov 2024
- 2024NeISF++: Neural Incident Stokes Field for Polarized Inverse Rendering of Conductors and Dielectrics15 Nov 2024
12 newest of 30 All 30 (JSON)