SupeRVol: Super-Resolution Shape and Reflectance Estimation in Inverse Volume Rendering
Not on the map. Why?
Abstract (arXiv)
We propose an end-to-end inverse rendering pipeline called SupeRVol that allows us to recover 3D shape and material parameters from a set of color images in a super-resolution manner. To this end, we represent both the bidirectional reflectance distribution function (BRDF) and the signed distance function (SDF) by multi-layer perceptrons. In order to obtain both the surface shape and its reflectance properties, we revert to a differentiable volume renderer with a physically based illumination model that allows us to decouple reflectance and lighting. This physical model takes into account the effect of the camera's point spread function thereby enabling a reconstruction of shape and material in a super-resolution quality. Experimental validation confirms that SupeRVol achieves state of the art performance in terms of inverse rendering quality. It generates reconstructions that are sharper than the individual input images, making this method ideally suited for 3D modeling from low-resolution imagery.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 48 of its 84 references that are in the map. First posted on arXiv 9 Dec 2022.
Builds on
48 of 84 references.
References · 48
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,584
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2020Neural Sparse Voxel Fieldscited by 959
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
36 more
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2019Deep Learning for Image Super-resolution: A Surveycited by 369
- 2021Advances in Neural Renderingcited by 365
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
- 2020State of the Art on Neural Renderingcited by 278
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 216
- 2022Modeling Indirect Illumination for Inverse Renderingcited by 168
- 2020Stable View Synthesiscited by 165
- 2018Deep Learning for Single Image Super-Resolution: A Brief Reviewcited by 158
- 2021NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illuminationcited by 135
- 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 111
- 2021Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Controlcited by 106
- 2021Neural Lumigraph Renderingcited by 105
- 2019Neural Inverse Rendering of an Indoor Scene from a Single Imagecited by 101
- 2020Deep Reflectance Volumes: Relightable Reconstructions from Multi-View Photometric Imagescited by 98
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
- 2019A Deep Journey into Super-resolution: A surveycited by 86
- 2021Unified Shape and SVBRDF Recovery using Differentiable Monte Carlo Renderingcited by 71
- 2022PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereocited by 69
- 2018Neural Inverse Rendering for General Reflectance Photometric Stereocited by 35
- 2020Uncalibrated Neural Inverse Rendering for Photometric Stereo of General Surfacescited by 33
- 2016ATGV-Net: Accurate Depth Super-Resolutioncited by 22
- 2022Look Back and Forth: Video Super-Resolution with Explicit Temporal Difference Modelingcited by 20
- 2018Photometric Depth Super-Resolutioncited by 8
- 2019Inferring Super-Resolution Depth from a Moving Light-Source Enhanced RGB-D Sensor: A Variational Approachcited by 8
- 2019On the well-posedness of uncalibrated photometric stereo under general lightingcited by 5
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 1.
6 papers.
- 2024Sparse Views, Near Light: A Practical Paradigm for Uncalibrated Point-light Photometric Stereocited by 6
- 2024PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularizationcited by 2
- 2025ROSA: Reconstructing Object Shape and Appearance Textures by Adaptive Detail Transfercited by 2
- 2025On Neural BRDFs: A Thorough Comparison of State-of-the-Art Approachescited by 2
- 2024Incorporating dense metric depth into neural 3D representations for view synthesis and relightingcited by 0
- 2026DIAMOND-SSS: Diffusion-Augmented Multi-View Optimization for Data-efficient SubSurface Scatteringcited by 0
- 2026DIAMOND-SSS: Diffusion-Augmented Multi-View Optimization for Data-efficient SubSurface Scattering17 Jan 2026
- 2025On Neural BRDFs: A Thorough Comparison of State-of-the-Art Approaches21 Feb 2025
- 2025ROSA: Reconstructing Object Shape and Appearance Textures by Adaptive Detail Transfer30 Jan 2025
- 2024Incorporating dense metric depth into neural 3D representations for view synthesis and relighting4 Sep 2024
- 2024PIR: Photometric Inverse Rendering with Shading Cues Modeling and Surface Reflectance Regularization13 Aug 2024
- 2024Sparse Views, Near Light: A Practical Paradigm for Uncalibrated Point-light Photometric Stereo29 Mar 2024