REFRAME: Reflective Surface Real-Time Rendering for Mobile Devices
Not on the map. Why?
Abstract (arXiv)
This work tackles the challenging task of achieving real-time novel view synthesis for reflective surfaces across various scenes. Existing real-time rendering methods, especially those based on meshes, often have subpar performance in modeling surfaces with rich view-dependent appearances. Our key idea lies in leveraging meshes for rendering acceleration while incorporating a novel approach to parameterize view-dependent information. We decompose the color into diffuse and specular, and model the specular color in the reflected direction based on a neural environment map. Our experiments demonstrate that our method achieves comparable reconstruction quality for highly reflective surfaces compared to state-of-the-art offline methods, while also efficiently enabling real-time rendering on edge devices such as smartphones.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 59 of its 66 references that are in the map. First posted on arXiv 25 Mar 2024.
Builds on
59 of 66 references.
References · 59
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
38 more
- 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 446
- 2020Modular Primitives for High-Performance Differentiable Renderingcited by 439
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 411
- 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
- 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
- 2021Urban Radiance Fieldscited by 263
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
- 2022Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representationcited by 243
- 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 220
- 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 204
- 2020Neural Reflectance Fields for Appearance Acquisitioncited by 196
- 2022Modeling Indirect Illumination for Inverse Renderingcited by 167
- 2023TensoIR: Tensorial Inverse Renderingcited by 166
- 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
- 2022Panoptic NeRF: 3D-to-2D Label Transfer for Panoptic Urban Scene Segmentationcited by 152
- 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
- 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
- 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 110
- 2022EfficientNeRF: Efficient Neural Radiance Fieldscited by 110
- 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
- 2023Neural Fields meet Explicit Geometric Representation for Inverse Rendering of Urban Scenescited by 89
- 2023NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimationcited by 73
- 2022R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesiscited by 69
- 2022AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fieldscited by 68
- 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 68
- 2023ENVIDR: Implicit Differentiable Renderer with Neural Environment Lightingcited by 63
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.