MicroSDF: Microfacet-Driven Hybrid Neural SDFs for Mixed-Reflectance Surface Reconstruction
Not on the map. Why?
Abstract (arXiv)
Accurate 3D reconstruction in real-world environments remains a significant challenge due to the coexistence of reflective and non-reflective surfaces, which pose distinct modeling demands. Existing methods often treat these surface types separately, limiting their generalizability and physical plausibility. To bridge this gap, we propose MicroSDF, a novel neural implicit framework that facilitates geometry and reflectance modeling through microfacet theory. Our approach incorporates three core innovations: (i) a microfacet-guided geometry model that extracts multi-scale surface normals (macroscopic and microfacet) from a signed distance field (SDF), regularized by a proposed microfacet normal consistency loss to enforce physically plausible surface orientations; (ii) an enhanced dual-branch color model, where the specular branch leverages the microfacet normals to model high-frequency reflectance, and the vanilla branch, unlike prior works, uses reflection direction (instead of viewing direction) to better model diffuse and low-frequency specular components; and (iii) a detection-guided color blending strategy that adaptively fuses the color outputs based on reflection priors, providing more physically intuitive blending than implicitly learned blending weights. Combined with a tailored multi-stage optimization scheme, the proposed MicroSDF achieves robust and high-fidelity reconstruction across reflective and non-reflective surfaces. Extensive experiments on DTU, Shiny Blender, Ref-NeRF, and DeepVoxels datasets demonstrate state-of-the-art performance, establishing a new direction for physically grounded neural reconstruction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 51 of its 80 references that are in the map. First posted on arXiv 14 Oct 2026.
Builds on
51 of 80 references.
References · 51
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2021Volume Rendering of Neural Implicit Surfacescited by 996
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
- 2020Implicit Geometric Regularization for Learning Shapescited by 710
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
38 more
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
- 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 405
- 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 335
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 314
- 2021Dense Depth Priors for Neural Radiance Fields from Sparse Input Viewscited by 302
- 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 232
- 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 221
- 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
- 2021Neural-PIL: Neural Pre-Integrated Lighting for Reflectance Decompositioncited by 205
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
- 2022SparseNeuS: Fast Generalizable Neural Surface Reconstruction from Sparse Viewscited by 177
- 2023TensoIR: Tensorial Inverse Renderingcited by 168
- 2021Improving neural implicit surfaces geometry with patch warpingcited by 137
- 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 122
- 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 111
- 2024GSDF: 3DGS Meets SDF for Improved Rendering and Reconstructioncited by 83
- 2022PermutoSDF: Fast Multi-View Reconstruction with Implicit Surfaces using Permutohedral Latticescited by 73
- 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 69
- 2023ENVIDR: Implicit Differentiable Renderer with Neural Environment Lightingcited by 65
- 2022MVSFormer: Multi-View Stereo by Learning Robust Image Features and Temperature-based Depthcited by 53
- 2024MVSFormer++: Revealing the Devil in Transformer's Details for Multi-View Stereocited by 50
- 2024WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splattingcited by 41
- 2023Neural Microfacet Fields for Inverse Renderingcited by 38
- 2021TRACER: Extreme Attention Guided Salient Object Tracing Networkcited by 33
- 2023UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflectionscited by 30
- 2024BillBoard Splatting (BBSplat): Learnable Textured Primitives for Novel View Synthesiscited by 25
- 2025LITA-GS: Illumination-Agnostic Novel View Synthesis via Reference-Free 3D Gaussian Splatting and Physical Priorscited by 21
- 2024LoopSparseGS: Loop Based Sparse-View Friendly Gaussian Splattingcited by 18
- 2023When Epipolar Constraint Meets Non-local Operators in Multi-View Stereocited by 14
- 2025RainyGS: Efficient Rain Synthesis with Physically-Based Gaussian Splattingcited by 13
- 2021LASOR: Learning Accurate 3D Human Pose and Shape Via Synthetic Occlusion-Aware Data and Neural Mesh Renderingcited by 8
- 2024AniSDF: Fused-Granularity Neural Surfaces with Anisotropic Encoding for High-Fidelity 3D Reconstructioncited by 6
- 2025Surface-SOS: Self-Supervised Object Segmentation via Neural Surface Representationcited by 4
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.