Car-GS: Addressing Reflective and Transparent Surface Challenges in 3D Car Reconstruction
Not on the map. Why?
Abstract (arXiv)
3D car modeling is crucial for applications in autonomous driving systems, virtual and augmented reality, and gaming. However, due to the distinctive properties of cars, such as highly reflective and transparent surface materials, existing methods often struggle to achieve accurate 3D car reconstruction.To address these limitations, we propose Car-GS, a novel approach designed to mitigate the effects of specular highlights and the coupling of RGB and geometry in 3D geometric and shading reconstruction (3DGS). Our method incorporates three key innovations: First, we introduce view-dependent Gaussian primitives to effectively model surface reflections. Second, we identify the limitations of using a shared opacity parameter for both image rendering and geometric attributes when modeling transparent objects. To overcome this, we assign a learnable geometry-specific opacity to each 2D Gaussian primitive, dedicated solely to rendering depth and normals. Third, we observe that reconstruction errors are most prominent when the camera view is nearly orthogonal to glass surfaces. To address this issue, we develop a quality-aware supervision module that adaptively leverages normal priors from a pre-trained large-scale normal model.Experimental results demonstrate that Car-GS achieves precise reconstruction of car surfaces and significantly outperforms prior methods. The project page is available at https://lcc815.github.io/Car-GS.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 42 of its 46 references that are in the map. First posted on arXiv 19 Jan 2025.
Builds on
42 of 46 references.
References · 42
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2024Depth Anything V2cited by 1,385
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2020Neural Sparse Voxel Fieldscited by 959
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
30 more
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
- 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 238
- 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
- 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
- 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2024High-quality Surface Reconstruction using Gaussian Surfelscited by 159
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
- 2023Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fieldscited by 142
- 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
- 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 73
- 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 68
- 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 65
- 2022Vox-Surf: Voxel-based Implicit Surface Representationcited by 49
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 47
- 2022TensorIR: An Abstraction for Automatic Tensorized Program Optimizationcited by 38
- 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 37
- 2024NeRF-Casting: Improved View-Dependent Appearance with Consistent Reflectionscited by 32
- 2023UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflectionscited by 29
- 2024GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyondcited by 24
- 2018Deep Surface Light Fieldscited by 23
- 2023UC-NeRF: Neural Radiance Field for Under-Calibrated Multi-view Cameras in Autonomous Drivingcited by 23
- 2024Rip-NeRF: Anti-aliasing Radiance Fields with Ripmap-Encoded Platonic Solidscited by 23
- 2024Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modelingcited by 15
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.