mlsanityData to 7 Oct 2026

Car-GS: Addressing Reflective and Transparent Surface Challenges in 3D Car Reconstruction

arXiv 2501.11020 ↗First posted 19 Jan 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

3D car modeling is crucial for applications in autonomous driving systems, virtual and augmented reality, and gaming. However, due to the distinctive properties of cars, such as highly reflective and transparent surface materials, existing methods often struggle to achieve accurate 3D car reconstruction.To address these limitations, we propose Car-GS, a novel approach designed to mitigate the effects of specular highlights and the coupling of RGB and geometry in 3D geometric and shading reconstruction (3DGS). Our method incorporates three key innovations: First, we introduce view-dependent Gaussian primitives to effectively model surface reflections. Second, we identify the limitations of using a shared opacity parameter for both image rendering and geometric attributes when modeling transparent objects. To overcome this, we assign a learnable geometry-specific opacity to each 2D Gaussian primitive, dedicated solely to rendering depth and normals. Third, we observe that reconstruction errors are most prominent when the camera view is nearly orthogonal to glass surfaces. To address this issue, we develop a quality-aware supervision module that adaptively leverages normal priors from a pre-trained large-scale normal model.Experimental results demonstrate that Car-GS achieves precise reconstruction of car surfaces and significantly outperforms prior methods. The project page is available at https://lcc815.github.io/Car-GS.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 42 of its 46 references that are in the map. First posted on arXiv 19 Jan 2025.

Builds on

42 of 46 references.

References · 42

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  8. 2024Depth Anything V2cited by 1,385
  9. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  10. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  11. 2020Neural Sparse Voxel Fieldscited by 959
  12. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
30 more
  1. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  2. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  3. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  4. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  5. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
  6. 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 396
  7. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
  8. 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 238
  9. 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
  10. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
  11. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
  12. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  13. 2024High-quality Surface Reconstruction using Gaussian Surfelscited by 159
  14. 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
  15. 2023Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fieldscited by 142
  16. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 136
  17. 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 73
  18. 2023Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with Reflectioncited by 68
  19. 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 65
  20. 2022Vox-Surf: Voxel-based Implicit Surface Representationcited by 49
  21. 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 47
  22. 2022TensorIR: An Abstraction for Automatic Tensorized Program Optimizationcited by 38
  23. 20243DRealCar: An In-the-wild RGB-D Car Dataset with 360-degree Viewscited by 37
  24. 2024NeRF-Casting: Improved View-Dependent Appearance with Consistent Reflectionscited by 32
  25. 2023UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflectionscited by 29
  26. 2024GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyondcited by 24
  27. 2018Deep Surface Light Fieldscited by 23
  28. 2023UC-NeRF: Neural Radiance Field for Under-Calibrated Multi-view Cameras in Autonomous Drivingcited by 23
  29. 2024Rip-NeRF: Anti-aliasing Radiance Fields with Ripmap-Encoded Platonic Solidscited by 23
  30. 2024Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modelingcited by 15

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.