mlsanityData to 14 Oct 2026

OP2GS: Object-Aware 3D Gaussian Splatting with Dual-Opacity Primitives

arXiv 2605.20044 ↗First posted 19 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting (3DGS) provides an explicit and efficient scene representation, but its primitives lack inherent object-level identity, hindering downstream tasks such as open-vocabulary scene understanding. Existing methods typically address this by either distilling high-dimensional feature embeddings into Gaussians or by lifting 2D mask labels into 3D via heuristic refinement. However, feature-based approaches incur heavy storage and decoding overhead, while lifting-based pipelines remain vulnerable to label contamination: Gaussians necessary for appearance reconstruction often receive incorrect object labels during 2D-to-3D projection. We propose OP2GS, an object-aware Gaussian representation that augments each primitive with an explicit instance identity and a dedicated instance opacity σ* for object-mask rendering. The original opacity σ remains responsible for visual reconstruction, while σ* models whether a Gaussian should contribute to a particular object mask. This dual-opacity formulation decouples visual existence from instance occupancy: mislabeled Gaussians can remain available for image rendering while becoming transparent in the object-mask branch. To learn this representation, we introduce a random object loss that optimizes the 1D instance occupancy field using the standard transmittance-based visibility of 3DGS. Semantic descriptors are then attached at the object level through multi-view aggregation, eliminating per-Gaussian feature storage. Compared with feature-training approaches, OP2GS achieves competitive open-vocabulary performance while significantly reducing computational overhead. Compared with training-free pipelines, it leverages physically consistent occupancy learning to resolve visibility ambiguities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

26 of 30 references.

References · 26

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  5. 2022Language-driven Semantic Segmentationcited by 717
  6. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  7. 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 565
  8. 2023LERF: Language Embedded Radiance Fieldscited by 543
  9. 2023LangSplat: 3D Language Gaussian Splattingcited by 415
  10. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
  11. 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
  12. 2023Tracking Anything with Decoupled Video Segmentationcited by 197
14 more
  1. 2023Segment Any 3D Gaussianscited by 161
  2. 2024OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understandingcited by 145
  3. 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
  4. 2024OpenNeRF: Open Set 3D Neural Scene Segmentation with Pixel-Wise Features and Rendered Novel Viewscited by 69
  5. 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussianscited by 58
  6. 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 52
  7. 2025Dr. Splat: Directly Referring 3D Gaussian Splatting via Direct Language Embedding Registrationcited by 51
  8. 2024LUDVIG: Learning-Free Uplifting of 2D Visual Features to Gaussian Splatting Scenescited by 37
  9. 2025ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via Gaussian Splattingcited by 25
  10. 2025Lifting by Gaussians: A Simple, Fast and Flexible Method for 3D Instance Segmentationcited by 23
  11. 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 20
  12. 2024Occam's LGS: An Efficient Approach for Language Gaussian Splattingcited by 16
  13. 2025Visibility-Aware Language Aggregation for Open-Vocabulary Segmentation in 3D Gaussian Splattingcited by 9
  14. 2026LightSplat: Fast and Memory-Efficient Open-Vocabulary 3D Scene Understanding in Five Secondscited by 5

Built on by

Not cited yet.