Scene-Agnostic Object-Centric Representation Learning for 3D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Recent works on 3D scene understanding leverage 2D masks from visual foundation models (VFMs) to supervise radiance fields, enabling instance-level 3D segmentation. However, the supervision signals from foundation models are not fundamentally object-centric and often require additional mask pre/post-processing or specialized training and loss design to resolve mask identity conflicts across views. The learned identity of the 3D scene is scene-dependent, limiting generalizability across scenes. Therefore, we propose a dataset-level, object-centric supervision scheme to learn object representations in 3D Gaussian Splatting (3DGS). Building on a pre-trained slot attention-based Global Object Centric Learning (GOCL) module, we learn a scene-agnostic object codebook that provides consistent, identity-anchored representations across views and scenes. By coupling the codebook with the module's unsupervised object masks, we can directly supervise the identity features of 3D Gaussians without additional mask pre-/post-processing or explicit multi-view alignment. The learned scene-agnostic codebook enables object supervision and identification without per-scene fine-tuning or retraining. Our method thus introduces unsupervised object-centric learning (OCL) into 3DGS, yielding more structured representations and better generalization for downstream tasks such as robotic interaction, scene understanding, and cross-scene generalization.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 41 of its 47 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
41 of 47 references.
References · 41
- 2023Segment Anythingcited by 8,158
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
29 more
- 2023LangSplat: 3D Language Gaussian Splattingcited by 410
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
- 2022Kubric: A scalable dataset generatorcited by 373
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2021Conditional Object-Centric Learning from Videocited by 247
- 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
- 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
- 2023Tracking Anything with Decoupled Video Segmentationcited by 197
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
- 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
- 2023Segment Any 3D Gaussianscited by 158
- 2024GARField: Group Anything with Radiance Fieldscited by 108
- 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 106
- 2021Unsupervised Discovery of Object Radiance Fieldscited by 100
- 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentationcited by 88
- 2023Object-Centric Learning for Real-World Videos by Predicting Temporal Feature Similaritiescited by 78
- 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
- 2023Segment Anything in 3D with Radiance Fieldscited by 61
- 2022Improving Object-centric Learning with Query Optimizationcited by 60
- 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussianscited by 58
- 2024Temporally Consistent Object-Centric Learning by Contrasting Slotscited by 30
- 2025Rethinking End-to-End 2D to 3D Scene Segmentation in Gaussian Splattingcited by 29
- 2022Unsupervised Discovery and Composition of Object Light Fieldscited by 28
- 2025ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via Gaussian Splattingcited by 24
- 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 19
- 2024Unsupervised Discovery of Object-Centric Neural Fieldscited by 12
- 2024Learning Global Object-Centric Representations via Disentangled Slot Attentioncited by 3
- 2023OCTScenes: A Versatile Real-World Dataset of Tabletop Scenes for Object-Centric Learningcited by 2
- 2026The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Modelscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.