mlsanityData to 7 Oct 2026

Scene-Agnostic Object-Centric Representation Learning for 3D Gaussian Splatting

arXiv 2604.09045 ↗First posted 10 Apr 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent works on 3D scene understanding leverage 2D masks from visual foundation models (VFMs) to supervise radiance fields, enabling instance-level 3D segmentation. However, the supervision signals from foundation models are not fundamentally object-centric and often require additional mask pre/post-processing or specialized training and loss design to resolve mask identity conflicts across views. The learned identity of the 3D scene is scene-dependent, limiting generalizability across scenes. Therefore, we propose a dataset-level, object-centric supervision scheme to learn object representations in 3D Gaussian Splatting (3DGS). Building on a pre-trained slot attention-based Global Object Centric Learning (GOCL) module, we learn a scene-agnostic object codebook that provides consistent, identity-anchored representations across views and scenes. By coupling the codebook with the module's unsupervised object masks, we can directly supervise the identity features of 3D Gaussians without additional mask pre-/post-processing or explicit multi-view alignment. The learned scene-agnostic codebook enables object supervision and identification without per-scene fine-tuning or retraining. Our method thus introduces unsupervised object-centric learning (OCL) into 3DGS, yielding more structured representations and better generalization for downstream tasks such as robotic interaction, scene understanding, and cross-scene generalization.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 41 of its 47 references that are in the map. First posted on arXiv 10 Apr 2026.

Builds on

41 of 47 references.

References · 41

  1. 2023Segment Anythingcited by 8,158
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  5. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  7. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  8. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  9. 2020Object-Centric Learning with Slot Attentioncited by 865
  10. 2025SAM 3: Segment Anything with Conceptscited by 835
  11. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  12. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
29 more
  1. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  2. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  3. 2022Kubric: A scalable dataset generatorcited by 373
  4. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
  5. 2021Conditional Object-Centric Learning from Videocited by 247
  6. 2022Bridging the Gap to Real-World Object-Centric Learningcited by 219
  7. 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 199
  8. 2023Tracking Anything with Decoupled Video Segmentationcited by 197
  9. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  10. 2022SAVi++: Towards End-to-End Object-Centric Learning from Real-World Videoscited by 165
  11. 2023Segment Any 3D Gaussianscited by 158
  12. 2024GARField: Group Anything with Radiance Fieldscited by 108
  13. 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 106
  14. 2021Unsupervised Discovery of Object Radiance Fieldscited by 100
  15. 2021Decomposing 3D Scenes into Objects via Unsupervised Volume Segmentationcited by 88
  16. 2023Object-Centric Learning for Real-World Videos by Predicting Temporal Feature Similaritiescited by 78
  17. 2023OmniSeg3D: Omniversal 3D Segmentation via Hierarchical Contrastive Learningcited by 75
  18. 2023Segment Anything in 3D with Radiance Fieldscited by 61
  19. 2022Improving Object-centric Learning with Query Optimizationcited by 60
  20. 2024Click-Gaussian: Interactive Segmentation to Any 3D Gaussianscited by 58
  21. 2024Temporally Consistent Object-Centric Learning by Contrasting Slotscited by 30
  22. 2025Rethinking End-to-End 2D to 3D Scene Segmentation in Gaussian Splattingcited by 29
  23. 2022Unsupervised Discovery and Composition of Object Light Fieldscited by 28
  24. 2025ObjectGS: Object-aware Scene Reconstruction and Scene Understanding via Gaussian Splattingcited by 24
  25. 2025OpenSplat3D: Open-Vocabulary 3D Instance Segmentation using Gaussian Splattingcited by 19
  26. 2024Unsupervised Discovery of Object-Centric Neural Fieldscited by 12
  27. 2024Learning Global Object-Centric Representations via Disentangled Slot Attentioncited by 3
  28. 2023OCTScenes: A Versatile Real-World Dataset of Tabletop Scenes for Object-Centric Learningcited by 2
  29. 2026The Semantic Lifecycle in Embodied AI: Acquisition, Representation and Storage via Foundation Modelscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.