DiSCO-3D : Discovering and segmenting Sub-Concepts from Open-vocabulary queries in NeRF
Not on the map. Why?
Abstract (arXiv)
3D semantic segmentation provides high-level scene understanding for applications in robotics, autonomous systems, textitetc. Traditional methods adapt exclusively to either task-specific goals (open-vocabulary segmentation) or scene content (unsupervised semantic segmentation). We propose DiSCO-3D, the first method addressing the broader problem of 3D Open-Vocabulary Sub-concepts Discovery, which aims to provide a 3D semantic segmentation that adapts to both the scene and user queries. We build DiSCO-3D on Neural Fields representations, combining unsupervised segmentation with weak open-vocabulary guidance. Our evaluations demonstrate that DiSCO-3D achieves effective performance in Open-Vocabulary Sub-concepts Discovery and exhibits state-of-the-art results in the edge cases of both open-vocabulary and unsupervised segmentation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 37 of its 42 references that are in the map. First posted on arXiv 19 Jul 2025.
Builds on
37 of 42 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2018Panoptic Segmentationcited by 802
- 2022Language-driven Semantic Segmentationcited by 717
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
- 2022OpenScene: 3D Scene Understanding with Open Vocabulariescited by 559
25 more
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 473
- 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 415
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
- 2019Deep Multi-modal Object Detection and Semantic Segmentation for Autonomous Driving: Datasets, Methods, and Challengescited by 314
- 2022Generalized Decoding for Pixel, Image, and Languagecited by 294
- 2022Unsupervised Semantic Segmentation by Distilling Feature Correspondencescited by 241
- 2023Language Embedded 3D Gaussians for Open-Vocabulary Scene Understandingcited by 208
- 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 196
- 2023Weakly Supervised 3D Open-vocabulary Segmentationcited by 135
- 2022Open-Vocabulary Universal Image Segmentation with MaskCLIPcited by 132
- 2023Distilled Feature Fields Enable Few-Shot Language-Guided Manipulationcited by 130
- 2019Deep Semantic Segmentation of Natural and Medical Images: A Reviewcited by 125
- 2024GARField: Group Anything with Radiance Fieldscited by 109
- 2023CLIP-DINOiser: Teaching CLIP a few DINO tricks for open-vocabulary semantic segmentationcited by 96
- 2024OpenNeRF: Open Set 3D Neural Scene Segmentation with Pixel-Wise Features and Rendered Novel Viewscited by 69
- 2022ACSeg: Adaptive Conceptualization for Unsupervised Semantic Segmentationcited by 42
- 2023GrowSP: Unsupervised Semantic Segmentation of 3D Point Cloudscited by 34
- 2024EAGLE: Eigen Aggregation Learning for Object-Centric Unsupervised Semantic Segmentationcited by 27
- 2023Interactive Segment Anything NeRF with Feature Imitationcited by 24
- 2023SANeRF-HQ: Segment Anything for NeRF in High Qualitycited by 20
- 2023Selective Visual Representations Improve Convergence and Generalization for Embodied AIcited by 19
- 2023SmooSeg: Smoothness Prior for Unsupervised Semantic Segmentationcited by 18
- 2023U3DS3: Unsupervised 3D Semantic Scene Segmentationcited by 16
- 2024Semantic Scene Segmentation for Roboticscited by 16
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.