DC-Scene: Data-Centric Learning for 3D Scene Understanding
Not on the map. Why?
Abstract (arXiv)
3D scene understanding plays a fundamental role in vision applications such as robotics, autonomous driving, and augmented reality. However, advancing learning-based 3D scene understanding remains challenging due to two key limitations: (1) the large scale and complexity of 3D scenes lead to higher computational costs and slower training compared to 2D counterparts; and (2) high-quality annotated 3D datasets are significantly scarcer than those available for 2D vision. These challenges underscore the need for more efficient learning paradigms. In this work, we propose DC-Scene, a data-centric framework tailored for 3D scene understanding, which emphasizes enhancing data quality and training efficiency. Specifically, we introduce a CLIP-driven dual-indicator quality (DIQ) filter, combining vision-language alignment scores with caption-loss perplexity, along with a curriculum scheduler that progressively expands the training pool from the top 25% to 75% of scene-caption pairs. This strategy filters out noisy samples and significantly reduces dependence on large-scale labeled 3D data. Extensive experiments on ScanRefer and Nr3D demonstrate that DC-Scene achieves state-of-the-art performance (86.1 CIDEr with the top-75% subset vs. 85.4 with the full dataset) while reducing training cost by approximately two-thirds, confirming that a compact set of high-quality samples can outperform exhaustive training. Code will be available at https://github.com/AIGeeksGroup/DC-Scene.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 21 May 2025.
Builds on
26 of 40 references.
References · 26
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 452
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
- 2022SQA3D: Situated Question Answering in 3D Scenescited by 314
- 2021Curriculum Learning: A Surveycited by 259
- 2020Scan2Cap: Context-aware Dense Captioning in RGB-D Scanscited by 218
- 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 133
- 2023End-to-End 3D Dense Captioning with Vote2Cap-DETRcited by 78
- 2021D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Groundingcited by 52
- 2022MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenescited by 46
- 2021SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videoscited by 40
14 more
- 2022Spatiality-guided Transformer for 3D Dense Captioning on Point Cloudscited by 40
- 2024TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenescited by 40
- 2023Vote2Cap-DETR++: Decoupling Localization and Describing for End-to-End 3D Dense Captioningcited by 39
- 2024View Selection for 3D Captioning via Diffusion Rankingcited by 32
- 2019TightCap: 3D Human Shape Capture with Clothing Tightness Fieldcited by 25
- 2024Open Vocabulary 3D Scene Understanding via Geometry Guided Self-Distillationcited by 17
- 2024Dense Multimodal Alignment for Open-Vocabulary 3D Scene Understandingcited by 16
- 2021Point Cloud Instance Segmentation with Semi-supervised Bounding-Box Miningcited by 15
- 2024MSDet: Receptive Field Enhanced Multiscale Detection for Tiny Pulmonary Nodulecited by 14
- 20253D CoCa: Contrastive Learners are 3D Captionerscited by 13
- 2023Curricular Object Manipulation in LiDAR-based Object Detectioncited by 12
- 2024Duoduo CLIP: Efficient 3D Understanding with Multi-View Imagescited by 12
- 2024MedDet: Generative Adversarial Distillation for Efficient Cervical Disc Herniation Detectioncited by 11
- 2025PedDet: Adaptive Spectral Optimization for Multimodal Pedestrian Detectioncited by 6
Built on by
Citing papers per year: 2025: 8; 2026: 7.
15 papers.
Sort:
By area:
- 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understandingcited by 47
- 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Modelscited by 38
- 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robotscited by 15
- 2025EvoVLA: Self-Evolving Vision-Language-Action Modelcited by 11
- 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenescited by 9
- 2026CoV: Chain-of-View Prompting for Spatial Reasoningcited by 9
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
- 2026AnyDepth: Depth Estimation Made Easycited by 5
- 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Potterycited by 4
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligencecited by 3
- 2026UniMesh: Unifying 3D Mesh Understanding and Generationcited by 2
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Modelscited by 2
3 more
- 2025RPD-Diff: Region-Adaptive Physics-Guided Diffusion Model for Visibility Enhancement under Dense and Non-Uniform Hazecited by 1
- 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoningcited by 1
- 2026MobileVLA-R1 2.0: RL-Enhanced Reasoning for Mobile Robot Controlcited by 1
- 2026MobileVLA-R1 2.0: RL-Enhanced Reasoning for Mobile Robot Control5 Sep 2026
- 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoning20 Jul 2026
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models25 Jun 2026
- 2026UniMesh: Unifying 3D Mesh Understanding and Generation19 Apr 2026
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligence10 Jan 2026
- 2026CoV: Chain-of-View Prompting for Spatial Reasoning8 Jan 2026
- 2026AnyDepth: Depth Estimation Made Easy6 Jan 2026
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusion4 Dec 2025
- 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robots22 Nov 2025
- 2025EvoVLA: Self-Evolving Vision-Language-Action Model20 Nov 2025
- 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Pottery6 Oct 2025
- 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Models2 Oct 2025
3 more
- 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understandingcited by 47
- 2026CoV: Chain-of-View Prompting for Spatial Reasoningcited by 9
- 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Potterycited by 4
- 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoningcited by 1
- 2026ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoning20 Jul 2026
- 2026CoV: Chain-of-View Prompting for Spatial Reasoning8 Jan 2026
- 2025VaseVQA-3D: Benchmarking 3D VLMs on Ancient Greek Pottery6 Oct 2025
- 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understanding31 Jul 2025
- 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenescited by 9
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
- 2026AnyDepth: Depth Estimation Made Easycited by 5
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligencecited by 3
- 2026UniMesh: Unifying 3D Mesh Understanding and Generationcited by 2
- 2026UniMesh: Unifying 3D Mesh Understanding and Generation19 Apr 2026
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligence10 Jan 2026
- 2026AnyDepth: Depth Estimation Made Easy6 Jan 2026
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusion4 Dec 2025
- 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenes19 Sep 2025