mlsanityData to 14 Oct 2026

DC-Scene: Data-Centric Learning for 3D Scene Understanding

arXiv 2505.15232 ↗First posted 21 May 2025cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

3D scene understanding plays a fundamental role in vision applications such as robotics, autonomous driving, and augmented reality. However, advancing learning-based 3D scene understanding remains challenging due to two key limitations: (1) the large scale and complexity of 3D scenes lead to higher computational costs and slower training compared to 2D counterparts; and (2) high-quality annotated 3D datasets are significantly scarcer than those available for 2D vision. These challenges underscore the need for more efficient learning paradigms. In this work, we propose DC-Scene, a data-centric framework tailored for 3D scene understanding, which emphasizes enhancing data quality and training efficiency. Specifically, we introduce a CLIP-driven dual-indicator quality (DIQ) filter, combining vision-language alignment scores with caption-loss perplexity, along with a curriculum scheduler that progressively expands the training pool from the top 25% to 75% of scene-caption pairs. This strategy filters out noisy samples and significantly reduces dependence on large-scale labeled 3D data. Extensive experiments on ScanRefer and Nr3D demonstrate that DC-Scene achieves state-of-the-art performance (86.1 CIDEr with the top-75% subset vs. 85.4 with the full dataset) while reducing training cost by approximately two-thirds, confirming that a compact set of high-quality samples can outperform exhaustive training. Code will be available at https://github.com/AIGeeksGroup/DC-Scene.

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 26 of its 40 references that are in the map. First posted on arXiv 21 May 2025.

Builds on

26 of 40 references.

References · 26

  1. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  2. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  3. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 452
  4. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
  5. 2022SQA3D: Situated Question Answering in 3D Scenescited by 314
  6. 2021Curriculum Learning: A Surveycited by 259
  7. 2020Scan2Cap: Context-aware Dense Captioning in RGB-D Scanscited by 218
  8. 2024SceneVerse: Scaling 3D Vision-Language Learning for Grounded Scene Understandingcited by 133
  9. 2023End-to-End 3D Dense Captioning with Vote2Cap-DETRcited by 78
  10. 2021D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Groundingcited by 52
  11. 2022MORE: Multi-Order RElation Mining for Dense Captioning in 3D Scenescited by 46
  12. 2021SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videoscited by 40
14 more
  1. 2022Spatiality-guided Transformer for 3D Dense Captioning on Point Cloudscited by 40
  2. 2024TOD3Cap: Towards 3D Dense Captioning in Outdoor Scenescited by 40
  3. 2023Vote2Cap-DETR++: Decoupling Localization and Describing for End-to-End 3D Dense Captioningcited by 39
  4. 2024View Selection for 3D Captioning via Diffusion Rankingcited by 32
  5. 2019TightCap: 3D Human Shape Capture with Clothing Tightness Fieldcited by 25
  6. 2024Open Vocabulary 3D Scene Understanding via Geometry Guided Self-Distillationcited by 17
  7. 2024Dense Multimodal Alignment for Open-Vocabulary 3D Scene Understandingcited by 16
  8. 2021Point Cloud Instance Segmentation with Semi-supervised Bounding-Box Miningcited by 15
  9. 2024MSDet: Receptive Field Enhanced Multiscale Detection for Tiny Pulmonary Nodulecited by 14
  10. 20253D CoCa: Contrastive Learners are 3D Captionerscited by 13
  11. 2023Curricular Object Manipulation in LiDAR-based Object Detectioncited by 12
  12. 2024Duoduo CLIP: Efficient 3D Understanding with Multi-View Imagescited by 12
  13. 2024MedDet: Generative Adversarial Distillation for Efficient Cervical Disc Herniation Detectioncited by 11
  14. 2025PedDet: Adaptive Spectral Optimization for Multimodal Pedestrian Detectioncited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 7.

15 papers.

Sort:

By area: