mlsanityData to 14 Oct 2026

DEGround: An Effective Baseline for Ego-centric 3D Visual Grounding with a Homogeneous Framework

arXiv 2506.05199 ↗First posted 5 Jun 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

A core task in embodied intelligence is ego-centric 3D visual grounding. Existing methods typically adopt two-stage, heterogeneous pipelines that pair a detector with a separate grounding model. Incompatible decoders and box heads hinder the transfer of object-level priors, and the split training causes redundant re-optimization. To overcome these limitations, we present DEGround, a straight, elegant, and effective framework that centers on object-level sharing over detection and grounding. It employs a set of queries that serves as the common object representation for both detection and grounding, which is decoded by a shared transformer and bounding box head. Building on this homogeneous framework, we further introduce two task-specific plug-in modules to enhance fine-grained instruction grounding. The Regional Activation Grounding module improves spatial-textual alignment by highlighting instruction-relevant regions, while the Query-wise Modulation module applies sentence-conditioned affine modulation to generate instruction-aware queries at initialization. Extensive experiments demonstrate that DEGround achieves the best performance on multiple benchmarks. Remarkably, it significantly outperforms previous methods by 7.52% at overall precision on the EmbodiedScan dataset.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 52 of its 68 references that are in the map. First posted on arXiv 5 Jun 2025.

Builds on

52 of 68 references.

References · 52

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2020End-to-End Object Detection with Transformerscited by 7,414
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  7. 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
  8. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  9. 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
  10. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
  11. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
  12. 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
38 more
  1. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 452
  2. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
  3. 2023An Embodied Generalist Agent in 3D Worldcited by 365
  4. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
  5. 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
  6. 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
  7. 2021Group-Free 3D Object Detection via Transformerscited by 215
  8. 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 188
  9. 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 175
  10. 2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
  11. 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 147
  12. 2023Multi3DRefer: Grounding Text Description to Multiple 3D Objectscited by 146
  13. 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 141
  14. 2022Multi-View Transformer for 3D Visual Groundingcited by 140
  15. 2023Towards Learning a Generalist Model for Embodied Navigationcited by 138
  16. 2021Bottom Up Top Down Detection Transformers for Language Grounding in Images and Point Cloudscited by 128
  17. 2021SAT: 2D Semantics Assisted Training for 3D Visual Groundingcited by 124
  18. 2022Language Conditioned Spatial Relation Reasoning for 3D Object Groundingcited by 122
  19. 2024Grounded 3D-LLM with Referent Tokenscited by 115
  20. 2023Language Prompt for Autonomous Drivingcited by 111
  21. 20223D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selectioncited by 110
  22. 2021FCAF3D: Fully Convolutional Anchor-Free 3D Object Detectioncited by 97
  23. 2023Referring Multi-Object Trackingcited by 93
  24. 2021TransRefer3D: Entity-and-Relation Aware Transformer for Fine-Grained 3D Visual Groundingcited by 86
  25. 2021Free-form Description Guided 3D Visual Graph Network for Object Grounding in Point Cloudcited by 81
  26. 2023ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidancecited by 70
  27. 2024Unifying 3D Vision-Language Understanding via Promptable Queriescited by 70
  28. 2023NS3D: Neuro-Symbolic Grounding of 3D Objects and Relationscited by 57
  29. 2023V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detectioncited by 35
  30. 2023Four Ways to Improve Verbo-visual Fusion for Dense 3D Visual Groundingcited by 32
  31. 2024MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Groundingcited by 29
  32. 2023Uni3DETR: Unified 3D Detection Transformercited by 27
  33. 2023Object2Scene: Putting Objects in Context for Open-Vocabulary 3D Detectioncited by 24
  34. 2024Bootstrapping Referring Multi-Object Trackingcited by 22
  35. 2024UniDet3D: Multi-dataset Indoor 3D Object Detectioncited by 20
  36. 2024Can 3D Vision-Language Models Truly Understand Natural Language?cited by 12
  37. 2025DenseGrounding: Improving Dense Language-Vision Semantics for Ego-Centric 3D Visual Groundingcited by 12
  38. 2024RG-SAN: Rule-Guided Spatial Awareness Network for End-to-End 3D Referring Expression Segmentationcited by 11

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.