DEGround: An Effective Baseline for Ego-centric 3D Visual Grounding with a Homogeneous Framework
Not on the map. Why?
Abstract (arXiv)
A core task in embodied intelligence is ego-centric 3D visual grounding. Existing methods typically adopt two-stage, heterogeneous pipelines that pair a detector with a separate grounding model. Incompatible decoders and box heads hinder the transfer of object-level priors, and the split training causes redundant re-optimization. To overcome these limitations, we present DEGround, a straight, elegant, and effective framework that centers on object-level sharing over detection and grounding. It employs a set of queries that serves as the common object representation for both detection and grounding, which is decoded by a shared transformer and bounding box head. Building on this homogeneous framework, we further introduce two task-specific plug-in modules to enhance fine-grained instruction grounding. The Regional Activation Grounding module improves spatial-textual alignment by highlighting instruction-relevant regions, while the Query-wise Modulation module applies sentence-conditioned affine modulation to generate instruction-aware queries at initialization. Extensive experiments demonstrate that DEGround achieves the best performance on multiple benchmarks. Remarkably, it significantly outperforms previous methods by 7.52% at overall precision on the EmbodiedScan dataset.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 52 of its 68 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
52 of 68 references.
References · 52
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 941
- 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 891
- 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
38 more
- 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 452
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2023An Embodied Generalist Agent in 3D Worldcited by 365
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
- 2023Occ3D: A Large-Scale 3D Occupancy Prediction Benchmark for Autonomous Drivingcited by 332
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2019RIO: 3D Object Instance Re-Localization in Changing Indoor Environmentscited by 188
- 2023Chat-Scene: Bridging 3D Scene and Large Language Models with Object Identifierscited by 175
- 2021ImVoxelNet: Image to Voxels Projection for Monocular and Multi-View General-Purpose 3D Object Detectioncited by 157
- 2023EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AIcited by 147
- 2023Multi3DRefer: Grounding Text Description to Multiple 3D Objectscited by 146
- 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 141
- 2022Multi-View Transformer for 3D Visual Groundingcited by 140
- 2023Towards Learning a Generalist Model for Embodied Navigationcited by 138
- 2021Bottom Up Top Down Detection Transformers for Language Grounding in Images and Point Cloudscited by 128
- 2021SAT: 2D Semantics Assisted Training for 3D Visual Groundingcited by 124
- 2022Language Conditioned Spatial Relation Reasoning for 3D Object Groundingcited by 122
- 2024Grounded 3D-LLM with Referent Tokenscited by 115
- 2023Language Prompt for Autonomous Drivingcited by 111
- 20223D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selectioncited by 110
- 2021FCAF3D: Fully Convolutional Anchor-Free 3D Object Detectioncited by 97
- 2023Referring Multi-Object Trackingcited by 93
- 2021TransRefer3D: Entity-and-Relation Aware Transformer for Fine-Grained 3D Visual Groundingcited by 86
- 2021Free-form Description Guided 3D Visual Graph Network for Object Grounding in Point Cloudcited by 81
- 2023ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidancecited by 70
- 2024Unifying 3D Vision-Language Understanding via Promptable Queriescited by 70
- 2023NS3D: Neuro-Symbolic Grounding of 3D Objects and Relationscited by 57
- 2023V-DETR: DETR with Vertex Relative Position Encoding for 3D Object Detectioncited by 35
- 2023Four Ways to Improve Verbo-visual Fusion for Dense 3D Visual Groundingcited by 32
- 2024MiKASA: Multi-Key-Anchor & Scene-Aware Transformer for 3D Visual Groundingcited by 29
- 2023Uni3DETR: Unified 3D Detection Transformercited by 27
- 2023Object2Scene: Putting Objects in Context for Open-Vocabulary 3D Detectioncited by 24
- 2024Bootstrapping Referring Multi-Object Trackingcited by 22
- 2024UniDet3D: Multi-dataset Indoor 3D Object Detectioncited by 20
- 2024Can 3D Vision-Language Models Truly Understand Natural Language?cited by 12
- 2025DenseGrounding: Improving Dense Language-Vision Semantics for Ego-Centric 3D Visual Groundingcited by 12
- 2024RG-SAN: Rule-Guided Spatial Awareness Network for End-to-End 3D Referring Expression Segmentationcited by 11
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Modelscited by 70
- 2025SpatialActor: Exploring Disentangled Spatial Representations for Robust Robotic Manipulationcited by 5
- 2026SeqAlign3DVG: A Sequence-Aligned Benchmark and Voxel Reasoning Framework for 3D Visual Groundingcited by 0
- 2026SeqAlign3DVG: A Sequence-Aligned Benchmark and Voxel Reasoning Framework for 3D Visual Grounding31 Aug 2026
- 2025SpatialActor: Exploring Disentangled Spatial Representations for Robust Robotic Manipulation12 Nov 2025
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulation26 Aug 2025
- 2025GeoVLA: Empowering 3D Representations in Vision-Language-Action Models12 Aug 2025