Dual Attribute-Spatial Relation Alignment for 3D Visual Grounding
Not on the map. Why?
Abstract (arXiv)
3D visual grounding is an emerging research area dedicated to making connections between the 3D physical world and natural language, which is crucial for achieving embodied intelligence. In this paper, we propose DASANet, a Dual Attribute-Spatial relation Alignment Network that separately models and aligns object attributes and spatial relation features between language and 3D vision modalities. We decompose both the language and 3D point cloud input into two separate parts and design a dual-branch attention module to separately model the decomposed inputs while preserving global context in attribute-spatial feature fusion by cross attentions. Our DASANet achieves the highest grounding accuracy 65.1% on the Nr3D dataset, 1.3% higher than the best competitor. Besides, the visualization of the two branches proves that our method is efficient and highly interpretable.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 21 references that are in the map. First posted on arXiv 13 Jun 2024.
Builds on
16 of 21 references.
References · 16
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 432
- 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 140
- 2022Multi-View Transformer for 3D Visual Groundingcited by 138
- 2021Bottom Up Top Down Detection Transformers for Language Grounding in Images and Point Cloudscited by 128
- 2021SAT: 2D Semantics Assisted Training for 3D Visual Groundingcited by 124
- 2022Language Conditioned Spatial Relation Reasoning for 3D Object Groundingcited by 121
- 2022EDA: Explicit Text-Decoupling and Dense Alignment for 3D Visual Groundingcited by 98
- 2021LanguageRefer: Spatial-Language Model for 3D Visual Groundingcited by 88
4 more
- 2021TransRefer3D: Entity-and-Relation Aware Transformer for Fine-Grained 3D Visual Groundingcited by 86
- 2021Free-form Description Guided 3D Visual Graph Network for Object Grounding in Point Cloudcited by 81
- 2023ViewRefer: Grasp the Multi-view Knowledge for 3D Visual Grounding with GPT and Prototype Guidancecited by 70
- 2022ScanEnts3D: Exploiting Phrase-to-3D-Object Correspondences for Improved Visio-Linguistic Models in 3D Scenescited by 32
Built on by
Not cited yet.