CA-W3D: Leveraging Context-Aware Knowledge for Weakly Supervised Monocular 3D Detection
Not on the map. Why?
Abstract (arXiv)
Weakly supervised monocular 3D detection, while less annotation-intensive, often struggles to capture the global context required for reliable 3D reasoning. Conventional label-efficient methods focus on object-centric features, neglecting contextual semantic relationships that are critical in complex scenes. In this work, we propose a Context-Aware Weak Supervision for Monocular 3D object detection, namely CA-W3D, to address this limitation in a two-stage training paradigm. Specifically, we first introduce a pre-training stage employing Region-wise Object Contrastive Matching (ROCM), which aligns regional object embeddings derived from a trainable monocular 3D encoder and a frozen open-vocabulary 2D visual grounding model. This alignment encourages the monocular encoder to discriminate scene-specific attributes and acquire richer contextual knowledge. In the second stage, we incorporate a pseudo-label training process with a Dual-to-One Distillation (D2OD) mechanism, which effectively transfers contextual priors into the monocular encoder while preserving spatial fidelity and maintaining computational efficiency during inference. Extensive experiments conducted on the public KITTI benchmark demonstrate the effectiveness of our approach, surpassing the SoTA method over all metrics, highlighting the importance of contextual-aware knowledge in weakly-supervised monocular 3D detection.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 34 of its 41 references that are in the map. First posted on arXiv 6 Mar 2025.
Builds on
34 of 41 references.
References · 34
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,707
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 498
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 455
- 2020Open-Vocabulary Object Detection Using Captionscited by 427
- 2022Simple Open-Vocabulary Object Detection with Vision Transformerscited by 303
- 20163D Bounding Box Estimation Using Deep Learning and Geometrycited by 277
22 more
- 2019M3D-RPN: Monocular 3D Region Proposal Network for Object Detectioncited by 251
- 2019Disentangling Monocular 3D Object Detectioncited by 215
- 2018Orthographic Feature Transform for Monocular 3D Object Detectioncited by 201
- 2019Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous Drivingcited by 188
- 2018ROI-10D: Monocular Lifting of 2D Detection to 6D Pose and Metric Shapecited by 123
- 2019Monocular 3D Object Detection with Pseudo-LiDAR Point Cloudcited by 113
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 113
- 2020End-to-End Pseudo-LiDAR for Image-Based 3D Object Detectioncited by 80
- 2019Deep Fitting Degree Scoring Network for Monocular 3D Object Detectioncited by 67
- 2020Weakly Supervised 3D Object Detection from Lidar Point Cloudcited by 67
- 2021FGR: Frustum-Aware Geometric Reasoning for Weakly Supervised 3D Vehicle Detectioncited by 29
- 2024MatchU: Matching Unseen Objects for 6D Pose Estimation from RGB-D Imagescited by 28
- 2021PLUMENet: Efficient 3D Object Detection from Stereo Imagescited by 19
- 2022WeakM3D: Towards Weakly Supervised Monocular 3D Object Detectioncited by 18
- 2023SmartMask: Context Aware High-Fidelity Mask Generation for Fine-grained Object Insertion and Layout Controlcited by 18
- 2024Decoupled Pseudo-labeling for Semi-Supervised Monocular 3D Object Detectioncited by 11
- 2024Weakly Supervised Monocular 3D Detection with a Single-View Imagecited by 10
- 2023Weakly Supervised 3D Object Detection via Multi-Level Visual Guidancecited by 9
- 2024ANIM: Accurate Neural Implicit Model for Human Reconstruction from a single RGB-D imagecited by 9
- 2023Advancements in 3D Lane Detection Using LiDAR Point Clouds: From Data Collection to Model Developmentcited by 4
- 2024Unleashing the Potential of Mamba: Boosting a LiDAR 3D Sparse Detector by Using Cross-Model Knowledge Distillationcited by 4
- 2024Future Does Matter: Boosting 3D Object Detection with Temporal Motion Estimation in Point Cloud Sequencescited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.