mlsanityData to 7 Oct 2026

From Dataset to Real-world: General 3D Object Detection via Generalized Cross-domain Few-shot Learning

arXiv 2503.06282 ↗First posted 8 Mar 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

LiDAR-based 3D object detection models often struggle to generalize to real-world environments due to limited object diversity in existing datasets. To tackle it, we introduce the first generalized cross-domain few-shot (GCFS) task in 3D object detection, aiming to adapt a source-pretrained model to both common and novel classes in a new domain with only few-shot annotations. We propose a unified framework that learns stable target semantics under limited supervision by bridging 2D open-set semantics with 3D spatial reasoning. Specifically, an image-guided multi-modal fusion injects transferable 2D semantic cues into the 3D pipeline via vision-language models, while a physically-aware box search enhances 2D-to-3D alignment via LiDAR priors. To capture class-specific semantics from sparse data, we further introduce contrastive-enhanced prototype learning, which encodes few-shot instances into discriminative semantic anchors and stabilizes representation learning. Extensive experiments on GCFS benchmarks demonstrate the effectiveness and generality of our approach in realistic deployment settings.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 48 of its 55 references that are in the map. First posted on arXiv 8 Mar 2025.

Builds on

48 of 55 references.

References · 48

  1. 2023Segment Anythingcited by 8,158
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  7. 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
  8. 2021Grounded Language-Image Pre-trainingcited by 1,147
  9. 2018PointRCNN: 3D Object Proposal Generation and Detection from Point Cloudcited by 939
  10. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
  11. 2019PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detectioncited by 890
  12. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 701
36 more
  1. 2019Deep Hough Voting for 3D Object Detection in Point Cloudscited by 648
  2. 2020Open-Vocabulary Object Detection Using Captionscited by 427
  3. 2020Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detectioncited by 409
  4. 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
  5. 2020Frustratingly Simple Few-Shot Object Detectioncited by 280
  6. 2021Voxel Transformer for 3D Object Detectioncited by 247
  7. 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
  8. 2023A Simple Framework for Open-Vocabulary Segmentation and Detectioncited by 197
  9. 20203D Object Detection with Pointformercited by 194
  10. 2020A2D2: Audi Autonomous Driving Datasetcited by 189
  11. 2019Meta R-CNN : Towards General Solver for Instance-level Few-shot Learningcited by 182
  12. 2023Towards Open Vocabulary Learning: A Surveycited by 165
  13. 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 158
  14. 2020Train in Germany, Test in The USA: Making 3D Object Detectors Generalizecited by 150
  15. 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
  16. 2020Multi-Scale Positive Sample Refinement for Few-Shot Object Detectioncited by 116
  17. 20213D Object Detection for Autonomous Driving: A Surveycited by 106
  18. 2021Generalized Few-Shot Object Detection without Forgettingcited by 88
  19. 2023Open-Vocabulary Point-Cloud Object Detection without 3D Annotationcited by 81
  20. 2018LSTD: A Low-Shot Transfer Detector for Object Detectioncited by 77
  21. 2021ST3D++: Denoised Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 57
  22. 2023CoDA: Collaborative Novel Box Discovery and Cross-modal Alignment for Open-vocabulary 3D Object Detectioncited by 51
  23. 2022SSDA3D: Semi-supervised Domain Adaptation for 3D Object Detection from Point Cloudcited by 37
  24. 2023Unsupervised 3D Perception with 2D Vision-Language Distillation for Autonomous Drivingcited by 37
  25. 2023Few-shot Class-incremental Learning for Classification and Object Detection: A Surveycited by 25
  26. 2023OpenSight: A Simple Open-Vocabulary Framework for LiDAR-Based Object Detectioncited by 22
  27. 2024Find n' Propagate: Open-Vocabulary 3D Object Detection in Urban Environmentscited by 21
  28. 2024RoboFusion: Towards Robust Multi-Modal 3D Object Detection via SAMcited by 20
  29. 2022Prototypical VoteNet for Few-Shot 3D Point Cloud Object Detectioncited by 14
  30. 2021Attentive Prototypes for Source-free Unsupervised Domain Adaptive 3D Object Detectioncited by 13
  31. 2024Few-Shot Object Detection: Research Advances and Challengescited by 11
  32. 2022Few-shot Adaptive Object Detection with Cross-Domain CutMixcited by 7
  33. 2023Generalized Few-Shot 3D Object Detection of LiDAR Point Cloud for Autonomous Drivingcited by 6
  34. 2023Domain Generalization of 3D Object Detection by Density-Resamplingcited by 6
  35. 2024Weak-to-Strong 3D Object Detection with X-Ray Distillationcited by 5
  36. 2024CP-VoteNet: Contrastive Prototypical VoteNet for Few-Shot Point Cloud Object Detectioncited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Just Add Geometry: Gradient-Free Open-Vocabulary 3D Detection Without Human-in-the-Loop
  2. 2026Training-Free Open-Vocabulary 3D Point-Cloud Segmentation on the Generalized Few-Shot Benchmark
  3. 2025Generalized Few-shot 3D Point Cloud Segmentation with Vision-Language Model
  4. 2025Boosting Single-domain Generalized Object Detection via Vision-Language Knowledge Interaction
  5. 2025Multi-Modal Assistance for Unsupervised Domain Adaptation on Point Cloud 3D Object Detection
  6. 2026Learning Multi-Modal Prototypes for Cross-Domain Few-Shot Object Detection
  7. 2025Towards 3D Objectness Learning in an Open World
  8. 2026Prototype-Anchored Generalized Manifold Regression for Unknown-Domain Object Detection