mlsanityData to 7 Oct 2026

Points as Queries: Weakly Semi-supervised Object Detection by Points

arXiv 2104.07434 ↗First posted 15 Apr 2021cs.CVcited by 60

Not on the map. Why?

Abstract (arXiv)

We propose a novel point annotated setting for the weakly semi-supervised object detection task, in which the dataset comprises small fully annotated images and large weakly annotated images by points. It achieves a balance between tremendous annotation burden and detection performance. Based on this setting, we analyze existing detectors and find that these detectors have difficulty in fully exploiting the power of the annotated points. To solve this, we introduce a new detector, Point DETR, which extends DETR by adding a point encoder. Extensive experiments conducted on MS-COCO dataset in various data settings show the effectiveness of our method. In particular, when using 20% fully labeled data from COCO, our detector achieves a promising performance, 33.3 AP, which outperforms a strong baseline (FCOS) by 2.0 AP, and we demonstrate the point annotations bring over 10 points in various AR metrics.

Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). Builds on 28 of its 38 references that are in the map. First posted on arXiv 15 Apr 2021.

Builds on

28 of 38 references.

References · 28

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  7. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  8. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
  9. 2017Accurate, Large Minibatch SGD: Training ImageNet in 1 Hourcited by 1,479
  10. 2016YOLO9000: Better, Faster, Strongercited by 1,429
  11. 2015Spatial Transformer Networkscited by 1,423
  12. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
16 more
  1. 2019Objects as Pointscited by 1,172
  2. 2018Image Transformercited by 770
  3. 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
  4. 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
  5. 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 297
  6. 2020A Simple Semi-Supervised Learning Framework for Object Detectioncited by 282
  7. 2015Weakly Supervised Deep Detection Networkscited by 183
  8. 2020TIDE: A General Toolbox for Identifying Object Detection Errorscited by 113
  9. 2020Proposal Learning for Semi-Supervised Object Detectioncited by 55
  10. 2018Weakly Supervised Scene Parsing with Point-based Distance Metric Learningcited by 33
  11. 2018Towards Human-Machine Cooperation: Self-supervised Sample Mining for Object Detectioncited by 32
  12. 2017Deep Self-Taught Learning for Weakly Supervised Object Localizationcited by 27
  13. 2020UFO2: A Unified Framework towards Omni-supervised Object Detectioncited by 26
  14. 2017Soft Proposal Networks for Weakly Supervised Object Localizationcited by 21
  15. 2017Weakly Supervised Object Localization Using Things and Stuff Transfercited by 12
  16. 2017Weakly- and Semi-Supervised Object Detection with Expectation-Maximization Algorithmcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 18; 2023: 14; 2024: 15; 2025: 8; 2026: 3.

60 papers.

Sort:

  1. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
  2. 2022Few-shot Object Counting and Detectioncited by 55
  3. 2023Mapping Degeneration Meets Label Evolution: Learning Infrared Small Target Detection with Single Point Supervisioncited by 50
  4. 2021Instance-Conditional Knowledge Distillation for Object Detectioncited by 42
  5. 2022Omni-DETR: Omni-Supervised Object Detection with Transformerscited by 28
  6. 2023PointOBB: Learning Oriented Object Detection via Single Point Supervisioncited by 25
  7. 2022Group R-CNN for Weakly Semi-supervised Object Detection with Pointscited by 23
  8. 2023The Devil is in the Points: Weakly Semi-Supervised Instance Segmentation via Point-Guided Mask Representationcited by 21
  9. 2023Point2RBox: Combine Knowledge from Synthetic Visual Patterns for End-to-end Oriented Object Detection with Single Point Supervisioncited by 21
  10. 2022Pointly-Supervised Panoptic Segmentationcited by 20
  11. 2023Monte Carlo Linear Clustering with Single-Point Supervision is Enough for Infrared Small Target Detectioncited by 19
  12. 2022Active Learning Strategies for Weakly-supervised Object Detectioncited by 17
38 more
  1. 2023Shepherding Slots to Objects: Towards Stable and Robust Object-Centric Learningcited by 17
  2. 2022Active Pointly-Supervised Instance Segmentationcited by 15
  3. 2022Interactive Multi-Class Tiny-Object Detectioncited by 14
  4. 2024Frontiers in Intelligent Colonoscopycited by 13
  5. 2022Point-Teaching: Weakly Semi-Supervised Object Detection with Point Annotationscited by 10
  6. 2022Visual Recognition by Requestcited by 10
  7. 2024From Easy to Hard: Progressive Active Learning Framework for Infrared Small Target Detection with Single Point Supervisioncited by 10
  8. 2022SAP-DETR: Bridging the Gap Between Salient Points and Queries-Based Transformer Detector for Fast Model Convergencycited by 9
  9. 2025PointOBB-v3: Expanding Performance Boundaries of Single Point-Supervised Oriented Object Detectioncited by 9
  10. 2022Graph Fusion Network for Multi-Oriented Object Detectioncited by 7
  11. 2022Scaling Novel Object Detection with Weakly Supervised Detection Transformerscited by 7
  12. 2025Wholly-WOOD: Wholly Leveraging Diversified-quality Labels for Weakly-supervised Oriented Object Detectioncited by 6
  13. 2023Semi-supervised Object Detection: A Survey on Recent Research and Progresscited by 5
  14. 2024What is Point Supervision Worth in Video Instance Segmentation?cited by 5
  15. 2023Meta-tuning Loss Functions and Data Augmentation for Few-shot Object Detectioncited by 4
  16. 2024Semi-Supervised Object Detection: A Survey on Progress from CNN to Transformercited by 4
  17. 2024POLO -- Point-based, multi-class animal detectioncited by 4
  18. 2025LiDAR Remote Sensing Meets Weak Supervision: Concepts, Methods, and Perspectivescited by 4
  19. 2024Point-DETR3D: Leveraging Imagery Data with Spatial Point Prior for Weakly Semi-supervised 3D Object Detectioncited by 3
  20. 2024Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Mattingcited by 3
  21. 2025From Sight to Insight: Unleashing Eye-Tracking in Weakly Supervised Video Salient Object Detectioncited by 3
  22. 2025Partial Weakly-Supervised Oriented Object Detectioncited by 3
  23. 2025OmViD: Omni-supervised active learning for video action detectioncited by 3
  24. 2021Frequency Spectrum Augmentation Consistency for Domain Adaptive Object Detectioncited by 2
  25. 2022Semi-Weakly Supervised Object Detection by Sampling Pseudo Ground-Truth Boxescited by 2
  26. 2024On-the-Fly Point Annotation for Fast Medical Video Labelingcited by 2
  27. 2024Boosting Medical Image-based Cancer Detection via Text-guided Supervision from Reportscited by 2
  28. 2024A Point-Neighborhood Learning Framework for Nasal Endoscope Image Segmentationcited by 2
  29. 2022Bounding Box Priors for Cell Detection with Point Annotationscited by 1
  30. 2023Towards Universal Vision-language Omni-supervised Segmentationcited by 1
  31. 2023Deep Omni-supervised Learning for Rib Fracture Detection from Chest Radiology Imagescited by 1
  32. 2023Weakly-semi-supervised object detection in remotely sensed imagerycited by 1
  33. 2024Sparse Generation: Making Pseudo Labels Sparse for Point Weakly Supervised Object Detection on Low Data Volumecited by 1
  34. 2024Detecting Endangered Marine Species in Autonomous Underwater Vehicle Imagery Using Point Annotations and Few-Shot Learningcited by 1
  35. 2024UAVDB: Point-Guided Masks for UAV Detection and Segmentationcited by 1
  36. 2025P2Object: Single Point Supervised Object Detection and Instance Segmentationcited by 1
  37. 2026DExTeR: Weakly Semi-Supervised Object Detection with Class and Instance Experts for Medical Imagingcited by 1
  38. 2026OnPoint: Offline-to-Online Multi-Level Distillation for Point-Supervised Online Temporal Action Localizationcited by 1

50 most cited of 60 All 60 (JSON)