mlsanityData to 14 Oct 2026

Novel 3D Scene Understanding Applications From Recurrence in a Single Image

arXiv 2210.07991 ↗First posted 14 Oct 2022cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

We demonstrate the utility of recurring pattern discovery from a single image for spatial understanding of a 3D scene in terms of (1) vanishing point detection, (2) hypothesizing 3D translation symmetry and (3) counting the number of RP instances in the image. Furthermore, we illustrate the feasibility of leveraging RP discovery output to form a more precise, quantitative text description of the scene. Our quantitative evaluations on a new 1K+ Recurring Pattern (RP) benchmark with diverse variations show that visual perception of recurrence from one single view leads to scene understanding outcomes that are as good as or better than existing supervised methods and/or unsupervised methods that use millions of images.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 37 of its 85 references that are in the map. First posted on arXiv 14 Oct 2022.

Builds on

37 of 85 references.

References · 37

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  4. 2016Densely Connected Convolutional Networkscited by 6,720
  5. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  6. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,462
  7. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
  8. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,382
  9. 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,312
  10. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,214
  11. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 808
  12. 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
25 more
  1. 2019Unified Vision-Language Pre-Training for Image Captioning and VQAcited by 494
  2. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 346
  3. 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 230
  4. 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 168
  5. 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 156
  6. 2021Learning To Count Everythingcited by 150
  7. 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 138
  8. 2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
  9. 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 107
  10. 2018Class-Agnostic Countingcited by 85
  11. 2022Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Countingcited by 80
  12. 2015Unsupervised Object Discovery and Localization in the Wild: Part-based Matching with Bottom-up Region Proposalscited by 69
  13. 2020Counting Out Time: Class Agnostic Video Repetition Counting in the Wildcited by 68
  14. 2020Toward unsupervised, multi-object discovery in large-scale image collectionscited by 65
  15. 2019Precise Detection in Densely Packed Scenescited by 63
  16. 2021Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimationcited by 63
  17. 2021Large-Scale Unsupervised Object Discoverycited by 54
  18. 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
  19. 2022Spatiality-guided Transformer for 3D Dense Captioning on Point Cloudscited by 40
  20. 2020OS2D: One-Stage One-Shot Object Detection by Matching Anchor Featurescited by 35
  21. 2020Towards Using Count-level Weak Supervision for Crowd Countingcited by 33
  22. 2019NeurVPS: Neural Vanishing Point Scanning via Conic Convolutioncited by 24
  23. 2020Single View Metrology in the Wildcited by 20
  24. 2016Detecting Dominant Vanishing Points in Natural Scenes with Application to Composition-Sensitive Image Retrievalcited by 11
  25. 2019Detecting Repeating Objects using Patch Correlation Analysiscited by 3

Built on by

Cited by year

Citing papers per year: 2024: 1.

1 paper.

  1. 2024Recurrence-based Vanishing Point Detectioncited by 1