Prediction of Scene Plausibility
Not on the map. Why?
Abstract (arXiv)
Understanding the 3D world from 2D images involves more than detection and segmentation of the objects within the scene. It also includes the interpretation of the structure and arrangement of the scene elements. Such understanding is often rooted in recognizing the physical world and its limitations, and in prior knowledge as to how similar typical scenes are arranged. In this research we pose a new challenge for neural network (or other) scene understanding algorithms - can they distinguish between plausible and implausible scenes? Plausibility can be defined both in terms of physical properties and in terms of functional and typical arrangements. Hence, we define plausibility as the probability of encountering a given scene in the real physical world. We build a dataset of synthetic images containing both plausible and implausible scenes, and test the success of various vision models in the task of recognizing and understanding plausibility.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 33 references that are in the map. First posted on arXiv 2 Dec 2022.
Builds on
21 of 33 references.
References · 21
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,430
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2017Cut, Paste and Learn: Surprisingly Easy Synthesis for Instance Detectioncited by 209
- 2019Implicit 3D Orientation Learning for 6D Object Detection from RGB Imagescited by 170
- 2019Effectively Unbiased FID and Inception Score and where to find themcited by 161
- 2018Strike (with) a Pose: Neural Networks Are Easily Fooled by Strange Poses of Familiar Objectscited by 143
- 2017Augmented Reality Meets Computer Vision : Efficient Data Generation for Urban Driving Scenescited by 122
- 2018Modeling Visual Context is Key to Augmenting Object Detection Datasetscited by 106
9 more
- 2020Don't Judge an Object by Its Context: Learning to Overcome Contextual Biascited by 91
- 2018ST-GAN: Spatial Transformer Generative Adversarial Networks for Image Compositingcited by 90
- 2018How good is my GAN?cited by 74
- 2021Shape or Texture: Understanding Discriminative Features in CNNscited by 52
- 2020On the Texture Bias for Few-Shot CNN Segmentationcited by 38
- 2017Weakly-supervised learning of visual relationscited by 36
- 2019Putting visual object recognition in contextcited by 33
- 2021When Pigs Fly: Contextual Reasoning in Synthetic and Natural Scenescited by 23
- 2016How useful is photo-realistic rendering for visual learning?cited by 22
Built on by
Not cited yet.