mlsanityData to 7 Oct 2026

Deep Learning from Parametrically Generated Virtual Buildings for Real-World Object Recognition

arXiv 2302.05283 ↗First posted 3 Jan 2023cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We study the use of parametric building information modeling (BIM) to automatically generate training data for artificial neural networks (ANNs) to recognize building objects in photos. Teaching artificial intelligence (AI) machines to detect building objects in images is the foundation toward AI-assisted semantic 3D reconstruction of existing buildings. However, there exists the challenge of acquiring training data which is typically human-annotated, that is, unless a computer machine can generate high-quality data to train itself for a certain task. In that vein, we trained ANNs solely on realistic computer-generated images of 3D BIM models which were parametrically and automatically generated using the BIMGenE program. The ANN training result demonstrated generalizability and good semantic segmentation on a test case as well as arbitrary photos of buildings that are outside the range of the training data, which is significant for the future of training AI with generated data for solving real-world architectural problems.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 39 references that are in the map. First posted on arXiv 3 Jan 2023.

Builds on

15 of 39 references.

References · 15

  1. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  2. 2016Pyramid Scene Parsing Networkcited by 2,472
  3. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  4. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  5. 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
  6. 2017Generative Adversarial Networks: An Overviewcited by 588
  7. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  8. 2017Learning from Synthetic Humanscited by 358
  9. 2020How Neural Networks Extrapolate: From Feedforward to Graph Neural Networkscited by 218
  10. 2016Unrolled Generative Adversarial Networkscited by 208
  11. 2016IM2CADcited by 78
  12. 2018Theoretical Impediments to Machine Learning With Seven Sparks from the Causal Revolutioncited by 66
3 more
  1. 2017Synthesizing Training Data for Object Detection in Indoor Scenescited by 48
  2. 2016Physically-Based Rendering for Indoor Scene Understanding Using Convolutional Neural Networkscited by 35
  3. 2021BIM Hyperreality: Data Synthesis Using BIM and Hyperrealistic Rendering for Deep Learningcited by 1

Built on by

Not cited yet.