mlsanityData to 7 Oct 2026

From Flat to Spatial: Comparison of 4 methods constructing 3D, 2 and 1/2D Models from 2D Plans with neural networks

arXiv 2407.19970 ↗First posted 29 Jul 2024cs.GR cs.CV cs.ETcited by 0

Not on the map. Why?

Abstract (arXiv)

In the field of architecture, the conversion of single images into 2 and 1/2D and 3D meshes is a promising technology that enhances design visualization and efficiency. This paper evaluates four innovative methods: "One-2-3-45," "CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Model," "Instant Mesh," and "Image-to-Mesh." These methods are at the forefront of this technology, focusing on their applicability in architectural design and visualization. They streamline the creation of 3D architectural models, enabling rapid prototyping and detailed visualization from minimal initial inputs, such as photographs or simple sketches.One-2-3-45 leverages a diffusion-based approach to generate multi-view reconstructions, ensuring high geometric fidelity and texture quality. CRM utilizes a convolutional network to integrate geometric priors into its architecture, producing detailed and textured meshes quickly and efficiently. Instant Mesh combines the strengths of multi-view diffusion and sparse-view models to offer speed and scalability, suitable for diverse architectural projects. Image-to-Mesh leverages a generative adversarial network (GAN) to produce 3D meshes from single images, focusing on maintaining high texture fidelity and geometric accuracy by incorporating image and depth map data into its training process. It uses a hybrid approach that combines voxel-based representations with surface reconstruction techniques to ensure detailed and realistic 3D models.This comparative study highlights each method's contribution to reducing design cycle times, improving accuracy, and enabling flexible adaptations to various architectural styles and requirements. By providing architects with powerful tools for rapid visualization and iteration, these advancements in 3D mesh generation are set to revolutionize architectural practices.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 23 references that are in the map. First posted on arXiv 29 Jul 2024.

Builds on

21 of 23 references.

References · 21

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
  4. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  5. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  6. 2016Semantic Scene Completion from a Single Depth Imagecited by 468
  7. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  8. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  9. 2023Text-to-3D using Gaussian Splattingcited by 299
  10. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  11. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  12. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
9 more
  1. 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
  2. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  3. 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
  4. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
  5. 2023Text-to-3D with Classifier Score Distillationcited by 127
  6. 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 109
  7. 2019Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networkscited by 106
  8. 2023IT3D: Improved Text-to-3D Generation with Explicit View Synthesiscited by 63
  9. 2024MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusioncited by 22

Built on by

Not cited yet.