mlsanityData to 14 Oct 2026

SE-MD: A Single-encoder multiple-decoder deep network for point cloud generation from 2D images

arXiv 2106.15325 ↗First posted 17 Jun 2021cs.CV cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

3D model generation from single 2D RGB images is a challenging and actively researched computer vision task. Various techniques using conventional network architectures have been proposed for the same. However, the body of research work is limited and there are various issues like using inefficient 3D representation formats, weak 3D model generation backbones, inability to generate dense point clouds, dependence of post-processing for generation of dense point clouds, and dependence on silhouettes in RGB images. In this paper, a novel 2D RGB image to point cloud conversion technique is proposed, which improves the state of art in the field due to its efficient, robust and simple model by using the concept of parallelization in network architecture. It not only uses the efficient and rich 3D representation of point clouds, but also uses a novel and robust point cloud generation backbone in order to address the prevalent issues. This involves using a single-encoder multiple-decoder deep network architecture wherein each decoder generates certain fixed viewpoints. This is followed by fusing all the viewpoints to generate a dense point cloud. Various experiments are conducted on the technique and its performance is compared with those of other state of the art techniques and impressive gains in performance are demonstrated. Code is available at https://github.com/mueedhafiz1982/

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 44 references that are in the map. First posted on arXiv 17 Jun 2021.

Builds on

31 of 44 references.

References · 31

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  3. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  4. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  5. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  6. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  7. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
  8. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
  9. 2019Deep Learning for 3D Point Clouds: A Surveycited by 558
  10. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  11. 2018PCN: Point Completion Networkcited by 384
  12. 2019From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Networkcited by 368
19 more
  1. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  2. 2016Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesiscited by 219
  3. 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
  4. 2017Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputscited by 189
  5. 2017Learning Efficient Point Cloud Generation for Dense 3D Object Reconstructioncited by 133
  6. 2018Visual Object Networks: Image Generation with Disentangled 3D Representationcited by 124
  7. 2020Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Reviewcited by 108
  8. 2016Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervisioncited by 106
  9. 2017Hierarchical Surface Prediction for 3D Object Reconstructioncited by 89
  10. 2018Learning to Reconstruct Shapes from Unseen Classescited by 60
  11. 2015Multi-view 3D Models from Single Images with a Convolutional Networkcited by 58
  12. 2018Multi-view Consistency as Supervisory Signal for Learning Shape and Pose Predictioncited by 52
  13. 20183D-LMNet: Latent Embedding Matching for Accurate and Diverse 3D Point Cloud Reconstruction from a Single Imagecited by 40
  14. 2019Dense 3D Point Cloud Reconstruction Using a Deep Pyramid Networkcited by 33
  15. 2019Multiview Aggregation for Learning Category-Specific Shape Reconstructioncited by 12
  16. 2018Inferring Point Clouds from Single Monocular Images by Depth Intermediationcited by 7
  17. 2019Learning to Generate Dense Point Clouds with Textures on Multiple Categoriescited by 6
  18. 2019Silhouette Guided Point Cloud Reconstruction beyond Occlusioncited by 3
  19. 2019Learning Occlusion-Aware View Synthesis for Light Fieldscited by 1

Built on by

Not cited yet.