M3D: Dual-Stream Selective State Spaces and Depth-Driven Framework for High-Fidelity Single-View 3D Reconstruction
Not on the map. Why?
Abstract (arXiv)
The precise reconstruction of 3D objects from a single RGB image in complex scenes presents a critical challenge in virtual reality, autonomous driving, and robotics. Existing neural implicit 3D representation methods face significant difficulties in balancing the extraction of global and local features, particularly in diverse and complex environments, leading to insufficient reconstruction precision and quality. We propose M3D, a novel single-view 3D reconstruction framework, to tackle these challenges. This framework adopts a dual-stream feature extraction strategy based on Selective State Spaces to effectively balance the extraction of global and local features, thereby improving scene comprehension and representation precision. Additionally, a parallel branch extracts depth information, effectively integrating visual and geometric features to enhance reconstruction quality and preserve intricate details. Experimental results indicate that the fusion of multi-scale features with depth information via the dual-branch feature extraction significantly boosts geometric consistency and fidelity, achieving state-of-the-art reconstruction performance.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 19 Nov 2024.
Builds on
26 of 37 references.
References · 26
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
14 more
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 327
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 260
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2016Volumetric and Multi-View CNNs for Object Classification on 3D Datacited by 240
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 224
- 2024CRM: Single Image to 3D Textured Mesh with Convolutional Reconstruction Modelcited by 215
- 2017Multi-view Supervision for Single-view Reconstruction via Differentiable Ray Consistencycited by 177
- 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 172
- 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 135
- 2018PlaneRCNN: 3D Plane Detection and Reconstruction from a Single Imagecited by 105
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 44
- 2023Single-view 3D Scene Reconstruction with High-fidelity Shape and Texturecited by 37
- 20213D-RETR: End-to-End Single and Multi-View 3D Reconstruction with Transformerscited by 15
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025DeepWheel: Generating a 3D Synthetic Wheel Dataset for Design and Performance Evaluationcited by 3
- 2026MGP-KAD: Multimodal Geometric Priors and Kolmogorov-Arnold Decoder for Single-View 3D Reconstruction in Complex Scenescited by 0
- 2026MetaSSP: Enhancing Semi-supervised Implicit 3D Reconstruction through Meta-adaptive EMA and SDF-aware Pseudo-label Evaluationcited by 0
- 2026MetaSSP: Enhancing Semi-supervised Implicit 3D Reconstruction through Meta-adaptive EMA and SDF-aware Pseudo-label Evaluation5 Feb 2026
- 2026MGP-KAD: Multimodal Geometric Priors and Kolmogorov-Arnold Decoder for Single-View 3D Reconstruction in Complex Scenes5 Feb 2026
- 2025DeepWheel: Generating a 3D Synthetic Wheel Dataset for Design and Performance Evaluation15 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2024MVD-Fusion: Single-view 3D via Depth-consistent Multi-view Generation
- 2025Dream-to-Recon: Monocular 3D Reconstruction with Diffusion-Depth Distillation from Single Images
- 2024MVDiff: Scalable and Flexible Multi-View Diffusion for 3D Object Reconstruction from Single-View
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction
- 2024Part123: Part-aware 3D Reconstruction from a Single-view Image
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective
- 2024MVDiffusion++: A Dense High-resolution Multi-view Diffusion Model for Single or Sparse-view 3D Object Reconstruction
- 2026Stream3Dv2: Geometric-Semantic Fusion Enhanced Streaming Zero-Shot 3D Scene Understanding