Point Diffusion Mamba: Unified Diffusion-State-Space Modeling for Single-View 3D Reconstruction under Data Scarcity
On the map: State-space sequence models (S4, Mamba) → Point clouds, detection and remote sensing also fits: Video, motion and generative Mamba models
Abstract (arXiv)
While single-view 3D reconstruction has seen significant progress, extrapolating complex 3D structures from inherently ambiguous 2D observations remains fundamentally ill-posed, particularly in the critically underexplored data-scarce regime. To address this challenge, we propose Point Diffusion Mamba (PDM), a method that integrates the generative power of diffusion models with the efficiency of state-space model for single-view 3D reconstruction under data-scarce conditions. Specifically, PDM employs a lightweight reconstruction module tailored to handle unordered point-cloud inputs effectively. By combining a Local Geometric Aggregation module with Mamba blocks, our approach jointly models global geometric structures and local details. In 3D reconstruction, each point in the initial noisy input requires a precise prediction, yet the high-level features extracted by the Mamba module capture only abstract semantic information from sparse points. To bridge this gap, we introduce the Hierarchical Feature Integration Network, which fuses high-level semantic and local geometric features for each point, overcoming the limitations of token-based point-cloud reconstruction. Furthermore, we propose a Dynamic Weighted Sampling strategy that adaptively unifies 3D generation with single-view reconstruction by leveraging generative priors to enhance reconstruction quality. Experimental results on the ShapeNet and Pix3D benchmarks demonstrate that PDM outperforms state-of-the-art methods, providing an effective solution for 3D reconstruction under data-scarce settings. Code is available at: https://github.com/NWUzhouwei/PDM.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Point clouds, detection and remote sensing, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 39 of its 47 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
39 of 47 references.
Closest ancestors · 1
Same direction, newest first
Other references · 38
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2024VMamba: Visual State Space Modelcited by 969
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 588
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
26 more
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2018Pix3D: Dataset and Methods for Single-Image 3D Shape Modelingcited by 218
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
- 2024The Mamba in the Llama: Distilling and Accelerating Hybrid Modelscited by 122
- 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generationcited by 110
- 2022Vision Transformer for NeRF-Based View Synthesis from a Single Input Imagecited by 104
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
- 2020Pix2Vox++: Multi-scale Context-aware 3D Object Reconstruction from Single and Multiple Imagescited by 79
- 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 76
- 2023Conditional Text Image Generation with Diffusion Modelscited by 58
- 20223D Shape Reconstruction from 2D Images with Disentangled Attribute Flowcited by 45
- 2023Learned representation-guided diffusion models for large-image generationcited by 40
- 2024SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Modelcited by 37
- 2024Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Modelcited by 35
- 2023DiffFacto: Controllable Part-Based 3D Point Cloud Generation with Cross Diffusioncited by 32
- 2022Pixel2Mesh++: 3D Mesh Generation and Refinement from Multi-View Imagescited by 21
- 2024Hybrid Mamba for Few-Shot Segmentationcited by 21
- 2024Bayesian Diffusion Models for 3D Shape Reconstructioncited by 19
- 2024GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstructioncited by 18
- 2024Hi-Mamba: Hierarchical Mamba for Efficient Image Super-Resolutioncited by 16
- 2022Single-view 3D Mesh Reconstruction for Seen and Unseen Categoriescited by 10
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstructioncited by 10
- 2023Fast Training of Diffusion Transformer with Extreme Masking for 3D Point Clouds Generationcited by 9
- 2023BuilDiff: 3D Building Shape Generation using Single-Image Conditional Point Cloud Diffusion Modelscited by 6
- 20223D-C2FT: Coarse-to-fine Transformer for Multi-view 3D Reconstructioncited by 5
- 2025MESC-3D:Mining Effective Semantic Cues for 3D Reconstruction from a Single Imagecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025TFDM: Time-Variant Frequency-Based Point Cloud Diffusion with Mamba
- 2025Consistency Diffusion Models for Single-Image 3D Reconstruction with Priors
- 2026Points-to-3D: Structure-Aware 3D Generation with Point Cloud Priors
- 2025Adaptive 3D Reconstruction via Diffusion Priors and Forward Curvature-Matching Likelihood Updates
- 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Images
- 2024Efficient 3D Shape Generation via Diffusion Mamba with Bidirectional SSMs
- 2026PointDiT: Pixel-Space Diffusion for Monocular Geometry Estimation
- 2025Simba: Towards High-Fidelity and Geometrically-Consistent Point Cloud Completion via Transformation Diffusion