Axolotl3D: a Unified Framework for Faithful 3D Shape Completion
Not on the map. Why?
Abstract (arXiv)
Recent 3D generative models produce high-quality geometry from a single image using large-scale priors and diffusion architectures. However, they assume complete visibility and single-view inputs, limiting applicability in multi-view, occluded, or editing scenarios. Although prior works address these challenges individually, they lack a unified framework for controllable 3D completion under diverse conditioning signals. We present Axolotl3D, a multi-modal and occlusion-aware 3D generation model that jointly conditions on images, visibility masks, camera parameters, and a partial point cloud. The point cloud serves as a geometric anchor promoting faithful shape completion, while camera parameters ensure consistent multi-view alignment in a shared 3D coordinate system. A unified training strategy synthesizes diverse conditioning regimes from large-scale 3D data, enabling robust cross-modal reasoning. Experiments on Toys4K and OmniObject3D demonstrate state-of-the-art performance under both clean and occluded settings, as well as strong results in real-world reconstruction and geometry-consistent editing.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 52 of its 59 references that are in the map. First posted on arXiv 22 Jul 2026.
Builds on
52 of 59 references.
References · 52
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
38 more
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2016Direct Sparse Odometrycited by 479
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 306
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 219
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 162
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
- 2025Native and Compact Structured Latents for 3D Generationcited by 157
- 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 138
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 115
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 113
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
- 2024EscherNet: A Generative Model for Scalable View Synthesiscited by 94
- 20243DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splattingcited by 87
- 2024pix2gestalt: Amodal Segmentation by Synthesizing Wholescited by 70
- 2025Amodal3R: Amodal 3D Reconstruction from Occluded 2D Imagescited by 52
- 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2025ReconViaGen: Towards Accurate Multi-view 3D Object Reconstruction via Generationcited by 30
- 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 27
- 2024Simplicits: Mesh-Free, Geometry-Agnostic, Elastic Simulationcited by 26
- 2026Orient Anything V2: Unifying Orientation and Rotation Understandingcited by 22
- 2025Hunyuan3D-Omni: A Unified Framework for Controllable Generation of 3D Assetscited by 20
- 2026ShapeR: Robust Conditional 3D Shape Generation from Casual Capturescited by 19
- 2025VoMP: Predicting Volumetric Mechanical Property Fieldscited by 13
- 2025DeOcc-1-to-3: 3D De-Occlusion from a Single Image via Self-Supervised Multi-View Diffusioncited by 10
- 2026VecSet-Edit: Unleashing Pre-trained LRM for Mesh Editing from Single Imagecited by 4
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.