Pixal3D: Pixel-Aligned 3D Generation from Images
Not on the map. Why?
Abstract (arXiv)
Recent advances in 3D generative models have rapidly improved image-to-3D synthesis quality, enabling higher-resolution geometry and more realistic appearance. Yet fidelity, which measures pixel-level faithfulness of the generated 3D asset to the input image, still remains a central bottleneck. We argue this stems from an implicit 2D-3D correspondence issue: most 3D-native generators synthesize shape in canonical space and inject image cues via attention, leaving pixel-to-3D associations ambiguous. To tackle this issue, we draw inspiration from 3D reconstruction and propose Pixal3D, a pixel-aligned 3D generation paradigm for high-fidelity 3D asset creation from images. Instead of generating in a canonical pose, Pixal3D directly generates 3D in a pixel-aligned way, consistent with the input view. To enable this, we introduce a pixel back-projection conditioning scheme that explicitly lifts multi-scale image features into a 3D feature volume, establishing direct pixel-to-3D correspondence without ambiguity. We show that Pixal3D is not only scalable and capable of producing high-quality 3D assets, but also substantially improves fidelity, approaching the fidelity level of reconstruction. Furthermore, Pixal3D naturally extends to multi-view generation by aggregating back-projected feature volumes across views. Finally, we show pixel-aligned generation benefits scene synthesis, and present a modular pipeline that produces high-fidelity, object-separated 3D scenes from images. Pixal3D for the first time demonstrates 3D-native pixel-aligned generation at scale, and provides a new inspiring way towards high-fidelity 3D generation of object or scene from single or multi-view images. Project page: https://ldyang694.github.io/projects/pixal3d/
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 35 of its 70 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
35 of 70 references.
References · 35
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
23 more
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
- 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 199
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
- 2019DPSNet: End-to-end Deep Plane Sweep Stereocited by 115
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 115
- 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
- 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
- 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
- 2025Bolt3D: Generating 3D Scenes in Secondscited by 57
- 2024TEXGen: a Generative Diffusion Model for Mesh Texturescited by 46
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstructioncited by 24
- 2025LaRI: Layered Ray Intersections for Single-view 3D Geometric Reasoningcited by 7
- 2025NAF: Zero-Shot Feature Upsampling via Neighborhood Attention Filteringcited by 6
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 7
- 2026GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstructioncited by 3
- 2026WorldSculpt: Generating Compositional Worlds from Grounded Videoscited by 2
- 2026DreamCharacter-1: From 3D Generative Foundation Models to Product-Ready Character Generationcited by 1
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Imagecited by 0
- 2026ReconPlusGen: Injecting Reconstruction Prior into Multi-view 3D Generation through Noise Inversion and Modulationcited by 0
- 2026TopoRig: Topology-Agnostic Facial Rigging via Multi-Source Supervisioncited by 0
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generationcited by 0
- 2026Texture Space Material Diffusioncited by 0
- 2026SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Imagescited by 0
- 20264Director: Controlling Video World Models with Rigid 3D Geometrycited by 0
- 20264Director: Controlling Video World Models with Rigid 3D Geometry1 Oct 2026
- 2026SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images30 Sep 2026
- 2026Texture Space Material Diffusion29 Sep 2026
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generation28 Sep 2026
- 2026TopoRig: Topology-Agnostic Facial Rigging via Multi-Source Supervision14 Sep 2026
- 2026ReconPlusGen: Injecting Reconstruction Prior into Multi-view 3D Generation through Noise Inversion and Modulation10 Sep 2026
- 2026WorldSculpt: Generating Compositional Worlds from Grounded Videos4 Sep 2026
- 2026DreamCharacter-1: From 3D Generative Foundation Models to Product-Ready Character Generation8 Jul 2026
- 2026InSpace: Structure-Aware 3D Indoor Scene Generation from a Single 360deg Image4 Jul 2026
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformation26 May 2026
- 2026GenRecon: Bridging Generative Priors for Multi-View 3D Scene Reconstruction22 May 2026