mlsanityData to 7 Oct 2026

Pixal3D: Pixel-Aligned 3D Generation from Images

arXiv 2605.10922 ↗First posted 11 May 2026cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Recent advances in 3D generative models have rapidly improved image-to-3D synthesis quality, enabling higher-resolution geometry and more realistic appearance. Yet fidelity, which measures pixel-level faithfulness of the generated 3D asset to the input image, still remains a central bottleneck. We argue this stems from an implicit 2D-3D correspondence issue: most 3D-native generators synthesize shape in canonical space and inject image cues via attention, leaving pixel-to-3D associations ambiguous. To tackle this issue, we draw inspiration from 3D reconstruction and propose Pixal3D, a pixel-aligned 3D generation paradigm for high-fidelity 3D asset creation from images. Instead of generating in a canonical pose, Pixal3D directly generates 3D in a pixel-aligned way, consistent with the input view. To enable this, we introduce a pixel back-projection conditioning scheme that explicitly lifts multi-scale image features into a 3D feature volume, establishing direct pixel-to-3D correspondence without ambiguity. We show that Pixal3D is not only scalable and capable of producing high-quality 3D assets, but also substantially improves fidelity, approaching the fidelity level of reconstruction. Furthermore, Pixal3D naturally extends to multi-view generation by aggregating back-projected feature volumes across views. Finally, we show pixel-aligned generation benefits scene synthesis, and present a modular pipeline that produces high-fidelity, object-separated 3D scenes from images. Pixal3D for the first time demonstrates 3D-native pixel-aligned generation at scale, and provides a new inspiring way towards high-fidelity 3D generation of object or scene from single or multi-view images. Project page: https://ldyang694.github.io/projects/pixal3d/

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 35 of its 70 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

35 of 70 references.

References · 35

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  3. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  4. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  5. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  6. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
  7. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  8. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  9. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  10. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
  11. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
  12. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
23 more
  1. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
  2. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
  3. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  4. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
  5. 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
  6. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
  7. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  8. 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
  9. 2020Atlas: End-to-End 3D Scene Reconstruction from Posed Imagescited by 206
  10. 2023ULIP-2: Towards Scalable Multimodal Pre-training for 3D Understandingcited by 199
  11. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
  12. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 157
  13. 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
  14. 2019DPSNet: End-to-end Deep Plane Sweep Stereocited by 115
  15. 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 115
  16. 2025Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attentioncited by 103
  17. 2025Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modelingcited by 84
  18. 2025OmniPart: Part-Aware 3D Generation with Semantic Decoupling and Structural Cohesioncited by 60
  19. 2025Bolt3D: Generating 3D Scenes in Secondscited by 57
  20. 2024TEXGen: a Generative Diffusion Model for Mesh Texturescited by 46
  21. 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstructioncited by 24
  22. 2025LaRI: Layered Ray Intersections for Single-view 3D Geometric Reasoningcited by 7
  23. 2025NAF: Zero-Shot Feature Upsampling via Neighborhood Attention Filteringcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.