Pose-Aware Diffusion for 3D Generation
Not on the map. Why?
Abstract (arXiv)
Generating pose-aligned 3D objects is challenging due to the spatial mismatches and transformation ambiguities inherent in decoupled canonical-then-rotate paradigms. To this end, we introduce Pose-Aware Diffusion (PAD), a novel end-to-end diffusion framework that synthesizes 3D geometry directly within the observation space. By unprojecting monocular depth into a partial point cloud and explicitly injecting it as a 3D geometric anchor, PAD abandons canonical assumptions to enforce rigorous spatial supervision. This native generation intrinsically resolves pose ambiguity, producing high-fidelity pose-aligned assets. Extensive experiments demonstrate that PAD achieves superior geometric alignment and image-to-3D correspondence compared to state-of-the-art methods. Additionally, PAD naturally extends to compositional 3D scene reconstruction via a simple union of independently generated objects, highlighting its robust ability to preserve precise spatial layouts.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 64 of its 67 references that are in the map. First posted on arXiv 1 May 2026.
Builds on
64 of 67 references.
References · 64
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
38 more
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2025Native and Compact Structured Latents for 3D Generationcited by 175
- 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 172
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
- 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2023WonderJourney: Going from Anywhere to Everywherecited by 158
- 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106
50 most cited of 64 All 64 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.