mlsanityData to 14 Oct 2026

Pose-Aware Diffusion for 3D Generation

arXiv 2605.00345 ↗First posted 1 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Generating pose-aligned 3D objects is challenging due to the spatial mismatches and transformation ambiguities inherent in decoupled canonical-then-rotate paradigms. To this end, we introduce Pose-Aware Diffusion (PAD), a novel end-to-end diffusion framework that synthesizes 3D geometry directly within the observation space. By unprojecting monocular depth into a partial point cloud and explicitly injecting it as a 3D geometric anchor, PAD abandons canonical assumptions to enforce rigorous spatial supervision. This native generation intrinsically resolves pose ambiguity, producing high-fidelity pose-aligned assets. Extensive experiments demonstrate that PAD achieves superior geometric alignment and image-to-3D correspondence compared to state-of-the-art methods. Additionally, PAD naturally extends to compositional 3D scene reconstruction via a simple union of independently generated objects, highlighting its robust ability to preserve precise spatial layouts.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 64 of its 67 references that are in the map. First posted on arXiv 1 May 2026.

Builds on

64 of 67 references.

References · 64

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  7. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  8. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  9. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  11. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  12. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
38 more
  1. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  3. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  4. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  5. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  6. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  7. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  8. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
  9. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 612
  10. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  11. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 521
  12. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  13. 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 455
  14. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  15. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 429
  16. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  17. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  18. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  19. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  20. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  21. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  22. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  23. 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
  24. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
  25. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 257
  26. 2025SAM 3D: 3Dfy Anything in Imagescited by 247
  27. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
  28. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
  29. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  30. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  31. 2025Native and Compact Structured Latents for 3D Generationcited by 175
  32. 2020Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes from a Single Imagecited by 172
  33. 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
  34. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
  35. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
  36. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  37. 2024MIDI: Multi-Instance Diffusion for Single Image to 3D Scene Generationcited by 117
  38. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 106

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.