mlsanityData to 7 Oct 2026

Global Pose Control for Generative View Synthesis in Normalized Object Coordinate Space

arXiv 2607.02712 ↗First posted 2 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Novel View Synthesis (NVS) enables the generation of unseen views of a scene from a single or multiple images, allowing users to freely explore an object from any viewpoint. Despite the recent impressive qualitative improvements of generative models for this task, existing methods struggle to provide global and intuitive control of target viewpoints because they either use input-relative camera poses or are limited to generating sparse global views. This lack of global pose control severely limits the number of downstream tasks potentially enabled by NVS. To address this limitation, we propose a novel approach for precise camera control in a customizable Normalized Object Coordinate Space (NOCS), requiring single or few unposed images. Our method operates solely on the absolute camera pose of the target view in NOCS, eliminating the need for a relative world frame or camera poses of the input images. Unlike previous methods that treat NVS as a standalone generation task, we formulate it as an image editing problem and build upon state-of-the-art editing models to leverage their superior generalization capability. Camera information is injected as dedicated camera tokens via an in-context multi-modal conditioning strategy. To alleviate the inherent ambiguity of NOCS, we incorporate text descriptions that explicitly define the object's canonical coordinate frame, which also enhances generalization to unseen object categories. Furthermore, we curate a high-quality dataset with consistently aligned orientations and corresponding NOCS text definitions. Extensive experiments demonstrate that our method robustly generates novel views with accurate and consistent orientations from arbitrary unposed images across diverse categories, achieving state-of-the-art image quality and fidelity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 76 of its 84 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

76 of 84 references.

References · 76

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  8. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  9. 2022Generative Adversarial Networkscited by 5,603
  10. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  12. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
38 more
  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  3. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
  4. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  5. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  6. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  7. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
  8. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
  9. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  10. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  11. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  12. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  13. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  14. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  15. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
  16. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  17. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  18. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
  19. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  20. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  21. 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
  22. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  23. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  24. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
  25. 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
  26. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  27. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
  28. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  29. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  30. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
  31. 2022Novel View Synthesis with Diffusion Modelscited by 299
  32. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
  33. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  34. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  35. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
  36. 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 222
  37. 2025Video models are zero-shot learners and reasonerscited by 208
  38. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179

50 most cited of 76 All 76 (JSON)

Built on by

Not cited yet.