Global Pose Control for Generative View Synthesis in Normalized Object Coordinate Space
Not on the map. Why?
Abstract (arXiv)
Novel View Synthesis (NVS) enables the generation of unseen views of a scene from a single or multiple images, allowing users to freely explore an object from any viewpoint. Despite the recent impressive qualitative improvements of generative models for this task, existing methods struggle to provide global and intuitive control of target viewpoints because they either use input-relative camera poses or are limited to generating sparse global views. This lack of global pose control severely limits the number of downstream tasks potentially enabled by NVS. To address this limitation, we propose a novel approach for precise camera control in a customizable Normalized Object Coordinate Space (NOCS), requiring single or few unposed images. Our method operates solely on the absolute camera pose of the target view in NOCS, eliminating the need for a relative world frame or camera poses of the input images. Unlike previous methods that treat NVS as a standalone generation task, we formulate it as an image editing problem and build upon state-of-the-art editing models to leverage their superior generalization capability. Camera information is injected as dedicated camera tokens via an in-context multi-modal conditioning strategy. To alleviate the inherent ambiguity of NOCS, we incorporate text descriptions that explicitly define the object's canonical coordinate frame, which also enhances generalization to unseen object categories. Furthermore, we curate a high-quality dataset with consistently aligned orientations and corresponding NOCS text definitions. Extensive experiments demonstrate that our method robustly generates novel views with accurate and consistent orientations from arbitrary unposed images across diverse categories, achieving state-of-the-art image quality and fidelity.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 76 of its 84 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
76 of 84 references.
References · 76
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Generative Adversarial Networkscited by 5,603
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
38 more
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generationcited by 597
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 490
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2018PVNet: Pixel-wise Voting Network for 6DoF Pose Estimationcited by 385
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2022Novel View Synthesis with Diffusion Modelscited by 299
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
- 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 222
- 2025Video models are zero-shot learners and reasonerscited by 208
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
50 most cited of 76 All 76 (JSON)
Built on by
Not cited yet.