WarpHammer: Densifying Scene Warps with 3D Object Priors for Extreme View Synthesis
Not on the map. Why?
Abstract (arXiv)
Projection-conditioned novel view synthesis (NVS) warps an explicit 3D reconstruction of the input view into the target camera and conditions a generator on the warped rendering. This works well for small viewpoint changes but degrades sharply under large orbital motion: the warp becomes sparse around the orbited object, where hidden surfaces dominate the new view and mirror-like artifacts emerge, causing the generator to lose both pixel content and the implicit camera cue carried by the warp. We introduce WarpHammer, a training-free framework that resolves this failure mode by augmenting the warped scene with an explicit 3D reconstruction of the object obtained from a native 3D generative prior (e.g., SAM3D). The reconstructed object adds missing foreground surfaces and occludes background points that should no longer be visible, restoring both appearance and camera cues without fine-tuning the base model. The same explicit object representation further unlocks a capability current NVS pipelines do not support: incorporating auxiliary views of the object from sources outside the target scene, for example, a casual snapshot of a car paired with a manufacturer studio shot of the same model. We process the reference and auxiliary images jointly with a pretrained multi-view geometry foundation model, which predicts a unified point cloud that we fuse into the 3D object reconstruction. This yields substantially more faithful geometry than single-image reconstruction, without requiring user-provided camera poses for the auxiliary views. On five benchmarks, WarpHammer produces stable novel views at viewpoint deviations where strong baselines collapse, and is the first scene-level NVS method that can naturally fuse auxiliary, pose-unknown object views from an external source.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 59 of its 65 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
59 of 65 references.
References · 59
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
- 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
- 2020Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotationscited by 155
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 74
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 54
- 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
- 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 44
- 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesiscited by 37
- 2025EX-4D: EXtreme Viewpoint 4D Video Synthesis via Depth Watertight Meshcited by 32
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.