mlsanityData to 7 Oct 2026

WarpHammer: Densifying Scene Warps with 3D Object Priors for Extreme View Synthesis

arXiv 2606.31258 ↗First posted 30 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Projection-conditioned novel view synthesis (NVS) warps an explicit 3D reconstruction of the input view into the target camera and conditions a generator on the warped rendering. This works well for small viewpoint changes but degrades sharply under large orbital motion: the warp becomes sparse around the orbited object, where hidden surfaces dominate the new view and mirror-like artifacts emerge, causing the generator to lose both pixel content and the implicit camera cue carried by the warp. We introduce WarpHammer, a training-free framework that resolves this failure mode by augmenting the warped scene with an explicit 3D reconstruction of the object obtained from a native 3D generative prior (e.g., SAM3D). The reconstructed object adds missing foreground surfaces and occludes background points that should no longer be visible, restoring both appearance and camera cues without fine-tuning the base model. The same explicit object representation further unlocks a capability current NVS pipelines do not support: incorporating auxiliary views of the object from sources outside the target scene, for example, a casual snapshot of a car paired with a manufacturer studio shot of the same model. We process the reference and auxiliary images jointly with a pretrained multi-view geometry foundation model, which predicts a unified point cloud that we fuse into the 3D object reconstruction. This yields substantially more faithful geometry than single-image reconstruction, without requiring user-provided camera poses for the auxiliary views. On five benchmarks, WarpHammer produces stable novel views at viewpoint deviations where strong baselines collapse, and is the first scene-level NVS method that can naturally fuse auxiliary, pose-unknown object views from an external source.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 59 of its 65 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

59 of 65 references.

References · 59

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  5. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  8. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  9. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  10. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  11. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
  1. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  2. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  3. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  4. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  5. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
  6. 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 638
  7. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  8. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  9. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
  10. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 530
  11. 2025VACE: All-in-One Video Creation and Editingcited by 467
  12. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  13. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 425
  14. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  15. 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
  16. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 342
  17. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
  18. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  19. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
  20. 2025SAM 3D: 3Dfy Anything in Imagescited by 230
  21. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
  22. 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 179
  23. 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
  24. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  25. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  26. 2020Objectron: A Large Scale Dataset of Object-Centric Videos in the Wild with Pose Annotationscited by 155
  27. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
  28. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  29. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  30. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  31. 2025CameraCtrl II: Dynamic Scene Exploration via Camera-controlled Video Diffusion Modelscited by 97
  32. 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 74
  33. 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
  34. 2025RealCam-I2V: Real-World Image-to-Video Generation with Interactive Complex Camera Controlcited by 54
  35. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
  36. 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 44
  37. 2025FlexWorld: Progressively Expanding 3D Scenes for Flexiable-View Synthesiscited by 37
  38. 2025EX-4D: EXtreme Viewpoint 4D Video Synthesis via Depth Watertight Meshcited by 32

50 most cited of 59 All 59 (JSON)

Built on by

Not cited yet.