ConfCtrl: Enabling Precise Camera Control in Video Diffusion via Confidence-Aware Interpolation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We address the challenge of novel view synthesis from only two input images under large viewpoint changes. Existing regression-based methods lack the capacity to reconstruct unseen regions, while camera-guided diffusion models often deviate from intended trajectories due to noisy point cloud projections or insufficient conditioning from camera poses. To address these issues, we propose ConfCtrl, a confidence-aware video interpolation framework that enables diffusion models to follow prescribed camera poses while completing unseen regions. ConfCtrl initializes the diffusion process by combining a confidence-weighted projected point cloud latent with noise as the conditioning input. It then applies a Kalman-inspired predict-update mechanism, treating the projected point cloud as a noisy measurement and using learned residual corrections to balance pose-driven predictions with noisy geometric observations. This allows the model to rely on reliable projections while down-weighting uncertain regions, yielding stable, geometry-aware generation. Experiments on multiple datasets show that ConfCtrl produces geometrically consistent and visually plausible novel views, effectively reconstructing occluded regions under large viewpoint changes.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 63 of its 75 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
63 of 75 references.
Closest ancestors · 18
Same direction, newest first
- 2026Gen3R: 3D Scene Generation Meets Feed-Forward Reconstruction7 Jan
- 2025Lightweight and Accurate Multi-View Stereo with Confidence-Aware Diffusion Model18 Sep
- 2025CausNVS: Autoregressive Multi-view Diffusion for Flexible 3D Novel View Synthesis8 Sep
- 2025IDCNet: Guided Video Diffusion for Metric-Consistent RGBD Scene Generation with Precise Camera Control6 Aug
- 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation4 Jun
- 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations17 May
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models18 Mar
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors17 Mar
- 2024Wonderland: Navigating 3D Scenes from a Single Image16 Dec
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models27 Nov
- 2024SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis25 Nov
- 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion7 Nov
6 more
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors21 Oct
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
- 2024ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model29 Aug
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
- 2023DifFlow3D: Toward Robust Uncertainty-Aware Scene Flow Estimation with Diffusion Model29 Nov
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov
Other references · 45
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Depth Anything V2cited by 1,385
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
33 more
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 278
- 2025Diffusion Transformers with Representation Autoencoderscited by 275
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2023Exposing flaws of generative model evaluation metrics and their unfair treatment of diffusion modelscited by 199
- 2024LVSM: A Large View Synthesis Model with Minimal 3D Inductive Biascited by 178
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
- 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 151
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 122
- 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
- 2024Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splatscited by 111
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 111
- 2025Latent Diffusion Model without Variational Autoencodercited by 83
- 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 75
- 2024TranSplat: Generalizable 3D Gaussian Splatting from Sparse Multi-View Images with Transformerscited by 71
- 2024InstantSplat: Sparse-view Gaussian Splatting in Secondscited by 67
- 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videoscited by 41
- 2024SelfSplat: Pose-Free and 3D Prior-Free Generalizable 3D Gaussian Splattingcited by 40
- 2025No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse Viewscited by 38
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2024Epipolar-Free 3D Gaussian Splatting for Generalizable Novel View Synthesiscited by 18
- 2024Modeling uncertainty for Gaussian Splattingcited by 17
- 2024Modeling Uncertainty in 3D Gaussian Splatting through Continuous Semantic Splattingcited by 12
- 2025VideoRFSplat: Direct Scene-Level Text-to-3D Gaussian Splatting Generation with Flexible Pose and Multi-View Joint Modelingcited by 12
- 2025These Magic Moments: Differentiable Uncertainty Quantification of Radiance Field Modelscited by 6
- 2025Uncertainty-Aware Normal-Guided Gaussian Splatting for Surface Reconstruction from Sparse Image Sequencescited by 5
- 2025View-Dependent Uncertainty Estimation of 3D Gaussian Splattingcited by 5
- 2025Uncertainty-Aware Diffusion Guided Refinement of 3D Scenescited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Stabilizing Camera-Controlled Novel View Synthesis at Inference Time
- 2024CamI2V: Camera-Controlled Image-to-Video Diffusion Model
- 2026VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis
- 2026Probing into Camera Control of Video Models
- 2024Controlling Space and Time with Diffusion Models
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Models
- 2026Landscape-Awareness for Geometric View Diffusion Model