PRISM3D: Probabilistic Refinement and Robust Initialization for Physically Consistent Scene Modeling under Extreme Motion Blur
Not on the map. Why?
Abstract (arXiv)
We address the inverse problem of blind 3D scene reconstruction from extremely motion-blurred images, a scenario where traditional Structure-from-Motion (SfM) pipelines fail. Existing approaches typically circumvent this bottleneck by relying on impractical sharp-image supervision. In this work, we introduce PRISM3D, a unified framework enabling robust reconstruction directly from severely degraded inputs. To overcome the lack of a reliable starting point, we propose a Robust Initialization strategy utilizing deep dense tracking method (VGGSfM) to recover global topology where feature matching fails. To the best of our knowledge, we are the first to effectively leverage this paradigm to bootstrap 3D Gaussian Splatting from extreme motion blur. However, while robust, this initialization yields sparse and noisy geometry that causes deterministic optimization to diverge. To resolve this, we propose a coupled solution driven by probability and physics: we adopt a probabilistic formulation for geometric densification via Markov Chain Monte Carlo (MCMC) to robustly populate the sparse priors, while simultaneously modeling physical image formation via continuous Bezier Trajectories. Furthermore, while PRISM3D establishes a highly robust standalone pipeline, the availability of complementary event streams offers an opportunity to push the reconstruction fidelity further. To exploit this, we introduce PRISM3D-E, a multi-modal (RGB + Events) extension that seamlessly integrates high-temporal-resolution events as structural priors to maximize geometric recovery. Because existing datasets lack paired event streams under such severe degradation, we concurrently contribute the PRISM3D-E Benchmark to facilitate rigorous evaluation. Extensive experiments demonstrate that both our standalone RGB framework and its multi-modal extension establish new state-of-the-art performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 43 references that are in the map. First posted on arXiv 4 Jul 2026.
Builds on
34 of 43 references.
References · 34
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
22 more
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 556
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2020Image Matching across Wide Baselines: From Paper to Practicecited by 224
- 2024Global Structure-from-Motion Revisitedcited by 215
- 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210
- 2020AutoInt: Automatic Integration for Fast Neural Volume Renderingcited by 204
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2018Bringing a Blurry Frame Alive at High Frame-Rate with an Event Cameracited by 141
- 2022BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fieldscited by 80
- 2024BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splattingcited by 61
- 2021DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Renderingcited by 60
- 2024EvaGaussians: Event Stream Assisted Gaussian Splatting from Blurry Imagescited by 56
- 2023ExBluRF: Efficient Radiance Fields for Extreme Motion Blurred Imagescited by 38
- 2022AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Trainingcited by 31
- 2024E2GS: Event Enhanced Gaussian Splattingcited by 26
- 2024Deblurring Neural Radiance Fields with Event-driven Bundle Adjustmentcited by 15
- 2025VGGT-X: When VGGT Meets Dense Novel View Synthesiscited by 8
Built on by
Not cited yet.