ReMatching Dynamic Reconstruction Flow
Not on the map. Why?
Abstract (arXiv)
Reconstructing a dynamic scene from image inputs is a fundamental computer vision task with many downstream applications. Despite recent advancements, existing approaches still struggle to achieve high-quality reconstructions from unseen viewpoints and timestamps. This work introduces the ReMatching framework, designed to improve reconstruction quality by incorporating deformation priors into dynamic reconstruction models. Our approach advocates for velocity-field based priors, for which we suggest a matching procedure that can seamlessly supplement existing dynamic reconstruction pipelines. The framework is highly adaptable and can be applied to various dynamic representations. Moreover, it supports integrating multiple types of model priors and enables combining simpler ones to create more complex classes. Our evaluations on popular benchmarks involving both synthetic and real-world dynamic scenes demonstrate that augmenting current state-of-the-art methods with our approach leads to a clear improvement in reconstruction accuracy.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 36 references that are in the map. First posted on arXiv 1 Nov 2024.
Builds on
27 of 36 references.
References · 27
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
15 more
- 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 151
- 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
- 2023Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstructioncited by 60
- 2022Matching Normalizing Flows and Probability Paths on Manifoldscited by 57
- 2022Physics Informed Neural Fields for Smoke Reconstruction with Sparse Datacited by 52
- 2020CaSPR: Learning Canonical Spatiotemporal Point Cloud Representationscited by 51
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2023Inferring Hybrid Neural Fluid Fields from Videoscited by 18
- 2024Diffusion Priors for Dynamic View Synthesis from Monocular Videoscited by 18
- 2021Class-agnostic Reconstruction of Dynamic Objects from Videoscited by 8
Built on by
Not cited yet.