Neural Trajectory Fields for Dynamic Novel View Synthesis
Not on the map. Why?
Abstract (arXiv)
Recent approaches to render photorealistic views from a limited set of photographs have pushed the boundaries of our interactions with pictures of static scenes. The ability to recreate moments, that is, time-varying sequences, is perhaps an even more interesting scenario, but it remains largely unsolved. We introduce DCT-NeRF, a coordinatebased neural representation for dynamic scenes. DCTNeRF learns smooth and stable trajectories over the input sequence for each point in space. This allows us to enforce consistency between any two frames in the sequence, which results in high quality reconstruction, particularly in dynamic regions.
Key facts. Cited by 86 papers in the map (data through 14 Oct 2026). Builds on 34 of its 54 references that are in the map. First posted on arXiv 12 May 2021.
Builds on
34 of 54 references.
References · 34
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2020Neural Sparse Voxel Fieldscited by 959
- 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
22 more
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
- 2020State of the Art on Neural Renderingcited by 278
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
- 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
- 2019Learning Trajectory Dependencies for Human Motion Predictioncited by 246
- 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 242
- 2020Consistent Video Depth Estimationcited by 220
- 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
- 2020AutoInt: Automatic Integration for Fast Neural Volume Renderingcited by 204
- 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
- 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
- 2020Stable View Synthesiscited by 165
- 2020DeRF: Decomposed Radiance Fieldscited by 163
- 2016Learning-Based View Synthesis for Light Field Camerascited by 145
- 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
- 2018Extreme View Synthesiscited by 94
- 2019Web Stereo Video Supervision for Depth Prediction from Dynamic Scenescited by 73
- 2020Portrait Neural Radiance Fields from a Single Imagecited by 61
- 2017Monocular Dense 3D Reconstruction of a Complex Dynamic Scene from Two Perspective Framescited by 27
- 2020Semantic View Synthesiscited by 18
- 2018A Benchmark and Evaluation of Non-Rigid Structure from Motioncited by 14
- 2020Generative View Synthesis: From Single-view Semantics to Novel-view Imagescited by 12
Built on by
Citing papers per year: 2021: 4; 2022: 6; 2023: 22; 2024: 30; 2025: 18; 2026: 6.
86 papers.
Sort:
By area:
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 152
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2023RobustNeRF: Ignoring Distractors with Robust Lossescited by 101
38 more
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
- 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
- 2023Forward Flow for Novel View Synthesis of Dynamic Scenescited by 68
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splattingcited by 63
- 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
- 2021Watch It Move: Unsupervised Discovery of 3D Joints for Re-Posing of Articulated Objectscited by 50
- 2023EPIC Fields: Marrying 3D Geometry and Video Understandingcited by 49
- 2025Dynamic Point Maps: A Versatile Representation for Dynamic 3D Reconstructioncited by 44
- 2022Neural Deformable Voxel Grid for Fast Optimization of Dynamic View Synthesiscited by 43
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modelingcited by 43
- 2023Flow supervision for Deformable NeRFcited by 42
- 2023DeformGS: Scene Flow in Highly Deformable Scenes for Deformable Object Manipulationcited by 42
- 2023DynPoint: Dynamic Neural Point For View Synthesiscited by 37
- 20244D Gaussian Splatting with Scale-aware Residual Field and Adaptive Optimization for Real-time Rendering of Temporally Complex Dynamic Scenescited by 37
- 2025Instant Gaussian Stream: Fast and Generalizable Streaming of Dynamic Scene Reconstruction via Gaussian Splattingcited by 36
- 2025Trace Anything: Representing Any Video in 4D via Trajectory Fieldscited by 33
- 2023Control4D: Efficient 4D Portrait Editing with Textcited by 32
- 2024Splatter a Video: Video Gaussian Representation for Versatile Processingcited by 31
- 2021HVH: Learning a Hybrid Neural Volumetric Representation for Dynamic Hair Performance Capturecited by 29
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videoscited by 28
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
- 2023ResFields: Residual Neural Fields for Spatiotemporal Signalscited by 27
- 2024QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videoscited by 25
- 2024Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimationcited by 24
- 2023Total-Recon: Deformable Scene Reconstruction for Embodied View Synthesiscited by 20
- 2024CTNeRF: Cross-Time Transformer for Dynamic Neural Radiance Field from Monocular Videocited by 18
- 2024Diffusion Priors for Dynamic View Synthesis from Monocular Videoscited by 18
- 2023Decoupling Dynamic Monocular Videos for Dynamic View Synthesiscited by 17
- 2024DyBluRF: Dynamic Neural Radiance Fields from Blurry Monocular Videocited by 17
- 2023Event-based Continuous Color Video Decompression from Single Framescited by 15
- 20244Dynamic: Text-to-4D Generation with Hybrid Priorscited by 15
- 2025DGS-LRM: Real-Time Deformable 3D Gaussian Reconstruction From Monocular Videoscited by 15
- 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representationscited by 14
- 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 14
- 2022PREF: Predictability Regularized Neural Motion Fieldscited by 13
- 2022Learning Motion-Dependent Appearance for High-Fidelity Rendering of Dynamic Humans from a Single Cameracited by 12
50 most cited of 86 All 86 (JSON)
- 2026FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement31 Jul 2026
- 2026On the Design of Mixture-of-Experts for Dynamic Gaussian Splatting9 Jul 2026
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis2 Jul 2026
- 2026Visual Geometry Transformer in the Wild: Distractor-Free 3D Reconstruction22 Jun 2026
- 2026MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model6 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generation3 Dec 2025
- 2025Gaussians on Fire: High-Frequency Reconstruction of Flames27 Nov 2025
- 2025See4D: Pose-Free 4D Generation via Auto-Regressive Video Inpainting30 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025Trace Anything: Representing Any Video in 4D via Trajectory Fields15 Oct 2025
- 2025TRACE: Learning 3D Gaussian Physical Dynamics from Multi-view Videos13 Aug 2025
38 more
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025HoliGS: Holistic Gaussian Splatting for Embodied View Synthesis24 Jun 2025
- 2025DGS-LRM: Real-Time Deformable 3D Gaussian Reconstruction From Monocular Videos11 Jun 2025
- 2025SpeeDe3DGS: Speedy Deformable 3D Gaussian Splatting with Temporal Pruning and Motion Grouping9 Jun 2025
- 2025Layered Motion Fusion: Lifting Motion Segmentation to 3D in Egocentric Videos5 Jun 2025
- 2025Advances in Radiance Field for Dynamic Scene: From Neural Field to Gaussian Field15 May 2025
- 20253D Gaussian Head Avatars with Expressive Dynamic Appearances by Compact Tensorial Representations21 Apr 2025
- 2025Instant Gaussian Stream: Fast and Generalizable Streaming of Dynamic Scene Reconstruction via Gaussian Splatting21 Mar 2025
- 2025Dynamic Point Maps: A Versatile Representation for Dynamic 3D Reconstruction20 Mar 2025
- 2025RSR-NF: Neural Field Regularization by Static Restoration Priors for Dynamic Imaging13 Mar 2025
- 2025Dynamic Scene Reconstruction: Recent Advance in Real-time Rendering and Streaming11 Mar 2025
- 2025SIRE: SE(3) Intrinsic Rigidity Embeddings10 Mar 2025
- 20244D Gaussian Splatting with Scale-aware Residual Field and Adaptive Optimization for Real-time Rendering of Temporally Complex Dynamic Scenes9 Dec 2024
- 2024QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videos5 Dec 2024
- 2024Monocular Dynamic Gaussian Splatting: Fast, Brittle, and Scene Complexity Rules5 Dec 2024
- 2024CTRL-D: Controllable Dynamic 3D Scene Editing with Personalized 2D Diffusion2 Dec 2024
- 2024Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling24 Oct 2024
- 2024MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splatting10 Oct 2024
- 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstruction17 Sep 2024
- 2024CD-NGP: A Fast Scalable Continual Representation for Dynamic Scenes8 Sep 2024
- 2024Regularizing Dynamic Radiance Fields with Kinematic Fields19 Jul 2024
- 2024Shape of Motion: 4D Reconstruction from a Single Video18 Jul 2024
- 20244Dynamic: Text-to-4D Generation with Hybrid Priors17 Jul 2024
- 2024Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimation15 Jul 2024
- 2024Dynamic Neural Radiance Field From Defocused Monocular Video8 Jul 2024
- 2024Splatter a Video: Video Gaussian Representation for Versatile Processing19 Jun 2024
- 2024Modeling Ambient Scene Dynamics for Free-view Synthesis13 Jun 2024
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models11 Jun 2024
- 2024Degrees of Freedom Matter: Inferring Dynamics from Point Trajectories5 Jun 2024
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wild29 May 2024
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds27 May 2024
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesis23 May 2024
- 20243D LiDAR Mapping in Dynamic Environments Using a 4D Implicit Neural Representation6 May 2024
- 2024TK-Planes: Tiered K-Planes with High Dimensional Feature Vectors for Dynamic UAV-based Scenes4 May 2024
- 2024Factorized Motion Fields for Fast Sparse Input Dynamic View Synthesis17 Apr 2024
- 2024Entity-NeRF: Detecting and Removing Moving Entities in Urban Scenes24 Mar 2024
- 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenes22 Mar 2024
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation19 Mar 2024
50 newest of 86 All 86 (JSON)
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2021BANMo: Building Animatable 3D Neural Models from Many Casual Videoscited by 197
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 152
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2023RobustNeRF: Ignoring Distractors with Robust Lossescited by 101
12 most cited of 81 All 81 (JSON)
- 2026FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement31 Jul 2026
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis2 Jul 2026
- 2026Visual Geometry Transformer in the Wild: Distractor-Free 3D Reconstruction22 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2025SeeU: Seeing the Unseen World via 4D Dynamics-aware Generation3 Dec 2025
- 2025Gaussians on Fire: High-Frequency Reconstruction of Flames27 Nov 2025
- 2025See4D: Pose-Free 4D Generation via Auto-Regressive Video Inpainting30 Oct 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025Trace Anything: Representing Any Video in 4D via Trajectory Fields15 Oct 2025
- 2025TRACE: Learning 3D Gaussian Physical Dynamics from Multi-view Videos13 Aug 2025
- 2025Reconstructing 4D Spatial Intelligence: A Survey28 Jul 2025
- 2025HoliGS: Holistic Gaussian Splatting for Embodied View Synthesis24 Jun 2025
12 newest of 81 All 81 (JSON)