mlsanityData to 7 Oct 2026

HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Sampling

arXiv 2301.02238 ↗First posted 5 Jan 2023cs.CVcited by 173

Not on the map. Why?

Abstract (arXiv)

Volumetric scene representations enable photorealistic view synthesis for static scenes and form the basis of several existing 6-DoF video techniques. However, the volume rendering procedures that drive these representations necessitate careful trade-offs in terms of quality, rendering speed, and memory efficiency. In particular, existing methods fail to simultaneously achieve real-time performance, small memory footprint, and high-quality rendering for challenging real-world scenes. To address these issues, we present HyperReel -- a novel 6-DoF video representation. The two core components of HyperReel are: (1) a ray-conditioned sample prediction network that enables high-fidelity, high frame rate rendering at high resolutions and (2) a compact and memory-efficient dynamic volume representation. Our 6-DoF video pipeline achieves the best performance compared to prior and contemporary approaches in terms of visual quality with small memory requirements, while also rendering at up to 18 frames-per-second at megapixel resolution without any custom CUDA code.

Key facts. Cited by 173 papers in the map (data through 7 Oct 2026). Builds on 48 of its 84 references that are in the map. First posted on arXiv 5 Jan 2023.

Builds on

48 of 84 references.

References · 48

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  5. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  6. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  7. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  8. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  9. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  10. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  11. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  12. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
36 more
  1. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  2. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  3. 2021Neural Fields in Visual Computing and Beyondcited by 539
  4. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  5. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  6. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  7. 2021Advances in Neural Renderingcited by 365
  8. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  9. 2019Neural Point-Based Graphicscited by 326
  10. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  11. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  12. 2020Free View Synthesiscited by 231
  13. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
  14. 2021HyperNeRF: A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fieldscited by 210
  15. 2020AutoInt: Automatic Integration for Fast Neural Volume Renderingcited by 204
  16. 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
  17. 2020Stable View Synthesiscited by 165
  18. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
  19. 2022NeRF: Neural Radiance Field in 3D Vision: A Comprehensive Review (Updated Post-Gaussian Splatting)cited by 156
  20. 2021NeRFReN: Neural Radiance Fields with Reflectionscited by 121
  21. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
  22. 2022Variable Bitrate Neural Fieldscited by 116
  23. 2021Light Field Neural Renderingcited by 108
  24. 2021T"oRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesiscited by 88
  25. 2022ReLU Fields: The Little Non-linearity That Couldcited by 87
  26. 2023Neural Point Catacaustics for Novel-View Synthesis of Reflectionscited by 81
  27. 2021TermiNeRF: Ray Termination Prediction for Efficient Neural Renderingcited by 70
  28. 2022R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesiscited by 69
  29. 2022AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fieldscited by 68
  30. 2020MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Imagescited by 64
  31. 2021DIVeR: Real-time and Accurate Neural Radiance Fields with Deterministic Integration for Volume Renderingcited by 60
  32. 2021NeuLF: Efficient Novel View Synthesis with Neural 4D Light Fieldcited by 33
  33. 2020X-Fields: Implicit Neural View-, Light- and Time-Image Interpolationcited by 31
  34. 2022Eikonal Fields for Refractive Novel-View Synthesiscited by 30
  35. 2022DoF-NeRF: Depth-of-Field Meets Neural Radiance Fieldscited by 26
  36. 2021NeuSample: Neural Sample Field for Efficient View Synthesiscited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 40; 2024: 47; 2025: 55; 2026: 31.

173 papers.

Sort:

By area:

  1. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  2. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  3. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  4. 2023Text-to-3D using Gaussian Splattingcited by 299
  5. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  6. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
  7. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
  8. 2023COLMAP-Free 3D Gaussian Splattingcited by 193
  9. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  10. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
  11. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
  12. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
38 more
  1. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  2. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
  3. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  4. 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
  5. 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
  6. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  7. 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
  8. 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
  9. 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
  10. 2023Progressively Optimized Local Radiance Fields for Robust View Synthesiscited by 103
  11. 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
  12. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  13. 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
  14. 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
  15. 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restorationcited by 89
  16. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78
  17. 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
  18. 20253D and 4D World Modeling: A Surveycited by 64
  19. 2023Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstructioncited by 60
  20. 2023Im4D: High-Fidelity and Real-Time Novel View Synthesis for Dynamic Scenescited by 55
  21. 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 53
  22. 2024Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videoscited by 48
  23. 2023SWinGS: Sliding Windows for Dynamic 3D Gaussian Splattingcited by 46
  24. 2024NPGA: Neural Parametric Gaussian Avatarscited by 46
  25. 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 45
  26. 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
  27. 2023Masked Space-Time Hash Encoding for Efficient Dynamic Scene Reconstructioncited by 43
  28. 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
  29. 2024Vidu4D: Single Generated Video to High-Fidelity 4D Reconstruction with Dynamic Gaussian Surfelscited by 38
  30. 20244D Gaussian Splatting with Scale-aware Residual Field and Adaptive Optimization for Real-time Rendering of Temporally Complex Dynamic Scenescited by 37
  31. 2025ReconDreamer++: Harmonizing Generative and Reconstructive Models for Driving Scene Representationcited by 36
  32. 2023MonoNPHM: Dynamic Head Reconstruction from Monocular Videoscited by 35
  33. 2025Trace Anything: Representing Any Video in 4D via Trajectory Fieldscited by 31
  34. 2024Recent Trends in 3D Reconstruction of General Non-Rigid Scenescited by 28
  35. 2024DN-4DGS: Denoised Deformable Network with Temporal-Spatial Aggregation for Dynamic Scene Renderingcited by 28
  36. 2023Pseudo-Generalized Dynamic View Synthesis from a Videocited by 27
  37. 20254DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Videocited by 26
  38. 2024GaussianPrediction: Dynamic 3D Gaussian Prediction for Motion Extrapolation and Free View Synthesiscited by 25

50 most cited of 173 All 173 (JSON)