mlsanityData to 7 Oct 2026

HexPlane: A Fast Representation for Dynamic Scenes

arXiv 2301.09632 ↗First posted 23 Jan 2023cs.CVcited by 582

Not on the map. Why?

Cited by 46 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Modeling and re-rendering dynamic 3D scenes is a challenging task in 3D vision. Prior approaches build on NeRF and rely on implicit representations. This is slow since it requires many MLP evaluations, constraining real-world applications. We show that dynamic 3D scenes can be explicitly represented by six planes of learned features, leading to an elegant solution we call HexPlane. A HexPlane computes features for points in spacetime by fusing vectors extracted from each plane, which is highly efficient. Pairing a HexPlane with a tiny MLP to regress output colors and training via volume rendering gives impressive results for novel view synthesis on dynamic scenes, matching the image quality of prior work but reducing training time by more than 100×. Extensive ablations confirm our HexPlane design and show that it is robust to different feature fusion mechanisms, coordinate systems, and decoding mechanisms. HexPlane is a simple and effective solution for representing 4D volumes, and we hope they can broadly contribute to modeling spacetime for dynamic 3D scenes.

Key facts. Cited by 582 papers in the map (data through 7 Oct 2026). Builds on 89 of its 111 references that are in the map. First posted on arXiv 23 Jan 2023.

Builds on

89 of 111 references.

References · 89

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  6. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  7. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  8. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  9. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  10. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  11. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  12. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
38 more
  1. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  2. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  3. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  4. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  5. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  6. 2020Neural Sparse Voxel Fieldscited by 959
  7. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  8. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  9. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
  10. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  11. 2020Convolutional Occupancy Networkscited by 760
  12. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  13. 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 735
  14. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
  15. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  16. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  17. 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
  18. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
  19. 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
  20. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  21. 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
  22. 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
  23. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 586
  24. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  25. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  26. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  27. 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
  28. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 470
  29. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  30. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  31. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  32. 2021In-Place Scene Labelling and Understanding with Implicit Scene Representationcited by 411
  33. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 401
  34. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 370
  35. 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
  36. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  37. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  38. 2020Neural Scene Graphs for Dynamic Scenescited by 298

50 most cited of 89 All 89 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 93; 2024: 203; 2025: 174; 2026: 112.

582 papers.

Sort:

By area:

  1. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  2. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  3. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  4. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  5. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
  6. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  7. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  8. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  9. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
  10. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
  11. 2024A Survey on 3D Gaussian Splattingcited by 221
  12. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
38 more
  1. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
  2. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  3. 2023Text-To-4D Dynamic Scene Generationcited by 204
  4. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 191
  5. 2023NeRSemble: Multi-view Radiance Field Reconstruction of Human Headscited by 190
  6. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
  7. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
  8. 20234D-fy: Text-to-4D Generation Using Hybrid Score Distillation Samplingcited by 184
  9. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 177
  10. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  11. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  12. 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 160
  13. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
  14. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  15. 2024L4GM: Large 4D Gaussian Reconstruction Modelcited by 143
  16. 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 143
  17. 2023Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fieldscited by 142
  18. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  19. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
  20. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 124
  21. 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
  22. 2023Drivable 3D Gaussian Avatarscited by 120
  23. 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 120
  24. 20234DGen: Grounded 4D Content Generation with Spatial-temporal Consistencycited by 117
  25. 2024Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collectionscited by 117
  26. 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 116
  27. 2023Animate124: Animating One Image to 4D Dynamic Scenecited by 113
  28. 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
  29. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
  30. 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
  31. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  32. 20243D Gaussian as a New Era: A Surveycited by 102
  33. 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
  34. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 99
  35. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 96
  36. 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
  37. 2023A Unified Approach for Text- and Image-guided 4D Scene Generationcited by 82
  38. 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 78

50 most cited of 582 All 582 (JSON)