mlsanityData to 7 Oct 2026

Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splatting

arXiv 2404.03613 ↗First posted 4 Apr 2024cs.CVcited by 104

Not on the map. Why?

Abstract (arXiv)

As 3D Gaussian Splatting (3DGS) provides fast and high-quality novel view synthesis, it is a natural extension to deform a canonical 3DGS to multiple frames for representing a dynamic scene. However, previous works fail to accurately reconstruct complex dynamic scenes. We attribute the failure to the design of the deformation field, which is built as a coordinate-based function. This approach is problematic because 3DGS is a mixture of multiple fields centered at the Gaussians, not just a single coordinate-based framework. To resolve this problem, we define the deformation as a function of per-Gaussian embeddings and temporal embeddings. Moreover, we decompose deformations as coarse and fine deformations to model slow and fast movements, respectively. Also, we introduce a local smoothness regularization for per-Gaussian embedding to improve the details in dynamic regions. Project page: https://jeongminb.github.io/e-d3dgs/

Key facts. Cited by 104 papers in the map (data through 7 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 4 Apr 2024.

Builds on

26 of 37 references.

References · 26

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2018SlowFast Networks for Video Recognitioncited by 1,862
  4. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  5. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  6. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  7. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  8. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  9. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  10. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
  11. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  12. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 720
14 more
  1. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  2. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  3. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  4. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  5. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  6. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  7. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
  8. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
  9. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
  10. 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 124
  11. 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
  12. 2021TermiNeRF: Ray Termination Prediction for Efficient Neural Renderingcited by 70
  13. 2023DeformGS: Scene Flow in Highly Deformable Scenes for Deformable Object Manipulationcited by 42
  14. 2023Sync-NeRF: Generalizing Dynamic NeRFs to Unsynchronized Videoscited by 16

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 14; 2025: 50; 2026: 40.

104 papers.

Sort:

By area:

  1. 2025ArtGS: Building Interactable Replicas of Complex Articulated Objects via Gaussian Splattingcited by 67
  2. 2024SplatSim: Zero-Shot Sim2Real Transfer of RGB Manipulation Policies Using Gaussian Splattingcited by 63
  3. 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstructioncited by 53
  4. 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
  5. 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 45
  6. 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
  7. 20254D LangSplat: 4D Language Gaussian Splatting via Multimodal Large Language Modelscited by 35
  8. 2024DN-4DGS: Denoised Deformable Network with Temporal-Spatial Aggregation for Dynamic Scene Renderingcited by 28
  9. 2024LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priorscited by 25
  10. 2025GIFStream: 4D Gaussian-based Immersive Video with Feature Streamcited by 23
  11. 2025BARD-GS: Blur-Aware Reconstruction of Dynamic Scenes via Gaussian Splattingcited by 18
  12. 2024Advancing Extended Reality with 3D Gaussian Splatting: Innovations and Prospectscited by 17
38 more
  1. 2025VideoArtGS: Building Digital Twins of Articulated Objects from Monocular Videocited by 15
  2. 2024Dynamics-Aware Gaussian Splatting Streaming Towards Fast On-the-Fly 4D Reconstructioncited by 14
  3. 2025FreeGave: 3D Physics Learning from Dynamic Videos by Gaussian Velocitycited by 13
  4. 2025Reconstructing 4D Spatial Intelligence: A Surveycited by 13
  5. 20251000+ FPS 4D Gaussian Splatting for Dynamic Scene Renderingcited by 12
  6. 2025LocalDyGS: Multi-view Global Dynamic Scene Modeling via Adaptive Local Implicit Feature Decouplingcited by 12
  7. 2025ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenescited by 12
  8. 2025MoBGS: Motion Deblurring Dynamic 3D Gaussian Splatting for Blurry Monocular Videocited by 11
  9. 2025Hybrid 3D-4D Gaussian Splatting for Fast Dynamic Scene Representationcited by 11
  10. 20254D Gaussian Splatting SLAMcited by 10
  11. 2024Mipmap-GS: Let Gaussians Deform with Scale-specific Mipmap for Anti-aliasing Renderingcited by 9
  12. 2024TimeFormer: Capturing Temporal Relationships of Deformable 3D Gaussians for Robust Reconstructioncited by 9
  13. 2025GSCodec Studio: A Modular Framework for Gaussian Splat Compressioncited by 9
  14. 2025VoxelSplat: Dynamic Gaussian Splatting as an Effective Loss for Occupancy and Flow Predictioncited by 9
  15. 2025Dynamic Scene Reconstruction: Recent Advance in Real-time Rendering and Streamingcited by 8
  16. 2025Light4GS: Lightweight Compact 4D Gaussian Splatting Generation via Context Modelcited by 8
  17. 2025Learning 3D-Gaussian Simulators from RGB Videoscited by 8
  18. 2025DASH: 4D Hash Encoding with Self-Supervised Decomposition for Real-Time Dynamic Scene Renderingcited by 8
  19. 2025Orientation-anchored Hyper-Gaussian for 4D Reconstruction from Casual Videoscited by 8
  20. 2026AdaGaR: Adaptive Gabor Representation for Dynamic Scene Reconstructioncited by 8
  21. 2025Digital Twin Generation from Visual Data: A Surveycited by 7
  22. 2025ADC-GS: Anchor-Driven Deformable and Compressed Gaussian Splatting for Dynamic Scene Reconstructioncited by 7
  23. 2024HiCoM: Hierarchical Coherent Motion for Streamable Dynamic Scene with 3D Gaussian Splattingcited by 6
  24. 2024Monocular Dynamic Gaussian Splatting: Fast, Brittle, and Scene Complexity Rulescited by 6
  25. 2025From Coarse to Fine: Learnable Discrete Wavelet Transforms for Efficient 3D Gaussian Splattingcited by 6
  26. 2024Adaptive and Temporally Consistent Gaussian Surfels for Multi-view Dynamic Reconstructioncited by 5
  27. 2025ParticleGS: Learning Neural Gaussian Particle Dynamics from Videos for Prior-free Physical Motion Extrapolationcited by 5
  28. 2025SD-GS: Structured Deformable 3D Gaussians for Efficient Dynamic Scene Reconstructioncited by 4
  29. 2025Optimized Minimal 4D Gaussian Splattingcited by 4
  30. 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
  31. 20264C4D: 4 Camera 4D Gaussian Splattingcited by 4
  32. 2024Event-boosted Deformable 3D Gaussians for Dynamic Scene Reconstructioncited by 3
  33. 2025MAPo : Motion-Aware Partitioning of Deformable 3D Gaussian Splatting for High-Fidelity Dynamic Scene Reconstructioncited by 3
  34. 2025Geometry-Consistent 4D Gaussian Splatting for Sparse-Input Dynamic View Synthesiscited by 3
  35. 2025TED-4DGS: Temporally Activated and Embedding-based Deformation for 4DGS Compressioncited by 3
  36. 2025Mono4DGS-HDR: High Dynamic Range 4D Gaussian Splatting from Alternating-exposure Monocular Videoscited by 2
  37. 2025MoE-GS: Mixture of Experts for Dynamic Gaussian Splattingcited by 2
  38. 2025Alias-free 4D Gaussian Splattingcited by 2

50 most cited of 104 All 104 (JSON)