mlsanityData to 14 Oct 2026

DR-GS: Physically-Based Deformable and Relightable 2D Gaussians

arXiv 2606.29379 ↗First posted 28 Jun 2026cs.CV cs.AI cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Gaussian splatting (GS) has garnered significant attention in VR/AR and digital content creation due to its explicit parameterization and efficient rendering capabilities. However, existing GS-based methods for deformable objects face two key limitations: (i) illumination is erroneously baked into textures, causing physically inconsistent responses under dynamic deformations and lighting changes; (ii) snapshot-based reconstruction restricts post-reconstruction material editing. To address these challenges, we propose Deformable and Relightable GS (DR-GS), a unified Gaussian framework that integrates physically-based inverse rendering, relighting, and deformation-aware manipulation. Through explicitly disentangling geometry, illumination, and material representations, DR-GS overcomes the limitations of static snapshots, resolving unrealistic appearance under varying conditions while enabling post-reconstruction parameter editing. Extensive experiments show that DR-GS achieves leading visual quality across static reconstruction, dynamic deformation, and relighting, reliably preserving reflections and specular highlights on glossy surfaces. It further establishes a fully decoupled geometry-illumination-material pipeline, enabling high-quality 3D asset creation and comprehensive post-editing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 50 of its 64 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

50 of 64 references.

References · 50

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  4. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  5. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  6. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
  7. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
  8. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  9. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
  10. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  11. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  12. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
38 more
  1. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 224
  2. 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
  3. 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
  4. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  5. 2023TensoIR: Tensorial Inverse Renderingcited by 168
  6. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  7. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  8. 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 139
  9. 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 139
  10. 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 108
  11. 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
  12. 2023GIR: 3D Gaussian Inverse Rendering for Relightable Scene Factorizationcited by 87
  13. 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 80
  14. 2024GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Graspingcited by 78
  15. 2023NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimationcited by 74
  16. 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 70
  17. 2023Adaptive Shells for Efficient Neural Radiance Field Renderingcited by 69
  18. 2024IRGS: Inter-Reflective Gaussian Splatting with 2D Gaussian Ray Tracingcited by 54
  19. 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 45
  20. 2025Real2Render2Real: Scaling Robot Data Without Dynamics Simulation or Robot Hardwarecited by 44
  21. 2024GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse Renderingcited by 42
  22. 2024Reflective Gaussian Splattingcited by 42
  23. 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
  24. 2024Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splattingcited by 38
  25. 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
  26. 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 32
  27. 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 32
  28. 2025SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Renderingcited by 23
  29. 2024Mani-GS: Gaussian Splatting Manipulation with Triangular Meshcited by 22
  30. 2024PRTGS: Precomputed Radiance Transfer of Gaussian Splats for Real-Time High-Quality Relightingcited by 18
  31. 2024GlossyGS: Inverse Rendering of Glossy Objects with 3D Gaussian Splattingcited by 13
  32. 2024GS-ROR2: Bidirectional-guided 3DGS and SDF for Reflective Object Relighting and Reconstructioncited by 11
  33. 2025PGC: Physics-Based Gaussian Cloth from a Single Posecited by 11
  34. 2024VR-Doh: Hands-on 3D Modeling in Virtual Realitycited by 5
  35. 2025B'ezierGS: Dynamic Urban Scene Reconstruction with B'ezier Curve Gaussian Splattingcited by 5
  36. 2025TensoFlow: Tensorial Flow-based Sampler for Inverse Renderingcited by 2
  37. 2024Multi-times Monte Carlo Rendering for Inter-reflection Reconstructioncited by 1
  38. 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformationcited by 1

Built on by

Not cited yet.