DR-GS: Physically-Based Deformable and Relightable 2D Gaussians
Not on the map. Why?
Abstract (arXiv)
Gaussian splatting (GS) has garnered significant attention in VR/AR and digital content creation due to its explicit parameterization and efficient rendering capabilities. However, existing GS-based methods for deformable objects face two key limitations: (i) illumination is erroneously baked into textures, causing physically inconsistent responses under dynamic deformations and lighting changes; (ii) snapshot-based reconstruction restricts post-reconstruction material editing. To address these challenges, we propose Deformable and Relightable GS (DR-GS), a unified Gaussian framework that integrates physically-based inverse rendering, relighting, and deformation-aware manipulation. Through explicitly disentangling geometry, illumination, and material representations, DR-GS overcomes the limitations of static snapshots, resolving unrealistic appearance under varying conditions while enabling post-reconstruction parameter editing. Extensive experiments show that DR-GS achieves leading visual quality across static reconstruction, dynamic deformation, and relighting, reliably preserving reflections and specular highlights on glossy surfaces. It further establishes a fully decoupled geometry-illumination-material pipeline, enabling high-quality 3D asset creation and comprehensive post-editing.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 50 of its 64 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
50 of 64 references.
References · 50
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 496
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 449
- 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 260
38 more
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 224
- 2023GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussianscited by 191
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 191
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
- 2023TensoIR: Tensorial Inverse Renderingcited by 168
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 139
- 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 139
- 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 108
- 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
- 2023GIR: 3D Gaussian Inverse Rendering for Relightable Scene Factorizationcited by 87
- 2024Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusioncited by 80
- 2024GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Graspingcited by 78
- 2023NeILF++: Inter-Reflectable Light Fields for Geometry and Material Estimationcited by 74
- 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 70
- 2023Adaptive Shells for Efficient Neural Radiance Field Renderingcited by 69
- 2024IRGS: Inter-Reflective Gaussian Splatting with 2D Gaussian Ray Tracingcited by 54
- 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 45
- 2025Real2Render2Real: Scaling Robot Data Without Dynamics Simulation or Robot Hardwarecited by 44
- 2024GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse Renderingcited by 42
- 2024Reflective Gaussian Splattingcited by 42
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
- 2024Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splattingcited by 38
- 2024Gaussian Splashing: Unified Particles for Versatile Motion Synthesis and Renderingcited by 37
- 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 32
- 2024Efficient Physics Simulation for 3D Scenes via MLLM-Guided Gaussian Splattingcited by 32
- 2025SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Renderingcited by 23
- 2024Mani-GS: Gaussian Splatting Manipulation with Triangular Meshcited by 22
- 2024PRTGS: Precomputed Radiance Transfer of Gaussian Splats for Real-Time High-Quality Relightingcited by 18
- 2024GlossyGS: Inverse Rendering of Glossy Objects with 3D Gaussian Splattingcited by 13
- 2024GS-ROR2: Bidirectional-guided 3DGS and SDF for Reflective Object Relighting and Reconstructioncited by 11
- 2025PGC: Physics-Based Gaussian Cloth from a Single Posecited by 11
- 2024VR-Doh: Hands-on 3D Modeling in Virtual Realitycited by 5
- 2025B'ezierGS: Dynamic Urban Scene Reconstruction with B'ezier Curve Gaussian Splattingcited by 5
- 2025TensoFlow: Tensorial Flow-based Sampler for Inverse Renderingcited by 2
- 2024Multi-times Monte Carlo Rendering for Inter-reflection Reconstructioncited by 1
- 2025AniGaussian: Animatable Gaussian Avatar with Pose-guided Deformationcited by 1
Built on by
Not cited yet.