RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction
Not on the map. Why?
Abstract (arXiv)
We study the problem of physically plausible shadow casting when animating 3D Gaussian Splatting (3DGS) avatars, either individually or in multi-avatar and object-interaction scenarios, within existing 3DGS scenes. In contrast to prior methods that rely on binary hit tests and mesh-based shadow casters, our method performs shadow computation entirely in Gaussian space, without requiring any mesh reconstruction. We introduce RAGA, a Ray-Traced Gaussian Shadow Casting formulation based on exact ray-Gaussian line integrals. For each occluding Gaussian, we integrate the opacity profile along the shadow ray and normalize by the theoretical maximum integral, producing a weight that captures how the ray traverses the occluder rather than merely whether an intersection occurred. To reduce temporal variance from clothing deformations in animated avatars, we further introduce an avatar proxy representation that stabilizes shadow casting while preserving visual fidelity. We implement RAGA using custom CUDA kernels integrated with the NVIDIA OptiX framework; as such, our shadow tracer runs at rates of about 50 FPS. We evaluate on single-avatar, multi-avatar, and avatar-object interaction scenarios across multiple datasets, demonstrating substantially improved shadow realism, temporal stability, and scene coherence. Our project page is available at https://miraymen.github.io/raga/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 111 of its 134 references that are in the map. First posted on arXiv 28 Jun 2026.
Builds on
111 of 134 references.
References · 111
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
38 more
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
- 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
- 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
- 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
- 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
- 2018Video Based Reconstruction of 3D People Modelscited by 237
- 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
- 2021Stochastic Scene-Aware Motion Predictioncited by 203
- 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
- 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
- 2023TensoIR: Tensorial Inverse Renderingcited by 166
- 2020Populating 3D Scenes by Learning Human-Scene Interactioncited by 164
- 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
- 2023HUGS: Human Gaussian Splatscited by 154
- 2019Single Image Portrait Relightingcited by 152
- 2020Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wildcited by 152
- 2019NASA: Neural Articulated Shape Approximationcited by 149
50 most cited of 111 All 111 (JSON)
Built on by
Not cited yet.