mlsanityData to 7 Oct 2026

RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction

arXiv 2606.29329 ↗First posted 28 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We study the problem of physically plausible shadow casting when animating 3D Gaussian Splatting (3DGS) avatars, either individually or in multi-avatar and object-interaction scenarios, within existing 3DGS scenes. In contrast to prior methods that rely on binary hit tests and mesh-based shadow casters, our method performs shadow computation entirely in Gaussian space, without requiring any mesh reconstruction. We introduce RAGA, a Ray-Traced Gaussian Shadow Casting formulation based on exact ray-Gaussian line integrals. For each occluding Gaussian, we integrate the opacity profile along the shadow ray and normalize by the theoretical maximum integral, producing a weight that captures how the ray traverses the occluder rather than merely whether an intersection occurred. To reduce temporal variance from clothing deformations in animated avatars, we further introduce an avatar proxy representation that stabilizes shadow casting while preserving visual fidelity. We implement RAGA using custom CUDA kernels integrated with the NVIDIA OptiX framework; as such, our shadow tracer runs at rates of about 50 FPS. We evaluate on single-avatar, multi-avatar, and avatar-object interaction scenarios across multiple datasets, demonstrating substantially improved shadow realism, temporal stability, and scene coherence. Our project page is available at https://miraymen.github.io/raga/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 111 of its 134 references that are in the map. First posted on arXiv 28 Jun 2026.

Builds on

111 of 134 references.

References · 111

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  7. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  8. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  9. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  10. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  11. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  12. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
38 more
  1. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  2. 2017End-to-end Recovery of Human Shape and Posecited by 883
  3. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  4. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  5. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  6. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  7. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  8. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
  9. 2021Neural Fields in Visual Computing and Beyondcited by 539
  10. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  11. 2022HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Videocited by 483
  12. 2020GRAB: A Dataset of Whole-Body Human Grasping of Objectscited by 397
  13. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  14. 2021Animatable Neural Radiance Fields for Modeling Dynamic Human Bodiescited by 361
  15. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  16. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
  17. 2019Resolving 3D Human Pose Ambiguities with 3D Scene Constraintscited by 294
  18. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  19. 2020ARCH: Animatable Reconstruction of Clothed Humanscited by 257
  20. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
  21. 2022NeuMan: Neural Human Radiance Field from a Single Videocited by 244
  22. 2018Video Based Reconstruction of 3D People Modelscited by 237
  23. 2021SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapescited by 221
  24. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
  25. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  26. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  27. 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
  28. 2022TAVA: Template-free Animatable Volumetric Actorscited by 172
  29. 2019Learning to Reconstruct People in Clothing from a Single RGB Cameracited by 168
  30. 2023TensoIR: Tensorial Inverse Renderingcited by 166
  31. 2020Populating 3D Scenes by Learning Human-Scene Interactioncited by 164
  32. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  33. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  34. 2021H-NeRF: Neural Radiance Fields for Rendering and Temporal Reconstruction of Humans in Motioncited by 157
  35. 2023HUGS: Human Gaussian Splatscited by 154
  36. 2019Single Image Portrait Relightingcited by 152
  37. 2020Perceiving 3D Human-Object Spatial Arrangements from a Single Image in the Wildcited by 152
  38. 2019NASA: Neural Articulated Shape Approximationcited by 149

50 most cited of 111 All 111 (JSON)

Built on by

Not cited yet.