Dynamic Thermal Gaussians: Multimodal 4D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Thermography plays a vital role in military and broader thermal analysis applications. Recent progress in 3D thermal reconstruction has extended temperature analysis from 2D to 3D space, yet most existing works assume static temperature distributions, neglecting the temporal dynamics of heat transfer in real-world environments. To address this limitation, we propose the first dynamic RGB-Thermal reconstruction framework for complex scenes. Our method jointly models RGB appearance, thermal observations, and scene geometry as they change over time. Specifically, we introduce a multimodal dynamic scene representation that anchors both the color and thermal modalities to a shared geometric substrate, ensuring their consistency under spatiotemporal deformations. We further design multimodal embeddings to enhance the motion expressiveness for each modality, and propose a multimodal routing mechanism that retains a unified set of shared multimodal Gaussians as the geometric backbone while adaptively spawning modality-specific Gaussians to strengthen the representational capacity in detail-rich regions of each individual modality. In addition, we contribute a novel benchmark dataset featuring high-frequency temperature variations to facilitate the evaluation of 4D reconstruction. Extensive experiments demonstrate that our method achieves high-fidelity spatiotemporal reconstruction of both appearance and temperature. Our code and dataset are available at: https://github.com/LinLif1869/DTG.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 43 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
18 of 43 references.
References · 18
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 174
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
- 2021Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimationcited by 79
- 2024MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenescited by 47
- 2023NTO3D: Neural Target Object 3D Reconstruction with Segment Anythingcited by 14
- 2024ThermalGaussian: Thermal 3D Gaussian Splattingcited by 13
6 more
- 2025ManipDreamer3D : Synthesizing Plausible Robotic Manipulation Video with Occupancy-aware 3D Trajectorycited by 12
- 2026ParkGaussian: Surround-view 3D Gaussian Splatting for Autonomous Parkingcited by 7
- 2025TextSplat: Text-Guided Semantic Fusion for Generalizable Gaussian Splattingcited by 6
- 2025VGNC: Reducing the Overfitting of Sparse-view 3DGS via Validation-guided Gaussian Number Controlcited by 3
- 2025MMOne: Representing Multiple Modalities in One Scenecited by 3
- 2025RoboArmGS: High-Quality Robotic Arm Splatting via B'ezier Curve Refinementcited by 3
Built on by
Not cited yet.