R2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction
Not on the map. Why?
Abstract (arXiv)
3D Gaussian splatting (3DGS) has shown promising results in image rendering and surface reconstruction. However, its potential in volumetric reconstruction tasks, such as X-ray computed tomography, remains under-explored. This paper introduces R2-Gaussian, the first 3DGS-based framework for sparse-view tomographic reconstruction. By carefully deriving X-ray rasterization functions, we discover a previously unknown integration bias in the standard 3DGS formulation, which hampers accurate volume retrieval. To address this issue, we propose a novel rectification technique via refactoring the projection from 3D to 2D Gaussians. Our new method presents three key innovations: (1) introducing tailored Gaussian kernels, (2) extending rasterization to X-ray imaging, and (3) developing a CUDA-based differentiable voxelizer. Experiments on synthetic and real-world datasets demonstrate that our method outperforms state-of-the-art approaches in accuracy and efficiency. Crucially, it delivers high-quality results in 4 minutes, which is 12× faster than NeRF-based methods and on par with traditional algorithms. Code and models are available on the project page https://github.com/Ruyi-Zha/r2gaussian.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). Builds on 31 of its 68 references that are in the map. First posted on arXiv 31 May 2024.
Builds on
31 of 68 references.
References · 31
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
19 more
- 2017Learned Primal-dual Reconstructioncited by 251
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 2021NeRP: Implicit Neural Representation Learning with Prior Embedding for Sparsely Sampled Image Reconstructioncited by 145
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 137
- 2022Solving 3D Inverse Problems using Pre-trained 2D Diffusion Modelscited by 130
- 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 111
- 2022NAF: Neural Attenuation Fields for Sparse-View CBCT Reconstructioncited by 106
- 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
- 2019X2CT-GAN: Reconstructing CT from Biplanar X-Rays with Generative Adversarial Networkscited by 85
- 2022DOLCE: A Model-Based Probabilistic Diffusion Framework for Limited-Angle CT Reconstructioncited by 73
- 2023Structure-Aware Sparse-View X-ray 3D Reconstructioncited by 70
- 2024Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesiscited by 56
- 2023Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Modelscited by 53
- 2023Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstructioncited by 42
- 2017Lose The Views: Limited Angle CT Reconstruction via Implicit Sinogram Completioncited by 31
- 2019TomoGAN: Low-Dose Synchrotron X-Ray Tomography with Generative Adversarial Networkscited by 25
- 20233DGR-CT: Sparse-View CT Reconstruction with a 3D Gaussian Representationcited by 24
- 2024GaSpCT: Gaussian Splatting for Novel CT Projection View Synthesiscited by 6
Built on by
Citing papers per year: 2024: 3; 2025: 28; 2026: 34.
65 papers.
Sort:
By area:
- 2024Volumetrically Consistent 3D Gaussian Rasterizationcited by 11
- 2025UltraGauss: Ultrafast Gaussian Reconstruction of 3D Ultrasound Volumescited by 8
- 2024Discretized Gaussian Representation for Tomographic Reconstructioncited by 6
- 2025X2-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstructioncited by 6
- 2025Are Pixel-Wise Metrics Reliable for Sparse-View Computed Tomography Reconstruction?cited by 6
- 2025From Coarse to Fine: Learnable Discrete Wavelet Transforms for Efficient 3D Gaussian Splattingcited by 6
- 2025X-LRM: X-ray Large Reconstruction Model for Extremely Sparse-View Computed Tomography Recovery in One Secondcited by 5
- 2025X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomographycited by 5
- 2025GR-Gaussian: Graph-Based Radiative Gaussian Splatting for Sparse-View CT Reconstructioncited by 5
- 2025DeepSparse: A Foundation Model for Sparse-View CBCT Reconstructioncited by 4
- 20244DRGS: 4D Radiative Gaussian Splatting for Efficient 3D Vessel Reconstruction from Sparse-View Dynamic DSA Imagescited by 3
- 2025NeAS: 3D Reconstruction from X-ray Images using Neural Attenuation Surfacecited by 3
38 more
- 2025InnerGS: Internal Scenes Reconstruction and Segmentation via Factorized 3D Gaussian Splattingcited by 3
- 2025MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imagingcited by 3
- 2025GEM: 3D Gaussian Splatting for Efficient and Accurate Cryo-EM Reconstructioncited by 3
- 2026DM4CT: Benchmarking Diffusion Models for Computed Tomography Reconstructioncited by 3
- 2025X-Field: A Physically Grounded Representation for 3D X-ray Reconstructioncited by 2
- 2025Time-resolved dynamic CBCT reconstruction using prior-model-free spatiotemporal Gaussian representation (PMF-STGR)cited by 2
- 2025NeRF-based CBCT Reconstruction needs Normalization and Initializationcited by 2
- 2025WIPES: Wavelet-based Visual Primitivescited by 2
- 2025MoRe-3DGSMR: Motion-resolved reconstruction framework for free-breathing pulmonary MRI based on 3D Gaussian representationcited by 1
- 2025Trans2-CBCT: A Dual-Transformer Framework for Sparse-View CBCT Reconstructioncited by 1
- 2025DIGS: Dynamic CBCT Reconstruction using Deformation-Informed 4D Gaussian Splatting and a Low-Rank Free-Form Deformation Modelcited by 1
- 2025NerT-CA: Efficient Dynamic Reconstruction from Sparse-view X-ray Coronary Angiographycited by 1
- 2025Zero-shot CT Super-Resolution using Diffusion-based 2D Projection Priors and Signed 3D Gaussianscited by 1
- 2025DenoiseGS: Gaussian Reconstruction Model for Burst Denoisingcited by 1
- 2026Radioactive 3D Gaussian Ray Tracing for Tomographic Reconstructioncited by 1
- 2026GR-Diffusion: 3D Gaussian Representation Meets Diffusion in Whole-Body PET Reconstructioncited by 1
- 2026M-Gaussian: An Magnetic Gaussian Framework for Efficient Multi-Stack MRI Reconstructioncited by 1
- 2026Active View Selection with Perturbed Gaussian Ensemble for Tomographic Reconstructioncited by 1
- 20263D Gaussian Splatting for Annular Dark Field Scanning Transmission Electron Microscopy Tomography Reconstructioncited by 1
- 2026Spatiotemporal Gaussian representation-based dynamic reconstruction and motion estimation framework for time-resolved volumetric MR imaging (DREME-GSMR)cited by 1
- 20263D Skew Gaussian Splatting with Any Camera Trajectory Visualization Enginecited by 1
- 2026When Variance Is Not an Error Map: Calibrated Uncertainty for Radiative Gaussian Splatting in Sparse-View CTcited by 1
- 2026LINGO: Latent Initialization and Gradient Optimization for Sparse-view X-ray Novel View Synthesis and CT Reconstruction with 3D Gaussian Splattingcited by 1
- 2026SpectralCTGaussians: Projection-Domain Reconstruction and Basis Material Decomposition for Spectral CT using 3D Gaussian Splattingcited by 1
- 2025IXGS-Intraoperative 3D Reconstruction from Sparse, Arbitrarily Posed Real X-rayscited by 0
- 2025RadGS-Reg: Registering Spine CT with Biplanar X-rays via Joint 3D Radiative Gaussians Reconstruction and 3D/3D Registrationcited by 0
- 2025LamiGauss: Pitching Radiative Gaussian for Sparse-View X-ray Laminography Reconstructioncited by 0
- 2025MORE: Multi-Organ Medical Image REconstruction Datasetcited by 0
- 2025A Gaussian Parameterization for Direct Atomic Structure Identification in Electron Tomographycited by 0
- 2025Resolving compositional and conformational heterogeneity in cryo-EM with deformable 3D Gaussian representationscited by 0
- 2026NAB: Neural Adaptive Binning for Sparse-View CT reconstructioncited by 0
- 20263D Field of Junctions: A Noise-Robust, Training-Free Structural Prior for Volumetric Inverse Problemscited by 0
- 2026DSA-SRGS: Super-Resolution Gaussian Splatting for Dynamic Sparse-View DSA Reconstructioncited by 0
- 2026InstantHDR: Single-forward Gaussian Splatting Initialization for HDR 3D Reconstructioncited by 0
- 2026GaussianPile: A Unified Sparse Gaussian Splatting Framework for Slice-based Volumetric Reconstructioncited by 0
- 2026Residual Gaussian Splatting for Ultra Sparse-View CBCT Reconstructioncited by 0
- 2026Texture-preserving implicit neural representation for Cone beam CT truncated reconstructioncited by 0
- 2026CD-RCM: Generalizable Continuous-Depth Novel View Synthesis for Reflectance Confocal Microscopycited by 0
50 most cited of 65 All 65 (JSON)
- 2026LINGO: Latent Initialization and Gradient Optimization for Sparse-view X-ray Novel View Synthesis and CT Reconstruction with 3D Gaussian Splatting19 Sep 2026
- 2026Shape-guided Gaussian Splatting for Sparse-View X-ray 3D Reconstruction9 Sep 2026
- 2026Diffusion-Encoding Gaussian Field for Joint k-q dMRI Reconstruction2 Sep 2026
- 2026SpectralCTGaussians: Projection-Domain Reconstruction and Basis Material Decomposition for Spectral CT using 3D Gaussian Splatting29 Aug 2026
- 2026PAGS: Autofocusing Photoacoustic Tomography via Speed-of-Sound-Adaptive Gaussian Splatting26 Aug 2026
- 2026Shared-Structure 4D Spectral Gaussian Representation for Sparse-View Spectral CT Reconstruction17 Aug 2026
- 2026TR-GS: High-Fidelity Sparse-View CT Volumetric Rendering via t-Distribution Gaussian Splatting and Ray-Confidence Modeling17 Aug 2026
- 2026Splat-based Metal Artifact Reduction in Cone-Beam CT via Polychromatic Modeling13 Aug 2026
- 2026Implicit representations are dead. Long live explicit primitives!7 Aug 2026
- 2026Splat-Based Metal Artifact Reduction in Cone-Beam CT via Compact Attenuation Modeling5 Aug 2026
- 2026Revisiting Pose Sensitivity in Splat-based Computed Tomography under Sparse-view Reconstruction5 Aug 2026
- 2026K-space Gaussian Representation for Parallel MRI29 Jul 2026
38 more
- 2026Agentic Autoresearch for CT Reconstruction24 Jul 2026
- 2026When Variance Is Not an Error Map: Calibrated Uncertainty for Radiative Gaussian Splatting in Sparse-View CT15 Jul 2026
- 2026UniSpine-GS: An Efficient Physics-Aware Gaussian Framework for Cross-Modality Multi-view Spine Image Synthesis6 Jul 2026
- 2026X-Splat: Gaussian Splatting for 3D CBCT Generation from Single Panoramic Radiograph2 Jul 2026
- 2026Rendering Novel Views of MRI Using 3D Gaussian Splatting24 Jun 2026
- 2026Projection-Volume Fidelity Divergence: Diagnosing and Controlling Optimization Drift in Sparse-View 3D Gaussian Tomography21 Jun 2026
- 2026CD-RCM: Generalizable Continuous-Depth Novel View Synthesis for Reflectance Confocal Microscopy10 Jun 2026
- 2026Texture-preserving implicit neural representation for Cone beam CT truncated reconstruction4 Jun 2026
- 20263D Skew Gaussian Splatting with Any Camera Trajectory Visualization Engine18 May 2026
- 2026Residual Gaussian Splatting for Ultra Sparse-View CBCT Reconstruction30 Apr 2026
- 2026Spatiotemporal Gaussian representation-based dynamic reconstruction and motion estimation framework for time-resolved volumetric MR imaging (DREME-GSMR)7 Apr 2026
- 20263D Gaussian Splatting for Annular Dark Field Scanning Transmission Electron Microscopy Tomography Reconstruction6 Apr 2026
- 2026GaussianPile: A Unified Sparse Gaussian Splatting Framework for Slice-based Volumetric Reconstruction21 Mar 2026
- 2026InstantHDR: Single-forward Gaussian Splatting Initialization for HDR 3D Reconstruction11 Mar 2026
- 2026Active View Selection with Perturbed Gaussian Ensemble for Tomographic Reconstruction6 Mar 2026
- 2026DSA-SRGS: Super-Resolution Gaussian Splatting for Dynamic Sparse-View DSA Reconstruction5 Mar 2026
- 20263D Field of Junctions: A Noise-Robust, Training-Free Structural Prior for Volumetric Inverse Problems2 Mar 2026
- 2026M-Gaussian: An Magnetic Gaussian Framework for Efficient Multi-Stack MRI Reconstruction24 Feb 2026
- 2026DM4CT: Benchmarking Diffusion Models for Computed Tomography Reconstruction20 Feb 2026
- 2026GR-Diffusion: 3D Gaussian Representation Meets Diffusion in Whole-Body PET Reconstruction12 Feb 2026
- 2026NAB: Neural Adaptive Binning for Sparse-View CT reconstruction2 Feb 2026
- 2026Radioactive 3D Gaussian Ray Tracing for Tomographic Reconstruction1 Feb 2026
- 2025Resolving compositional and conformational heterogeneity in cryo-EM with deformable 3D Gaussian representations25 Dec 2025
- 2025A Gaussian Parameterization for Direct Atomic Structure Identification in Electron Tomography17 Dec 2025
- 2025DenoiseGS: Gaussian Reconstruction Model for Burst Denoising28 Nov 2025
- 2025MORE: Multi-Organ Medical Image REconstruction Dataset30 Oct 2025
- 2025GEM: 3D Gaussian Splatting for Efficient and Accurate Cryo-EM Reconstruction29 Sep 2025
- 2025MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imaging20 Sep 2025
- 2025LamiGauss: Pitching Radiative Gaussian for Sparse-View X-ray Laminography Reconstruction17 Sep 2025
- 2025RadGS-Reg: Registering Spine CT with Biplanar X-rays via Joint 3D Radiative Gaussians Reconstruction and 3D/3D Registration28 Aug 2025
- 2025Zero-shot CT Super-Resolution using Diffusion-based 2D Projection Priors and Signed 3D Gaussians21 Aug 2025
- 2025InnerGS: Internal Scenes Reconstruction and Segmentation via Factorized 3D Gaussian Splatting18 Aug 2025
- 2025WIPES: Wavelet-based Visual Primitives18 Aug 2025
- 2025GR-Gaussian: Graph-Based Radiative Gaussian Splatting for Sparse-View CT Reconstruction4 Aug 2025
- 2025NerT-CA: Efficient Dynamic Reconstruction from Sparse-view X-ray Coronary Angiography25 Jul 2025
- 2025From Coarse to Fine: Learnable Discrete Wavelet Transforms for Efficient 3D Gaussian Splatting29 Jun 2025
- 2025DIGS: Dynamic CBCT Reconstruction using Deformation-Informed 4D Gaussian Splatting and a Low-Rank Free-Form Deformation Model27 Jun 2025
- 2025NeRF-based CBCT Reconstruction needs Normalization and Initialization24 Jun 2025
50 newest of 65 All 65 (JSON)
- 2026Agentic Autoresearch for CT Reconstructioncited by 0
- 2026Agentic Autoresearch for CT Reconstruction24 Jul 2026
- 2024Volumetrically Consistent 3D Gaussian Rasterizationcited by 11
- 2025UltraGauss: Ultrafast Gaussian Reconstruction of 3D Ultrasound Volumescited by 8
- 2024Discretized Gaussian Representation for Tomographic Reconstructioncited by 6
- 2025X2-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstructioncited by 6
- 2025Are Pixel-Wise Metrics Reliable for Sparse-View Computed Tomography Reconstruction?cited by 6
- 2025From Coarse to Fine: Learnable Discrete Wavelet Transforms for Efficient 3D Gaussian Splattingcited by 6
- 2025X-LRM: X-ray Large Reconstruction Model for Extremely Sparse-View Computed Tomography Recovery in One Secondcited by 5
- 2025X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomographycited by 5
- 2025GR-Gaussian: Graph-Based Radiative Gaussian Splatting for Sparse-View CT Reconstructioncited by 5
- 2025DeepSparse: A Foundation Model for Sparse-View CBCT Reconstructioncited by 4
- 20244DRGS: 4D Radiative Gaussian Splatting for Efficient 3D Vessel Reconstruction from Sparse-View Dynamic DSA Imagescited by 3
- 2025NeAS: 3D Reconstruction from X-ray Images using Neural Attenuation Surfacecited by 3
12 most cited of 62 All 62 (JSON)
- 2026LINGO: Latent Initialization and Gradient Optimization for Sparse-view X-ray Novel View Synthesis and CT Reconstruction with 3D Gaussian Splatting19 Sep 2026
- 2026Shape-guided Gaussian Splatting for Sparse-View X-ray 3D Reconstruction9 Sep 2026
- 2026Diffusion-Encoding Gaussian Field for Joint k-q dMRI Reconstruction2 Sep 2026
- 2026SpectralCTGaussians: Projection-Domain Reconstruction and Basis Material Decomposition for Spectral CT using 3D Gaussian Splatting29 Aug 2026
- 2026PAGS: Autofocusing Photoacoustic Tomography via Speed-of-Sound-Adaptive Gaussian Splatting26 Aug 2026
- 2026Shared-Structure 4D Spectral Gaussian Representation for Sparse-View Spectral CT Reconstruction17 Aug 2026
- 2026TR-GS: High-Fidelity Sparse-View CT Volumetric Rendering via t-Distribution Gaussian Splatting and Ray-Confidence Modeling17 Aug 2026
- 2026Splat-based Metal Artifact Reduction in Cone-Beam CT via Polychromatic Modeling13 Aug 2026
- 2026Implicit representations are dead. Long live explicit primitives!7 Aug 2026
- 2026Splat-Based Metal Artifact Reduction in Cone-Beam CT via Compact Attenuation Modeling5 Aug 2026
- 2026Revisiting Pose Sensitivity in Splat-based Computed Tomography under Sparse-view Reconstruction5 Aug 2026
- 2026K-space Gaussian Representation for Parallel MRI29 Jul 2026
12 newest of 62 All 62 (JSON)