Structure-Aware Sparse-View X-ray 3D Reconstruction
Not on the map. Why?
Abstract (arXiv)
X-ray, known for its ability to reveal internal structures of objects, is expected to provide richer information for 3D reconstruction than visible light. Yet, existing neural radiance fields (NeRF) algorithms overlook this important nature of X-ray, leading to their limitations in capturing structural contents of imaged objects. In this paper, we propose a framework, Structure-Aware X-ray Neural Radiodensity Fields (SAX-NeRF), for sparse-view X-ray 3D reconstruction. Firstly, we design a Line Segment-based Transformer (Lineformer) as the backbone of SAX-NeRF. Linefomer captures internal structures of objects in 3D space by modeling the dependencies within each line segment of an X-ray. Secondly, we present a Masked Local-Global (MLG) ray sampling strategy to extract contextual and geometric information in 2D projection. Plus, we collect a larger-scale dataset X3D covering wider X-ray applications. Experiments on X3D show that SAX-NeRF surpasses previous NeRF-based methods by 12.56 and 2.49 dB on novel view synthesis and CT reconstruction. Code, models, and data are released at https://github.com/caiyuanhao1998/SAX-NeRF
Key facts. Cited by 70 papers in the map (data through 7 Oct 2026). Builds on 33 of its 60 references that are in the map. First posted on arXiv 18 Nov 2023.
Builds on
33 of 60 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2021ViViT: A Video Vision Transformercited by 1,610
21 more
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2023Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancementcited by 228
- 2021TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Upcited by 162
- 2015DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentationcited by 158
- 2021StyleSwin: Transformer-based GAN for High-resolution Image Generationcited by 152
- 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
- 2022Solving 3D Inverse Problems using Pre-trained 2D Diffusion Modelscited by 130
- 2021Generative Adversarial Transformerscited by 120
- 2021Mask-guided Spectral-wise Transformer for Efficient Hyperspectral Image Reconstructioncited by 110
- 2021Light Field Neural Renderingcited by 108
- 2022NAF: Neural Attenuation Fields for Sparse-View CBCT Reconstructioncited by 106
- 2019X2CT-GAN: Reconstructing CT from Biplanar X-Rays with Generative Adversarial Networkscited by 85
- 2022MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-raycited by 66
- 2022Degradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imagingcited by 66
- 2023NeuRBF: A Neural Fields Representation with Adaptive Radial Basis Functionscited by 65
- 2023Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstructioncited by 42
- 2017Lose The Views: Limited Angle CT Reconstruction via Implicit Sinogram Completioncited by 31
- 2020End-To-End Convolutional Neural Network for 3D Reconstruction of Knee Bones From Bi-Planar X-Ray Imagescited by 28
Built on by
Citing papers per year: 2023: 1; 2024: 19; 2025: 28; 2026: 22.
70 papers.
Sort:
By area:
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2024PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generationcited by 185
- 2024R2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstructioncited by 65
- 2024Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesiscited by 56
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 40
- 2024HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed via Gaussian Splattingcited by 35
- 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Resultscited by 26
- 2024LangSurf: Language-Embedded Surface Gaussians for 3D Scene Understandingcited by 17
- 2024Volumetrically Consistent 3D Gaussian Rasterizationcited by 11
- 2024Neural Radiance Fields in Medical Imaging: A Surveycited by 7
- 2025MASIV: Toward Material-Agnostic System Identification from Videoscited by 7
- 2024Discretized Gaussian Representation for Tomographic Reconstructioncited by 6
38 more
- 2025X2-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstructioncited by 6
- 2025Are Pixel-Wise Metrics Reliable for Sparse-View Computed Tomography Reconstruction?cited by 6
- 20243D Vessel Reconstruction from Sparse-View Dynamic DSA Images via Vessel Probability Guided Attenuation Learningcited by 5
- 2025X-LRM: X-ray Large Reconstruction Model for Extremely Sparse-View Computed Tomography Recovery in One Secondcited by 5
- 2025X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomographycited by 5
- 2025GR-Gaussian: Graph-Based Radiative Gaussian Splatting for Sparse-View CT Reconstructioncited by 5
- 2024NeRF-CA: Dynamic Reconstruction of X-ray Coronary Angiography with Extremely Sparse-viewscited by 4
- 2024Differentiable Voxel-based X-ray Rendering Improves Sparse-View 3D CBCT Reconstructioncited by 3
- 2024Unsupervised Multi-Parameter Inverse Solving for Reducing Ring Artifacts in 3D X-Ray CBCTcited by 3
- 20244DRGS: 4D Radiative Gaussian Splatting for Efficient 3D Vessel Reconstruction from Sparse-View Dynamic DSA Imagescited by 3
- 2025NeAS: 3D Reconstruction from X-ray Images using Neural Attenuation Surfacecited by 3
- 2025Render-FM: Feedforward Model for Real-time Photorealistic Volumetric Renderingcited by 3
- 2025InnerGS: Internal Scenes Reconstruction and Segmentation via Factorized 3D Gaussian Splattingcited by 3
- 2025MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imagingcited by 3
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancementcited by 3
- 2025X-Field: A Physically Grounded Representation for 3D X-ray Reconstructioncited by 2
- 2025NeRF-based CBCT Reconstruction needs Normalization and Initializationcited by 2
- 2023HISR: Hybrid Implicit Surface Representation for Photorealistic 3D Human Reconstructioncited by 1
- 2024Epi-NAF: Enhancing Neural Attenuation Fields for Limited-Angle CT with Epipolar Consistency Conditionscited by 1
- 2024PAD-F: Prior-Aware Debiasing Framework for Long-Tailed X-ray Prohibited Item Detectioncited by 1
- 2025Adaptive Multi-resolution Hash-Encoding Framework for INR-based Dental CBCT Reconstruction with Truncated FOVcited by 1
- 2025NerT-CA: Efficient Dynamic Reconstruction from Sparse-view X-ray Coronary Angiographycited by 1
- 2025Zero-shot CT Super-Resolution using Diffusion-based 2D Projection Priors and Signed 3D Gaussianscited by 1
- 2025FrontierGS: Progressive View-Space Frontier Expansion for Sparse 3D Gaussian Splattingcited by 1
- 2025DenoiseGS: Gaussian Reconstruction Model for Burst Denoisingcited by 1
- 2026Radioactive 3D Gaussian Ray Tracing for Tomographic Reconstructioncited by 1
- 2026Active View Selection with Perturbed Gaussian Ensemble for Tomographic Reconstructioncited by 1
- 2026Disentangled Learning Improves Implicit Neural Representations for Medical Reconstructioncited by 1
- 2026LINGO: Latent Initialization and Gradient Optimization for Sparse-view X-ray Novel View Synthesis and CT Reconstruction with 3D Gaussian Splattingcited by 1
- 2024Fan-Beam CT Reconstruction for Unaligned Sparse-View X-ray Baggage Datasetcited by 0
- 2025Physics-informed 4D X-ray image reconstruction from ultra-sparse spatiotemporal datacited by 0
- 2025X2BR: High-Fidelity 3D Bone Reconstruction from a Planar X-Ray Image with Hybrid Neural Implicit Methodscited by 0
- 2025IXGS-Intraoperative 3D Reconstruction from Sparse, Arbitrarily Posed Real X-rayscited by 0
- 2025RadGS-Reg: Registering Spine CT with Biplanar X-rays via Joint 3D Radiative Gaussians Reconstruction and 3D/3D Registrationcited by 0
- 2025LatXGen: Towards Radiation-Free and Accurate Quantitative Analysis of Sagittal Spinal Alignment Via Cross-Modal Radiographic View Synthesiscited by 0
- 2025Iterative Diffusion-Refined Neural Attenuation Fields for Multi-Source Stationary CT Reconstruction: NAF Meets Diffusion Modelcited by 0
- 2025ReBrain: Brain MRI Reconstruction from Sparse CT Slice via Retrieval-Augmented Diffusioncited by 0
- 2025TPG-INR: Target Prior-Guided Implicit 3D CT Reconstruction for Enhanced Sparse-view Imagingcited by 0
50 most cited of 70 All 70 (JSON)
- 2026LINGO: Latent Initialization and Gradient Optimization for Sparse-view X-ray Novel View Synthesis and CT Reconstruction with 3D Gaussian Splatting19 Sep 2026
- 2026Shape-guided Gaussian Splatting for Sparse-View X-ray 3D Reconstruction9 Sep 2026
- 2026Learning Where and What to Lift for Bi-planar X-ray-to-CT Reconstruction18 Aug 2026
- 2026Shared-Structure 4D Spectral Gaussian Representation for Sparse-View Spectral CT Reconstruction17 Aug 2026
- 2026TR-GS: High-Fidelity Sparse-View CT Volumetric Rendering via t-Distribution Gaussian Splatting and Ray-Confidence Modeling17 Aug 2026
- 2026Splat-based Metal Artifact Reduction in Cone-Beam CT via Polychromatic Modeling13 Aug 2026
- 2026Splat-Based Metal Artifact Reduction in Cone-Beam CT via Compact Attenuation Modeling5 Aug 2026
- 2026Revisiting Pose Sensitivity in Splat-based Computed Tomography under Sparse-view Reconstruction5 Aug 2026
- 2026K-NeAS: Scalable Multi-Material CT Reconstruction Using Neural SDFs15 Jul 2026
- 2026UniSpine-GS: An Efficient Physics-Aware Gaussian Framework for Cross-Modality Multi-view Spine Image Synthesis6 Jul 2026
- 2026X-Splat: Gaussian Splatting for 3D CBCT Generation from Single Panoramic Radiograph2 Jul 2026
- 2026Texture-preserving implicit neural representation for Cone beam CT truncated reconstruction4 Jun 2026
38 more
- 2026Disentangled Learning Improves Implicit Neural Representations for Medical Reconstruction5 May 2026
- 2026DiffNR: Diffusion-Enhanced Neural Representation Optimization for Sparse-View 3D Tomographic Reconstruction23 Apr 2026
- 2026GaussianPile: A Unified Sparse Gaussian Splatting Framework for Slice-based Volumetric Reconstruction21 Mar 2026
- 2026ILV: Iterative Latent Volumes for Fast and Accurate Sparse-View CT Reconstruction16 Mar 2026
- 2026Active View Selection with Perturbed Gaussian Ensemble for Tomographic Reconstruction6 Mar 2026
- 2026DefenseSplat: Enhancing the Robustness of 3D Gaussian Splatting via Frequency-Aware Filtering22 Feb 2026
- 2026TG-Field: Geometry-Aware Radiative Gaussian Fields for Tomographic Reconstruction12 Feb 2026
- 2026NAB: Neural Adaptive Binning for Sparse-View CT reconstruction2 Feb 2026
- 2026Radioactive 3D Gaussian Ray Tracing for Tomographic Reconstruction1 Feb 2026
- 2026DuFal: Dual-Frequency-Aware Learning for High-Fidelity Extremely Sparse-view CBCT Reconstruction21 Jan 2026
- 2025XDen-1K: A Density Field Dataset of Real-World Objects11 Dec 2025
- 2025LoGoColor: Local-Global 3D Colorization for 360deg Scenes10 Dec 2025
- 2025See More, Change Less: Anatomy-Aware Diffusion for Contrast Enhancement8 Dec 2025
- 2025DenoiseGS: Gaussian Reconstruction Model for Burst Denoising28 Nov 2025
- 2025TPG-INR: Target Prior-Guided Implicit 3D CT Reconstruction for Enhanced Sparse-view Imaging24 Nov 2025
- 2025ReBrain: Brain MRI Reconstruction from Sparse CT Slice via Retrieval-Augmented Diffusion21 Nov 2025
- 2025FrontierGS: Progressive View-Space Frontier Expansion for Sparse 3D Gaussian Splatting20 Nov 2025
- 2025Iterative Diffusion-Refined Neural Attenuation Fields for Multi-Source Stationary CT Reconstruction: NAF Meets Diffusion Model18 Nov 2025
- 2025LatXGen: Towards Radiation-Free and Accurate Quantitative Analysis of Sagittal Spinal Alignment Via Cross-Modal Radiographic View Synthesis29 Sep 2025
- 2025MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imaging20 Sep 2025
- 2025RadGS-Reg: Registering Spine CT with Biplanar X-rays via Joint 3D Radiative Gaussians Reconstruction and 3D/3D Registration28 Aug 2025
- 2025Zero-shot CT Super-Resolution using Diffusion-based 2D Projection Priors and Signed 3D Gaussians21 Aug 2025
- 2025InnerGS: Internal Scenes Reconstruction and Segmentation via Factorized 3D Gaussian Splatting18 Aug 2025
- 2025GR-Gaussian: Graph-Based Radiative Gaussian Splatting for Sparse-View CT Reconstruction4 Aug 2025
- 2025MASIV: Toward Material-Agnostic System Identification from Videos1 Aug 2025
- 2025NerT-CA: Efficient Dynamic Reconstruction from Sparse-view X-ray Coronary Angiography25 Jul 2025
- 2025NeRF-based CBCT Reconstruction needs Normalization and Initialization24 Jun 2025
- 2025Adaptive Multi-resolution Hash-Encoding Framework for INR-based Dental CBCT Reconstruction with Truncated FOV14 Jun 2025
- 2025Are Pixel-Wise Metrics Reliable for Sparse-View Computed Tomography Reconstruction?2 Jun 2025
- 2025Render-FM: Feedforward Model for Real-time Photorealistic Volumetric Rendering22 May 2025
- 2025X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomography21 May 2025
- 2025IXGS-Intraoperative 3D Reconstruction from Sparse, Arbitrarily Posed Real X-rays20 Apr 2025
- 2025X2BR: High-Fidelity 3D Bone Reconstruction from a Planar X-Ray Image with Hybrid Neural Implicit Methods11 Apr 2025
- 2025Physics-informed 4D X-ray image reconstruction from ultra-sparse spatiotemporal data4 Apr 2025
- 2025X2-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstruction27 Mar 2025
- 2025X-Field: A Physically Grounded Representation for 3D X-ray Reconstruction11 Mar 2025
- 2025NeAS: 3D Reconstruction from X-ray Images using Neural Attenuation Surface10 Mar 2025
- 2025X-LRM: X-ray Large Reconstruction Model for Extremely Sparse-View Computed Tomography Recovery in One Second9 Mar 2025
50 newest of 70 All 70 (JSON)
- 2024A Survey on 3D Gaussian Splattingcited by 221
- 2024R2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstructioncited by 65
- 2024Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesiscited by 56
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 40
- 2024HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed via Gaussian Splattingcited by 35
- 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Resultscited by 26
- 2024LangSurf: Language-Embedded Surface Gaussians for 3D Scene Understandingcited by 17
- 2024Volumetrically Consistent 3D Gaussian Rasterizationcited by 11
- 2024Neural Radiance Fields in Medical Imaging: A Surveycited by 7
- 2025MASIV: Toward Material-Agnostic System Identification from Videoscited by 7
- 2024Discretized Gaussian Representation for Tomographic Reconstructioncited by 6
- 2025X2-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstructioncited by 6
12 most cited of 67 All 67 (JSON)
- 2026LINGO: Latent Initialization and Gradient Optimization for Sparse-view X-ray Novel View Synthesis and CT Reconstruction with 3D Gaussian Splatting19 Sep 2026
- 2026Shape-guided Gaussian Splatting for Sparse-View X-ray 3D Reconstruction9 Sep 2026
- 2026Learning Where and What to Lift for Bi-planar X-ray-to-CT Reconstruction18 Aug 2026
- 2026Shared-Structure 4D Spectral Gaussian Representation for Sparse-View Spectral CT Reconstruction17 Aug 2026
- 2026TR-GS: High-Fidelity Sparse-View CT Volumetric Rendering via t-Distribution Gaussian Splatting and Ray-Confidence Modeling17 Aug 2026
- 2026Splat-based Metal Artifact Reduction in Cone-Beam CT via Polychromatic Modeling13 Aug 2026
- 2026Splat-Based Metal Artifact Reduction in Cone-Beam CT via Compact Attenuation Modeling5 Aug 2026
- 2026Revisiting Pose Sensitivity in Splat-based Computed Tomography under Sparse-view Reconstruction5 Aug 2026
- 2026K-NeAS: Scalable Multi-Material CT Reconstruction Using Neural SDFs15 Jul 2026
- 2026UniSpine-GS: An Efficient Physics-Aware Gaussian Framework for Cross-Modality Multi-view Spine Image Synthesis6 Jul 2026
- 2026X-Splat: Gaussian Splatting for 3D CBCT Generation from Single Panoramic Radiograph2 Jul 2026
- 2026Texture-preserving implicit neural representation for Cone beam CT truncated reconstruction4 Jun 2026
12 newest of 67 All 67 (JSON)