IXGS-Intraoperative 3D Reconstruction from Sparse, Arbitrarily Posed Real X-rays
Not on the map. Why?
Abstract (arXiv)
Spine surgery is a high-risk intervention demanding precise execution, often supported by image-based navigation systems. Recently, supervised learning approaches have gained attention for reconstructing 3D spinal anatomy from sparse fluoroscopic data, significantly reducing reliance on radiation-intensive 3D imaging systems. However, these methods typically require large amounts of annotated training data and may struggle to generalize across varying patient anatomies or imaging conditions. Instance-learning approaches like Gaussian splatting could offer an alternative by avoiding extensive annotation requirements. While Gaussian splatting has shown promise for novel view synthesis, its application to sparse, arbitrarily posed real intraoperative X-rays has remained largely unexplored. This work addresses this limitation by extending the R2-Gaussian splatting framework to reconstruct anatomically consistent 3D volumes under these challenging conditions. We introduce an anatomy-guided radiographic standardization step using style transfer, improving visual consistency across views, and enhancing reconstruction quality. Notably, our framework requires no pretraining, making it inherently adaptable to new patients and anatomies. We evaluated our approach using an ex-vivo dataset. Expert surgical evaluation confirmed the clinical utility of the 3D reconstructions for navigation, especially when using 20 to 30 views, and highlighted the standardization's benefit for anatomical clarity. Benchmarking via quantitative 2D metrics (PSNR/SSIM) confirmed performance trade-offs compared to idealized settings, but also validated the improvement gained from standardization over raw inputs. This work demonstrates the feasibility of instance-based volumetric reconstruction from arbitrary sparse-view X-rays, advancing intraoperative 3D imaging for surgical navigation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 55 references that are in the map. First posted on arXiv 20 Apr 2025.
Builds on
20 of 55 references.
References · 20
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 982
- 2023Vision Transformers Need Registerscited by 871
- 2023Medical SAM Adapter: Adapting Segment Anything Model for Medical Image Segmentationcited by 490
- 2017Learning a Multi-View Stereo Machinecited by 194
- 2023Structure-Aware Sparse-View X-ray 3D Reconstructioncited by 72
- 2024R2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstructioncited by 67
- 2022MedNeRF: Medical Neural Radiance Fields for Reconstructing 3D-aware CT-Projections from a Single X-raycited by 66
- 2024Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesiscited by 58
- 2023NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshescited by 53
8 more
- 2024Deform3DGS: Flexible Deformation for Fast Surgical Scene Reconstruction with Gaussian Splattingcited by 38
- 2020End-To-End Convolutional Neural Network for 3D Reconstruction of Knee Bones From Bi-Planar X-Ray Imagescited by 28
- 2023Ultra-NeRF: Neural Radiance Fields for Ultrasound Imagingcited by 27
- 2024DDGS-CT: Direction-Disentangled Gaussian Splatting for Realistic Volume Renderingcited by 23
- 2024Similarity and Quality Metrics for MR Image-To-Image Translationcited by 20
- 2024Gaussian in the Dark: Real-Time View Synthesis From Inconsistent Dark Images Using Gaussian Splattingcited by 20
- 2024A study on the adequacy of common IQA measures for medical imagescited by 10
- 2024Domain adaptation strategies for 3D reconstruction of the lumbar spine using real fluoroscopy datacited by 2
Built on by
Not cited yet.