# DeepSparse: A Foundation Model for Sparse-View CBCT Reconstruction

arXiv: https://arxiv.org/abs/2505.02628 · HTML: https://mlsanity.com/paper/2505.02628/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 33 of its 65 references that are in the map.
- First posted on arXiv 5 May 2025.

## Builds on (most cited first, 30 of 33)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Densely Connected Convolutional Networks](https://mlsanity.com/paper/1608.06993/) (2016)
- [pixelNeRF: Neural Radiance Fields from One or Few Images](https://mlsanity.com/paper/2012.02190/) (2020)
- [Generating Diverse High-Fidelity Images with VQ-VAE-2](https://mlsanity.com/paper/1906.00446/) (2019)
- [Solving Inverse Problems in Medical Imaging with Score-Based Generative Models](https://mlsanity.com/paper/2111.08005/) (2021)
- [Deep Convolutional Neural Network for Inverse Problems in Imaging](https://mlsanity.com/paper/1611.03679/) (2016)
- [BBDM: Image-to-image Translation with Brownian Bridge Diffusion Models](https://mlsanity.com/paper/2205.07680/) (2022)
- [Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challenge](https://mlsanity.com/paper/1612.08012/) (2016)
- [NeRP: Implicit Neural Representation Learning with Prior Embedding for Sparsely Sampled Image Reconstruction](https://mlsanity.com/paper/2108.10991/) (2021)
- [Solving 3D Inverse Problems using Pre-trained 2D Diffusion Models](https://mlsanity.com/paper/2211.10655/) (2022)
- [NAF: Neural Attenuation Fields for Sparse-View CBCT Reconstruction](https://mlsanity.com/paper/2209.14540/) (2022)
- [X2CT-GAN: Reconstructing CT from Biplanar X-Rays with Generative Adversarial Networks](https://mlsanity.com/paper/1905.06902/) (2019)
- [A Vision-Language Foundation Model to Enhance Efficiency of Chest X-ray Interpretation](https://mlsanity.com/paper/2401.12208/) (2024)
- [DuDoNet: Dual Domain Network for CT Metal Artifact Reduction](https://mlsanity.com/paper/1907.00273/) (2019)
- [R2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction](https://mlsanity.com/paper/2405.20693/) (2024)
- [AbdomenAtlas-8K: Annotating 8,000 CT Volumes for Multi-Organ Segmentation in Three Weeks](https://mlsanity.com/paper/2305.09666/) (2023)
- [Learning Deep Intensity Field for Extremely Sparse-View CBCT Reconstruction](https://mlsanity.com/paper/2303.06681/) (2023)
- [Radon Inversion via Deep Learning](https://mlsanity.com/paper/1808.03015/) (2018)
- [Enhancing Representation in Radiography-Reports Foundation Model: A Granular Alignment Algorithm Using Masked Contrastive Learning](https://mlsanity.com/paper/2309.05904/) (2023)
- [Towards a Holistic Framework for Multimodal Large Language Models in Three-dimensional Brain CT Report Generation](https://mlsanity.com/paper/2407.02235/) (2024)
- [EVA-X: A Foundation Model for General Chest X-ray Analysis with Self-supervised Learning](https://mlsanity.com/paper/2405.05237/) (2024)
- [Interpretable Bilingual Multimodal Large Language Model for Diverse Biomedical Tasks](https://mlsanity.com/paper/2410.18387/) (2024)
- [Triad: Vision Foundation Model for 3D Magnetic Resonance Imaging](https://mlsanity.com/paper/2502.14064/) (2025)
- [SNAF: Sparse-view CBCT Reconstruction with Neural Attenuation Fields](https://mlsanity.com/paper/2211.17048/) (2022)
- [Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis](https://mlsanity.com/paper/1611.06391/) (2016)
- [FreeSeed: Frequency-band-aware and Self-guided Network for Sparse-view CT Reconstruction](https://mlsanity.com/paper/2307.05890/) (2023)
- [Perspective Projection-Based 3D CT Reconstruction from Biplanar X-rays](https://mlsanity.com/paper/2303.05297/) (2023)
- [Learning 3D Gaussians for Extremely Sparse-View Cone-Beam CT Reconstruction](https://mlsanity.com/paper/2407.01090/) (2024)
- [C^2RV: Cross-Regional and Cross-View Learning for Sparse-View CBCT Reconstruction](https://mlsanity.com/paper/2406.03902/) (2024)
- [DuDoTrans: Dual-Domain Transformer Provides More Attention for Sinogram Restoration in Sparse-View CT Reconstruction](https://mlsanity.com/paper/2111.10790/) (2021)

## Built on by (most cited first, 5 of 5)

- [X-GRM: Large Gaussian Reconstruction Model for Sparse-view X-rays to Computed Tomography](https://mlsanity.com/paper/2505.15235/) (2025)
- [Cross-view Generalized Diffusion Model for Sparse-view CT Reconstruction](https://mlsanity.com/paper/2508.10313/) (2025)
- [ILV: Iterative Latent Volumes for Fast and Accurate Sparse-View CT Reconstruction](https://mlsanity.com/paper/2603.14915/) (2026)
- [LUCID: Learned Undersampling-Adaptive Consistency-Guided Inference with Deterministic Flow Matching for Sparse-View CT Reconstruction](https://mlsanity.com/paper/2606.16212/) (2026)
- [RePrior: Measurement-Reconciled Prior Correction for Sparse-View CBCT Reconstruction](https://mlsanity.com/paper/2610.14102/) (2026)

## Abstract (arXiv)

Cone-beam computed tomography (CBCT) is a critical 3D imaging technology in the medical field, while the high radiation exposure required for high-quality imaging raises significant concerns, particularly for vulnerable populations. Sparse-view reconstruction reduces radiation by using fewer X-ray projections while maintaining image quality, yet existing methods face challenges such as high computational demands and poor generalizability to different datasets. To overcome these limitations, we propose DeepSparse, the first foundation model for sparse-view CBCT reconstruction, featuring DiCE (Dual-Dimensional Cross-Scale Embedding), a novel network that integrates multi-view 2D features and multi-scale 3D features. Additionally, we introduce the HyViP (Hybrid View Sampling Pretraining) framework, which pretrains the model on large datasets with both sparse-view and dense-view projections, and a two-step finetuning strategy to adapt and refine the model for new datasets. Extensive experiments and ablation studies demonstrate that our proposed DeepSparse achieves superior reconstruction quality compared to state-of-the-art methods, paving the way for safer and more efficient CBCT imaging.