A Geometry-Informed Deep Learning Framework for Ultra-Sparse 3D Tomographic Image Reconstruction
Not on the map. Why?
Abstract (arXiv)
Deep learning affords enormous opportunities to augment the armamentarium of biomedical imaging, albeit its design and implementation have potential flaws. Fundamentally, most deep learning models are driven entirely by data without consideration of any prior knowledge, which dramatically increases the complexity of neural networks and limits the application scope and model generalizability. Here we establish a geometry-informed deep learning framework for ultra-sparse 3D tomographic image reconstruction. We introduce a novel mechanism for integrating geometric priors of the imaging system. We demonstrate that the seamless inclusion of known priors is essential to enhance the performance of 3D volumetric computed tomography imaging with ultra-sparse sampling. The study opens new avenues for data-driven biomedical imaging and promises to provide substantially improved imaging tools for various clinical imaging and image-guided interventions.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 36 of its 81 references that are in the map. First posted on arXiv 25 May 2021.
Builds on
36 of 81 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018Group Normalizationcited by 1,514
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
- 2018Explaining Explanations: An Overview of Interpretability of Machine Learningcited by 508
- 2016Deep Convolutional Neural Network for Inverse Problems in Imagingcited by 431
- 2019SynSin: End-to-end View Synthesis from a Single Imagecited by 364
24 more
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
- 2019What Do Single-view 3D Reconstruction Networks Learn?cited by 259
- 2017Learned Primal-dual Reconstructioncited by 251
- 2017Image reconstruction by domain transform manifold learningcited by 231
- 2017Learning a Multi-View Stereo Machinecited by 194
- 2019Unsupervised Learning of Probably Symmetric Deformable 3D Objects from Images in the Wildcited by 180
- 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
- 2018Escaping Plato's Cave: 3D Shape From Adversarial Renderingcited by 170
- 2017Solving ill-posed inverse problems using iterative deep neural networkscited by 145
- 2016Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervisioncited by 106
- 2017Framing U-Net via Deep Convolutional Framelets: Application to Sparse-view CTcited by 87
- 2019X2CT-GAN: Reconstructing CT from Biplanar X-Rays with Generative Adversarial Networkscited by 85
- 2019DuDoNet: Dual Domain Network for CT Metal Artifact Reductioncited by 68
- 2018Learning to Reconstruct Shapes from Unseen Classescited by 60
- 2019Image Reconstruction: From Sparsity to Data-adaptive Methods and Machine Learningcited by 60
- 2018Deep-neural-network based sinogram synthesis for sparse-view CT image reconstructioncited by 47
- 2020Deep Sinogram Completion with Image Prior for Metal Artifact Reduction in CT Imagescited by 40
- 2018Learning Spatial Common Sense with Geometry-Aware Recurrent Networkscited by 35
- 2019Explicit topological priors for deep-learning based image segmentation using persistent homologycited by 30
- 2019Modified U-Net (mU-Net) with Incorporation of Object-Dependent High Level Features for Improved Liver and Liver-Tumor Segmentation in CT Imagescited by 28
- 2019Learning with Known Operators reduces Maximum Training Error Boundscited by 25
- 2019Model-Based and Data-Driven Strategies in Medical Image Computingcited by 16
- 2017PWLS-ULTRA: An Efficient Clustering and Learning-Based Approach for Low-Dose 3D CT Image Reconstructioncited by 15
- 2018Deep Learning with Attention to Predict Gestational Age of the Fetal Braincited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 2; 2023: 1; 2024: 4; 2025: 2; 2026: 1.
11 papers.
- 2024DIFR3CT: Latent Diffusion for Probabilistic 3D CT Reconstruction from Few Planar X-Rayscited by 8
- 2022X-ray Dissectography Improves Lung Nodule Detectioncited by 1
- 2023SdCT-GAN: Reconstructing CT from Biplanar X-Rays with Self-driven Generative Adversarial Networkscited by 1
- 2024Low-resolution Prior Equilibrium Network for CT Reconstructioncited by 1
- 2025Surf2CT: Cascaded 3D Flow Matching Models for Torso 3D CT Synthesis from Skin Surfacecited by 1
- 2021X-ray Dissectography Enables Stereotography to Improve Diagnostic Performancecited by 0
- 2022Enhanced artificial intelligence-based diagnosis using CBCT with internal denoising: Clinical validation for discrimination of fungal ball, sinusitis, and normal cases in the maxillary sinuscited by 0
- 2024GuidedRec: Guiding Ill-Posed Unsupervised Volumetric Recoverycited by 0
- 2024Multi-sensor Learning Enables Information Transfer across Different Sensory Data and Augments Multi-modality Imagingcited by 0
- 2025Novel-view X-ray Projection Synthesis through Geometry-Integrated Deep Learningcited by 0
- 2026Deep learning Based Correction Algorithms for 3D Medical Reconstruction in Computed Tomography and Macroscopic Imagingcited by 0
- 2026Deep learning Based Correction Algorithms for 3D Medical Reconstruction in Computed Tomography and Macroscopic Imaging30 Jan 2026
- 2025Surf2CT: Cascaded 3D Flow Matching Models for Torso 3D CT Synthesis from Skin Surface28 May 2025
- 2025Novel-view X-ray Projection Synthesis through Geometry-Integrated Deep Learning16 Apr 2025
- 2024Multi-sensor Learning Enables Information Transfer across Different Sensory Data and Augments Multi-modality Imaging28 Sep 2024
- 2024DIFR3CT: Latent Diffusion for Probabilistic 3D CT Reconstruction from Few Planar X-Rays27 Aug 2024
- 2024GuidedRec: Guiding Ill-Posed Unsupervised Volumetric Recovery20 May 2024
- 2024Low-resolution Prior Equilibrium Network for CT Reconstruction28 Jan 2024
- 2023SdCT-GAN: Reconstructing CT from Biplanar X-Rays with Self-driven Generative Adversarial Networks10 Sep 2023
- 2022Enhanced artificial intelligence-based diagnosis using CBCT with internal denoising: Clinical validation for discrimination of fungal ball, sinusitis, and normal cases in the maxillary sinus29 Nov 2022
- 2022X-ray Dissectography Improves Lung Nodule Detection24 Mar 2022
- 2021X-ray Dissectography Enables Stereotography to Improve Diagnostic Performance30 Nov 2021