# On hallucinations in tomographic image reconstruction

arXiv: https://arxiv.org/abs/2012.00646 · HTML: https://mlsanity.com/paper/2012.00646/

## Key facts

- Cited by 68 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Dec 2020.

## Built on by (most cited first, 30 of 68)

- [UnCRtainTS: Uncertainty Quantification for Cloud Removal in Optical Satellite Time Series](https://mlsanity.com/paper/2304.05464/) (2023)
- [Prior Image-Constrained Reconstruction using Style-Based Generative Models](https://mlsanity.com/paper/2102.12525/) (2021)
- [Multi-Spectral Multi-Image Super-Resolution of Sentinel-2 with Radiometric Consistency Losses and Its Effect on Building Delineation](https://mlsanity.com/paper/2111.03231/) (2021)
- [Progressive Divide-and-Conquer via Subsampling Decomposition for Accelerated MRI](https://mlsanity.com/paper/2403.10064/) (2024)
- [Assessing the ability of generative adversarial networks to learn canonical medical image statistics](https://mlsanity.com/paper/2204.12007/) (2022)
- [AmbientFlow: Invertible generative models from incomplete, noisy measurements](https://mlsanity.com/paper/2309.04856/) (2023)
- [Impact of deep learning-based image super-resolution on binary signal detection](https://mlsanity.com/paper/2107.02338/) (2021)
- [Synthetic Data in Radiological Imaging: Current State and Future Outlook](https://mlsanity.com/paper/2407.01561/) (2024)
- [NESTANets: Stable, accurate and efficient neural networks for analysis-sparse inverse problems](https://mlsanity.com/paper/2203.00804/) (2022)
- [Learning ReLU networks to high uniform accuracy is intractable](https://mlsanity.com/paper/2205.13531/) (2022)
- [Conditional Variational Diffusion Models](https://mlsanity.com/paper/2312.02246/) (2023)
- [SISMIK for brain MRI: Deep-learning-based motion estimation and model-based motion correction in k-space](https://mlsanity.com/paper/2312.13220/) (2023)
- [Report on the AAPM Grand Challenge on deep generative modeling for learning medical image statistics](https://mlsanity.com/paper/2405.01822/) (2024)
- [Posterior temperature optimized Bayesian models for inverse problems in medical imaging](https://mlsanity.com/paper/2202.00986/) (2022)
- [Mining the manifolds of deep generative models for multiple data-consistent solutions of ill-posed tomographic imaging problems](https://mlsanity.com/paper/2202.05311/) (2022)
- [Content-Aware Differential Privacy with Conditional Invertible Neural Networks](https://mlsanity.com/paper/2207.14625/) (2022)
- [Deep Learning-based Diffusion Tensor Cardiac Magnetic Resonance Reconstruction: A Comparison Study](https://mlsanity.com/paper/2304.00996/) (2023)
- [Learned, uncertainty-driven adaptive acquisition for photon-efficient scanning microscopy](https://mlsanity.com/paper/2310.16102/) (2023)
- [Metric-Guided Conformal Bounds for Probabilistic Image Reconstruction](https://mlsanity.com/paper/2404.15274/) (2024)
- [Systematic Review and Meta-analysis of AI-driven MRI Motion Artifact Detection and Correction](https://mlsanity.com/paper/2509.05071/) (2025)
- [Prior image-based medical image reconstruction using a style-based generative adversarial network](https://mlsanity.com/paper/2202.08936/) (2022)
- [Uncertainty Estimation and Out-of-Distribution Detection for Deep Learning-Based Image Reconstruction using the Local Lipschitz](https://mlsanity.com/paper/2305.07618/) (2023)
- [Erase to Enhance: Data-Efficient Machine Unlearning in MRI Reconstruction](https://mlsanity.com/paper/2405.15517/) (2024)
- [pcaGAN: Improving Posterior-Sampling cGANs via Principal Component Regularization](https://mlsanity.com/paper/2411.00605/) (2024)
- [TPC: Cross-Temporal Prediction Connection for Vision-Language Model Hallucination Reduction](https://mlsanity.com/paper/2503.04457/) (2025)
- [Conformal Bounds on Full-Reference Image Quality for Imaging Inverse Problems](https://mlsanity.com/paper/2505.09528/) (2025)
- [How many measurements are enough? Bayesian recovery in inverse problems with general distributions](https://mlsanity.com/paper/2505.10630/) (2025)
- [Evaluating Procedures for Establishing Generative Adversarial Network-based Stochastic Image Models in Medical Imaging](https://mlsanity.com/paper/2204.03547/) (2022)
- [Residual Back Projection With Untrained Neural Networks](https://mlsanity.com/paper/2210.14416/) (2022)
- [Optimization of array encoding for ultrasound imaging](https://mlsanity.com/paper/2403.00289/) (2024)

## Abstract (arXiv)

Tomographic image reconstruction is generally an ill-posed linear inverse problem. Such ill-posed inverse problems are typically regularized using prior knowledge of the sought-after object property. Recently, deep neural networks have been actively investigated for regularizing image reconstruction problems by learning a prior for the object properties from training images. However, an analysis of the prior information learned by these deep networks and their ability to generalize to data that may lie outside the training distribution is still being explored. An inaccurate prior might lead to false structures being hallucinated in the reconstructed image and that is a cause for serious concern in medical imaging. In this work, we propose to illustrate the effect of the prior imposed by a reconstruction method by decomposing the image estimate into generalized measurement and null components. The concept of a hallucination map is introduced for the general purpose of understanding the effect of the prior in regularized reconstruction methods. Numerical studies are conducted corresponding to a stylized tomographic imaging modality. The behavior of different reconstruction methods under the proposed formalism is discussed with the help of the numerical studies.