Hallucination Detection in Virtually-Stained Histology: A Latent Space Baseline
Not on the map. Why?
Abstract (arXiv)
Histopathologic analysis of stained tissue remains central to biomedical research and clinical care. Virtual staining (VS) offers a promising alternative, with potential to reduce costs and streamline workflows, yet hallucinations pose serious risks to clinical reliability. Here, we formalize the problem of hallucination detection in VS and propose a scalable post-hoc method: Neural Hallucination Precursor (NHP), which leverages the generator's latent space to preemptively flag hallucinations. Extensive experiments across diverse VS tasks show NHP is both effective and robust. Critically, we also find that models with fewer hallucinations do not necessarily offer better detectability, exposing a gap in current VS evaluation and underscoring the need for hallucination detection benchmarks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 63 of its 91 references that are in the map. First posted on arXiv 22 Nov 2024.
Builds on
63 of 91 references.
References · 63
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 903
38 more
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2022Out-of-Distribution Detection with Deep Nearest Neighborscited by 596
- 2020Underspecification Presents Challenges for Credibility in Modern Machine Learningcited by 488
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2022ViM: Out-Of-Distribution with Virtual-logit Matchingcited by 404
- 2021MagFace: A Universal Representation for Face Recognition and Quality Assessmentcited by 332
- 2021Deep ViT Features as Dense Visual Descriptorscited by 327
- 2021Unsolved Problems in ML Safetycited by 291
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
- 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
- 2021Deep Deterministic Uncertainty: A Simple Baselinecited by 200
- 2018Reducing Network Agnostophobiacited by 165
- 2019Ensemble Distribution Distillationcited by 158
- 2018Adversarially Learned Anomaly Detectioncited by 115
- 2020Old is Gold: Redefining the Adversarially Learned One-Class Classifier Training Paradigmcited by 115
- 2021DEUP: Direct Epistemic Uncertainty Predictioncited by 102
- 2018Distribution Matching Losses Can Hallucinate Features in Medical Image Translationcited by 99
- 2021On Feature Collapse and Deep Kernel Learning for Single Forward Pass Uncertaintycited by 87
- 2022Full-Spectrum Out-of-Distribution Detectioncited by 63
- 2021On the Practicality of Deterministic Epistemic Uncertaintycited by 62
- 2022BCI: Breast Cancer Immunohistochemical Image Generation through Pyramid Pix2pixcited by 61
- 2021Hierarchical VAEs Know What They Don't Knowcited by 58
- 2023Feed Two Birds with One Scone: Exploiting Wild Data for Both Out-of-Distribution Generalization and Detectioncited by 57
- 2020Deep learning-based transformation of the H&E stain into special stainscited by 55
- 2022A Call to Reflect on Evaluation Practices for Failure Detection in Image Classificationcited by 51
- 2023Adaptive Supervised PatchNCE Loss for Learning H&E-to-IHC Stain Translation with Inconsistent Groundtruth Image Pairscited by 38
- 2019Outside the Box: Abstraction-Based Monitoring of Neural Networkscited by 36
- 2022Block Selection Method for Using Feature Norm in Out-of-distribution Detectioncited by 30
- 2020An Empirical Evaluation on Robustness and Uncertainty of Regularization Methodscited by 28
- 2022Benchmarking the Robustness of Deep Neural Networks to Common Corruptions in Digital Pathologycited by 26
- 2022Predicting is not Understanding: Recognizing and Addressing Underspecification in Machine Learningcited by 26
- 2023SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathologycited by 25
- 2022Out-Of-Distribution Detection Is Not All You Needcited by 23
- 2024Pathological Semantics-Preserving Learning for H&E-to-IHC Virtual Stainingcited by 21
- 2022Watermark Vaccine: Adversarial Attacks to Prevent Watermark Removalcited by 18
- 2023Benchmarking common uncertainty estimation methods with histopathological images under domain shift and label noisecited by 15
50 most cited of 63 All 63 (JSON)
Built on by
Not cited yet.