# GazeXPErT: An Expert Eye-tracking Dataset for Interpretable and Explainable AI in Oncologic FDG-PET/CT Scans

arXiv: https://arxiv.org/abs/2603.00162 · HTML: https://mlsanity.com/paper/2603.00162/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 14 of its 73 references that are in the map.
- First posted on arXiv 26 Feb 2026.

## Builds on (most cited first, 14 of 14)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Segment Anything](https://mlsanity.com/paper/2304.02643/) (2023)
- [nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentation](https://mlsanity.com/paper/2404.09556/) (2024)
- [Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Development](https://mlsanity.com/paper/2009.07386/) (2020)
- [REFLACX, a dataset of reports and eye-tracking data for localization of abnormalities in chest x-rays](https://mlsanity.com/paper/2109.14187/) (2021)
- [GazeGNN: A Gaze-Guided Graph Neural Network for Chest X-ray Classification](https://mlsanity.com/paper/2305.18221/) (2023)
- [Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning](https://mlsanity.com/paper/2403.12416/) (2024)
- [A Collaborative Computer Aided Diagnosis (C-CAD) System with Eye-Tracking, Sparse Attentional Model, and Deep Learning](https://mlsanity.com/paper/1802.06260/) (2018)
- [Gaze2Segment: A Pilot Study for Integrating Eye-Tracking Technology into Medical Image Segmentation](https://mlsanity.com/paper/1608.03235/) (2016)
- [Using Eye-tracking Data to Predict Situation Awareness in Real Time during Takeover Transitions in Conditionally Automated Driving](https://mlsanity.com/paper/2103.14792/) (2021)
- [Gaze-Assisted Medical Image Segmentation](https://mlsanity.com/paper/2410.17920/) (2024)
- [FG-CXR: A Radiologist-Aligned Gaze Dataset for Enhancing Interpretability in Chest X-Ray Report Generation](https://mlsanity.com/paper/2411.15413/) (2024)
- [When Eye-Tracking Meets Machine Learning: A Systematic Review on Applications in Medical Image Analysis](https://mlsanity.com/paper/2403.07834/) (2024)

## Abstract (arXiv)

[18F]FDG-PET/CT is a cornerstone imaging modality for guiding oncology therapies, yet human expert shortages necessitate more efficient diagnostic aids. While standalone AI models for automatic lesion detection exist, clinical translation remains hindered by AI explainability, reliability, and workflow integration. Meanwhile, human-computer-interaction in radiology remain limited to keyboard, mouse and voice, ignoring experts' faster, natural gaze signal. We present GazeXPErT, a 4D eye-tracking dataset with annotated expert decision windows for tumor detection and measurement on 346 dual-read FDG-PET/CTs. The dataset contributes 9,030 gaze-to-lesion trajectories derived from 3,948 minutes of 60 Hz eye-tracking data, rendered in COCO-style format. GazeXPErT captures experts' visual reasoning patterns when adjudicating suspicious lesions. It aims to facilitate development of trusted, explainable and interactive AI models through understanding expert gaze patterns. Baseline feasibility experiments suggest salient signal is extractable from routinely collected expert gaze (3D nnU-Net Dice: 0.6819 versus 0.6008 without), that gaze-trained vision transformers may aid dynamic lesion localization (74.95% predicted gaze closer to tumor), and that experts' intent may be predictable from raw gaze (Accuracy 67.53%, AUROC 0.747).