GazeXPErT: An Expert Eye-tracking Dataset for Interpretable and Explainable AI in Oncologic FDG-PET/CT Scans
Not on the map. Why?
Abstract (arXiv)
[18F]FDG-PET/CT is a cornerstone imaging modality for guiding oncology therapies, yet human expert shortages necessitate more efficient diagnostic aids. While standalone AI models for automatic lesion detection exist, clinical translation remains hindered by AI explainability, reliability, and workflow integration. Meanwhile, human-computer-interaction in radiology remain limited to keyboard, mouse and voice, ignoring experts' faster, natural gaze signal. We present GazeXPErT, a 4D eye-tracking dataset with annotated expert decision windows for tumor detection and measurement on 346 dual-read FDG-PET/CTs. The dataset contributes 9,030 gaze-to-lesion trajectories derived from 3,948 minutes of 60 Hz eye-tracking data, rendered in COCO-style format. GazeXPErT captures experts' visual reasoning patterns when adjudicating suspicious lesions. It aims to facilitate development of trusted, explainable and interactive AI models through understanding expert gaze patterns. Baseline feasibility experiments suggest salient signal is extractable from routinely collected expert gaze (3D nnU-Net Dice: 0.6819 versus 0.6008 without), that gaze-trained vision transformers may aid dynamic lesion localization (74.95% predicted gaze closer to tumor), and that experts' intent may be predictable from raw gaze (Accuracy 67.53%, AUROC 0.747).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 73 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
14 of 73 references.
References · 14
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Segment Anythingcited by 8,158
- 2024nnU-Net Revisited: A Call for Rigorous Validation in 3D Medical Image Segmentationcited by 235
- 2020Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Developmentcited by 55
- 2021REFLACX, a dataset of reports and eye-tracking data for localization of abnormalities in chest x-rayscited by 34
- 2023GazeGNN: A Gaze-Guided Graph Neural Network for Chest X-ray Classificationcited by 25
- 2024Eye-gaze Guided Multi-modal Alignment for Medical Representation Learningcited by 16
- 2018A Collaborative Computer Aided Diagnosis (C-CAD) System with Eye-Tracking, Sparse Attentional Model, and Deep Learningcited by 14
- 2016Gaze2Segment: A Pilot Study for Integrating Eye-Tracking Technology into Medical Image Segmentationcited by 11
- 2021Using Eye-tracking Data to Predict Situation Awareness in Real Time during Takeover Transitions in Conditionally Automated Drivingcited by 6
- 2024Gaze-Assisted Medical Image Segmentationcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Seeing Through Experts Eyes A Foundational Vision Language Model Trained on Radiologists Gaze and Reasoning
- 2026A World Model of Radiologist Reading for Medical Image Representation Learning
- 2025EyeAgent: An Agentic AI System for Multimodal Clinical Decision Support in Ophthalmology
- 2026GazeVaLM: A Multi-Observer Eye-Tracking Benchmark for Evaluating Clinical Realism in AI-Generated X-Rays
- 2025PETAR: Localized Findings Generation with Mask-Aware Vision-Language Modeling for PET Automated Reporting
- 2025Eyes on the Image: Gaze Supervised Multimodal Learning for Chest X-ray Diagnosis and Report Generation
- 2026Thinking with Gaze: Sequential Eye-Tracking as Visual Reasoning Supervision for Medical VLMs
- 2026CheXpercept: A Benchmark for Evaluating Expert-Level Lesion Perception in Chest X-rays