When Eye-Tracking Meets Machine Learning: A Systematic Review on Applications in Medical Image Analysis
Not on the map. Why?
Abstract (arXiv)
Eye-gaze tracking research offers significant promise in enhancing various healthcare-related tasks, above all in medical image analysis and interpretation. Eye tracking, a technology that monitors and records the movement of the eyes, provides valuable insights into human visual attention patterns. This technology can transform how healthcare professionals and medical specialists engage with and analyze diagnostic images, offering a more insightful and efficient approach to medical diagnostics. Hence, extracting meaningful features and insights from medical images by leveraging eye-gaze data improves our understanding of how radiologists and other medical experts monitor, interpret, and understand images for diagnostic purposes. Eye-tracking data, with intricate human visual attention patterns embedded, provides a bridge to integrating artificial intelligence (AI) development and human cognition. This integration allows novel methods to incorporate domain knowledge into machine learning (ML) and deep learning (DL) approaches to enhance their alignment with human-like perception and decision-making. Moreover, extensive collections of eye-tracking data have also enabled novel ML/DL methods to analyze human visual patterns, paving the way to a better understanding of human vision, attention, and cognition. This systematic review investigates eye-gaze tracking applications and methodologies for enhancing ML/DL algorithms for medical image analysis in depth.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 16 of its 39 references that are in the map. First posted on arXiv 12 Mar 2024.
Builds on
16 of 39 references.
References · 16
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Creation and Validation of a Chest X-Ray Dataset with Eye-tracking and Report Dictation for AI Developmentcited by 56
- 2022Follow My Eye: Using Gaze to Supervise Computer-Aided Diagnosiscited by 38
- 2021REFLACX, a dataset of reports and eye-tracking data for localization of abnormalities in chest x-rayscited by 34
- 2021Human Attention in Fine-grained Classificationcited by 21
- 2022Eye-gaze-guided Vision Transformer for Rectifying Shortcut Learningcited by 20
- 2022RadioTransformer: A Cascaded Global-Focal Transformer for Visual Attention-guided Disease Classificationcited by 19
- 2020Deep semantic gaze embedding and scanpath comparison for expertise classification during OPT viewingcited by 17
- 2018A Collaborative Computer Aided Diagnosis (C-CAD) System with Eye-Tracking, Sparse Attentional Model, and Deep Learningcited by 14
- 2023Learning Better Contrastive View from Radiologist's Gazecited by 4
- 2022Improving Disease Classification Performance and Explainability of Deep Learning Models in Radiology with Heatmap Generatorscited by 3
- 2022Localization supervision of chest x-ray classifiers using label-specific eye-tracking annotationcited by 3
4 more
- 2022On Smart Gaze based Annotation of Histopathology Images for Training of Deep Convolutional Neural Networkscited by 2
- 2023Integrating Eye-Gaze Data into CXR DL Approaches: A Preliminary studycited by 2
- 2022Using Multi-modal Data for Improving Generalizability and Explainability of Disease Classification in Radiologycited by 1
- 2023Discrimination of Radiologists Utilizing Eye-Tracking Technology and Machine Learning: A Case Studycited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.