Predicting Eye Gaze Location on Websites
Not on the map. Why?
Abstract (arXiv)
World-wide-web, with the website and webpage as the main interface, facilitates the dissemination of important information. Hence it is crucial to optimize them for better user interaction, which is primarily done by analyzing users' behavior, especially users' eye-gaze locations. However, gathering these data is still considered to be labor and time intensive. In this work, we enable the development of automatic eye-gaze estimations given a website screenshots as the input. This is done by the curation of a unified dataset that consists of website screenshots, eye-gaze heatmap and website's layout information in the form of image and text masks. Our pre-processed dataset allows us to propose an effective deep learning-based model that leverages both image and text spatial location, which is combined through attention mechanism for effective eye-gaze prediction. In our experiment, we show the benefit of careful fine-tuning using our unified dataset to improve the accuracy of eye-gaze predictions. We further observe the capability of our model to focus on the targeted areas (images and text) to achieve high accuracy. Finally, the comparison with other alternatives shows the state-of-the-art result of our model establishing the benchmark for the eye-gaze prediction task.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 35 references that are in the map. First posted on arXiv 15 Nov 2022.
Builds on
12 of 35 references.
References · 12
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2017EAST: An Efficient and Accurate Scene Text Detectorcited by 248
- 2016What do different evaluation metrics tell us about saliency models?cited by 184
- 2020Attentional Feature Fusioncited by 115
- 2019Contextual Encoder-Decoder Network for Visual Saliency Predictioncited by 44
- 2018End-to-End Saliency Mapping via Probability Distribution Predictioncited by 17
- 2016Visual Saliency Based on Scale-Space Analysis in the Frequency Domaincited by 11
- 2021Machine Learning-based Lie Detector applied to a Novel Annotated Game Datasetcited by 1
- 2022User Interaction Analysis through Contrasting Websites Experiencecited by 1
Built on by
Citing papers per year: 2024: 2.
2 papers.