A Deep Learning Framework for Visual Attention Prediction and Analysis of News Interfaces
Not on the map. Why?
Abstract (arXiv)
News outlets' competition for attention in news interfaces has highlighted the need for demographically-aware saliency prediction models. Despite recent advancements in saliency detection applied to user interfaces (UI), existing datasets are limited in size and demographic representation. We present a deep learning framework that enhances the SaRa (Saliency Ranking) model with DeepGaze IIE, improving Salient Object Ranking (SOR) performance by 10.7%. Our framework optimizes three key components: saliency map generation, grid segment scoring, and map normalization. Through a two-fold experiment using eye-tracking (30 participants) and mouse-tracking (375 participants aged 13--70), we analyze attention patterns across demographic groups. Statistical analysis reveals significant age-based variations (p < 0.05, ε2 = 0.042), with older users (36--70) engaging more with textual content and younger users (13--35) interacting more with images. Mouse-tracking data closely approximates eye-tracking behavior (sAUC = 0.86) and identifies UI elements that immediately stand out, validating its use in large-scale studies. We conclude that saliency studies should prioritize gathering data from a larger, demographically representative sample and report exact demographic distributions.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 21 Mar 2025.
Builds on
12 of 33 references.
References · 12
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
- 2014The Secrets of Salient Object Segmentationcited by 200
- 2020Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthycited by 183
- 2016Eye Tracking for Everyonecited by 155
- 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingcited by 56
- 2018Revisiting Salient Object Detection: Simultaneous Detection, Ranking, and Subitizing of Multiple Salient Objectscited by 26
- 2021Understanding Visual Saliency in Mobile User Interfacescited by 13
- 2018Relative Saliency and Ranking: Models, Metrics, Data, and Benchmarkscited by 9
- 2017Saliency Prediction for Mobile User Interfacescited by 5
- 2024AI as a Tool for Fair Journalism: Case Studies from Maltacited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.