A Survey on Using Gaze Behaviour for Natural Language Processing
Not on the map. Why?
Abstract (arXiv)
Gaze behaviour has been used as a way to gather cognitive information for a number of years. In this paper, we discuss the use of gaze behaviour in solving different tasks in natural language processing (NLP) without having to record it at test time. This is because the collection of gaze behaviour is a costly task, both in terms of time and money. Hence, in this paper, we focus on research done to alleviate the need for recording gaze behaviour at run time. We also mention different eye tracking corpora in multiple languages, which are currently available and can be used in natural language processing. We conclude our paper by discussing applications in a domain - education - and how learning gaze behaviour can help in solving the tasks of complex word identification and automatic essay grading.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 10 of its 82 references that are in the map. First posted on arXiv 21 Dec 2021.
Builds on
10 of 82 references.
References · 10
- 2016Automatic Text Scoring Using Neural Networkscited by 51
- 2018A Report on the Complex Word Identification Shared Task 2018cited by 30
- 2019Entity Recognition at First Sight: Improving NER with Eye Movement Informationcited by 26
- 2016Improving sentence compression by learning to predict gazecited by 24
- 2017SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoringcited by 22
- 2017Leveraging Cognitive Features for Sentiment Analysiscited by 19
- 2019Co-Attention Based Neural Network for Source-Dependent Essay Scoringcited by 11
- 2017Predicting Native Language from Gazecited by 9
- 2018Eyes are the Windows to the Soul: Predicting the Rating of Text Quality Using Gaze Behaviourcited by 9
- 2017Harnessing Cognitive Features for Sarcasm Detectioncited by 8
Built on by
Citing papers per year: 2022: 2; 2023: 4; 2024: 2; 2025: 2; 2026: 1.
11 papers.
- 2023Synthesizing Human Gaze Feedback for Improved NLP Performancecited by 16
- 2024Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Modelscited by 12
- 2022The Copenhagen Corpus of Eye Tracking Recordings from Natural Reading of Danish Textscited by 7
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Datasetcited by 6
- 2023Longer Fixations, More Computation: Gaze-Guided Recurrent Neural Networkscited by 3
- 2025OASST-ETC Dataset: Alignment Signals from Eye-tracking Analysis of LLM Responsescited by 3
- 2022A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Modelscited by 2
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directionscited by 2
- 2024Describing Images textitFast and Slow: Quantifying and Predicting the Variation in Human Signals during Visuo-Linguistic Processescited by 1
- 2023Revising with a Backward Glance: Regressions and Skips during Reading as Cognitive Signals for Revision Policies in Incremental Processingcited by 0
- 2026Your Mouse and Eyes Secretly Leak Your Preference: LLM Alignment using Implicit Feedback from Userscited by 0
- 2026Your Mouse and Eyes Secretly Leak Your Preference: LLM Alignment using Implicit Feedback from Users18 Jun 2026
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directions9 Apr 2025
- 2025OASST-ETC Dataset: Alignment Signals from Eye-tracking Analysis of LLM Responses13 Mar 2025
- 2024Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models2 Oct 2024
- 2024Describing Images textitFast and Slow: Quantifying and Predicting the Variation in Human Signals during Visuo-Linguistic Processes2 Feb 2024
- 2023Longer Fixations, More Computation: Gaze-Guided Recurrent Neural Networks31 Oct 2023
- 2023Revising with a Backward Glance: Regressions and Skips during Reading as Cognitive Signals for Revision Policies in Incremental Processing27 Oct 2023
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset31 Mar 2023
- 2023Synthesizing Human Gaze Feedback for Improved NLP Performance11 Feb 2023
- 2022A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Models19 Dec 2022
- 2022The Copenhagen Corpus of Eye Tracking Recordings from Natural Reading of Danish Texts28 Apr 2022