Bridging Information-Seeking Human Gaze and Machine Reading Comprehension
Not on the map. Why?
Abstract (arXiv)
In this work, we analyze how human gaze during reading comprehension is conditioned on the given reading comprehension question, and whether this signal can be beneficial for machine reading comprehension. To this end, we collect a new eye-tracking dataset with a large number of participants engaging in a multiple choice reading comprehension task. Our analysis of this data reveals increased fixation times over parts of the text that are most relevant for answering the question. Motivated by this finding, we propose making automated reading comprehension more human-like by mimicking human information-seeking reading behavior during reading comprehension. We demonstrate that this approach leads to performance gains on multiple choice question answering in English for a state-of-the-art reading comprehension model.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 5; 2023: 5; 2024: 4; 2025: 2; 2026: 1.
20 papers.
Sort:
- 2021Multilingual Language Models Predict Human Reading Behaviorcited by 29
- 2021Relative Importance in Sentence Processingcited by 22
- 2022Do Transformer Models Show Similar Attention Patterns to Task-Specific Human Gaze?cited by 20
- 2024Fine-Grained Prediction of Reading Comprehension from Eye Movementscited by 9
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Datasetcited by 6
- 2024PoTeC: A German Naturalistic Eye-tracking-while-reading Corpuscited by 5
- 2024EMTeC: A Corpus of Eye Movements on Machine-Generated Textscited by 5
- 2024Decoding Reading Goals from Eye Movementscited by 5
- 2021Human Attention during Goal-directed Reading Comprehension Relies on Task Optimizationcited by 3
- 2023Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolutioncited by 3
- 2022A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Modelscited by 2
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directionscited by 2
8 more
- 2022Does Attention Mechanism Possess the Feature of Human Reading? A Perspective of Sentiment Classification Taskcited by 1
- 2023Language Cognition and Language Computation -- Human and Machine Language Understandingcited by 1
- 2023Perturbation-based Self-supervised Attention for Attention Bias in Text Classificationcited by 1
- 2022Deep Understanding based Multi-Document Machine Reading Comprehensioncited by 0
- 2022An Understanding-Oriented Robust Machine Reading Comprehension Modelcited by 0
- 2023Cross-corpus Readability Compatibility Assessment for English Textscited by 0
- 2025Decoding Open-Ended Information Seeking Goals from Eye Movements in Readingcited by 0
- 2026Eye-Tracking-while-Reading: A Living Survey of Datasets with Open Library Supportcited by 0
- 2026Eye-Tracking-while-Reading: A Living Survey of Datasets with Open Library Support23 Feb 2026
- 2025Decoding Open-Ended Information Seeking Goals from Eye Movements in Reading4 May 2025
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directions9 Apr 2025
- 2024Decoding Reading Goals from Eye Movements28 Oct 2024
- 2024Fine-Grained Prediction of Reading Comprehension from Eye Movements6 Oct 2024
- 2024EMTeC: A Corpus of Eye Movements on Machine-Generated Texts8 Aug 2024
- 2024PoTeC: A German Naturalistic Eye-tracking-while-reading Corpus1 Mar 2024
- 2023Cross-corpus Readability Compatibility Assessment for English Texts16 Jun 2023
- 2023Perturbation-based Self-supervised Attention for Attention Bias in Text Classification25 May 2023
- 2023Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolution24 May 2023
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset31 Mar 2023
- 2023Language Cognition and Language Computation -- Human and Machine Language Understanding12 Jan 2023
8 more
- 2022A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Models19 Dec 2022
- 2022Does Attention Mechanism Possess the Feature of Human Reading? A Perspective of Sentiment Classification Task8 Sep 2022
- 2022An Understanding-Oriented Robust Machine Reading Comprehension Model1 Jul 2022
- 2022Do Transformer Models Show Similar Attention Patterns to Task-Specific Human Gaze?25 Apr 2022
- 2022Deep Understanding based Multi-Document Machine Reading Comprehension25 Feb 2022
- 2021Human Attention during Goal-directed Reading Comprehension Relies on Task Optimization13 Jul 2021
- 2021Relative Importance in Sentence Processing7 Jun 2021
- 2021Multilingual Language Models Predict Human Reading Behavior12 Apr 2021
- 2021Multilingual Language Models Predict Human Reading Behaviorcited by 29
- 2021Relative Importance in Sentence Processingcited by 22
- 2022Do Transformer Models Show Similar Attention Patterns to Task-Specific Human Gaze?cited by 20
- 2024Fine-Grained Prediction of Reading Comprehension from Eye Movementscited by 9
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Datasetcited by 6
- 2024PoTeC: A German Naturalistic Eye-tracking-while-reading Corpuscited by 5
- 2024EMTeC: A Corpus of Eye Movements on Machine-Generated Textscited by 5
- 2024Decoding Reading Goals from Eye Movementscited by 5
- 2021Human Attention during Goal-directed Reading Comprehension Relies on Task Optimizationcited by 3
- 2023Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolutioncited by 3
- 2022A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Modelscited by 2
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directionscited by 2
12 most cited of 20 All 20 (JSON)
- 2026Eye-Tracking-while-Reading: A Living Survey of Datasets with Open Library Support23 Feb 2026
- 2025Decoding Open-Ended Information Seeking Goals from Eye Movements in Reading4 May 2025
- 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directions9 Apr 2025
- 2024Decoding Reading Goals from Eye Movements28 Oct 2024
- 2024Fine-Grained Prediction of Reading Comprehension from Eye Movements6 Oct 2024
- 2024EMTeC: A Corpus of Eye Movements on Machine-Generated Texts8 Aug 2024
- 2024PoTeC: A German Naturalistic Eye-tracking-while-reading Corpus1 Mar 2024
- 2023Cross-corpus Readability Compatibility Assessment for English Texts16 Jun 2023
- 2023Perturbation-based Self-supervised Attention for Attention Bias in Text Classification25 May 2023
- 2023Comparing Humans and Models on a Similar Scale: Towards Cognitive Gender Bias Evaluation in Coreference Resolution24 May 2023
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset31 Mar 2023
- 2023Language Cognition and Language Computation -- Human and Machine Language Understanding12 Jan 2023
12 newest of 20 All 20 (JSON)