Entity Recognition at First Sight: Improving NER with Eye Movement Information
Not on the map. Why?
Abstract (arXiv)
Previous research shows that eye-tracking data contains information about the lexical and syntactic properties of text, which can be used to improve natural language processing models. In this work, we leverage eye movement features from three corpora with recorded gaze information to augment a state-of-the-art neural model for named entity recognition (NER) with gaze embeddings. These corpora were manually annotated with named entity labels. Moreover, we show how gaze features, generalized on word type level, eliminate the need for recorded eye-tracking data at test time. The gaze-augmented models for NER using token-level and type-level features outperform the baselines. We present the benefits of eye-tracking features by evaluating the NER models on both individual datasets as well as in cross-domain settings.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Feb 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 2; 2023: 9; 2024: 4; 2025: 2; 2026: 2.
26 papers.
Sort:
By area:
- 2021Multilingual Language Models Predict Human Reading Behaviorcited by 29
- 2023Eyettention: An Attention-based Dual-Sequence Model for Predicting Human Scanpaths during Readingcited by 18
- 2023Synthesizing Human Gaze Feedback for Improved NLP Performancecited by 16
- 2021Decoding EEG Brain Activity for Multi-Modal Natural Language Processingcited by 13
- 2023ScanDL: A Diffusion Model for Generating Synthetic Scanpaths on Textscited by 13
- 2021CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signalscited by 11
- 2021A Survey on Using Gaze Behaviour for Natural Language Processingcited by 11
- 2024Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Modelscited by 11
- 2023Pre-Trained Language Models Augmented with Synthetic Scanpaths for Natural Language Understandingcited by 8
- 2022The Copenhagen Corpus of Eye Tracking Recordings from Natural Reading of Danish Textscited by 7
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Datasetcited by 6
- 2024PoTeC: A German Naturalistic Eye-tracking-while-reading Corpuscited by 5
14 more
- 2024EMTeC: A Corpus of Eye Movements on Machine-Generated Textscited by 5
- 2021Cognition-aware Cognate Detectioncited by 3
- 2023Longer Fixations, More Computation: Gaze-Guided Recurrent Neural Networkscited by 3
- 2025OASST-ETC Dataset: Alignment Signals from Eye-tracking Analysis of LLM Responsescited by 3
- 2023GazeReader: Detecting Unknown Word Using Webcam for English as a Second Language (ESL) Learnerscited by 2
- 2023DocTrack: A Visually-Rich Document Dataset Really Aligned with Human Eye Movement for Machine Readingcited by 2
- 2024Teaching Human Behavior Improves Content Understanding Abilities Of LLMscited by 2
- 2021Bridging between Cognitive Processing Signals and Linguistic Features via a Unified Attentional Networkcited by 1
- 2022Does Attention Mechanism Possess the Feature of Human Reading? A Perspective of Sentiment Classification Taskcited by 1
- 2025Unknown Word Detection for English as a Second Language (ESL) Learners Using Gaze and Pre-trained Language Modelscited by 1
- 2021Retrieving Event-related Human Brain Dynamics from Natural Sentence Readingcited by 0
- 2023Revising with a Backward Glance: Regressions and Skips during Reading as Cognitive Signals for Revision Policies in Incremental Processingcited by 0
- 2026Eye-Tracking-while-Reading: A Living Survey of Datasets with Open Library Supportcited by 0
- 2026Eyettention II: A Dual-Sequence Architecture for Modeling Fixation Location, Within-Word Landing Position, and Fixation Duration in Readingcited by 0
- 2026Eyettention II: A Dual-Sequence Architecture for Modeling Fixation Location, Within-Word Landing Position, and Fixation Duration in Reading1 Jun 2026
- 2026Eye-Tracking-while-Reading: A Living Survey of Datasets with Open Library Support23 Feb 2026
- 2025OASST-ETC Dataset: Alignment Signals from Eye-tracking Analysis of LLM Responses13 Mar 2025
- 2025Unknown Word Detection for English as a Second Language (ESL) Learners Using Gaze and Pre-trained Language Models14 Feb 2025
- 2024Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models2 Oct 2024
- 2024EMTeC: A Corpus of Eye Movements on Machine-Generated Texts8 Aug 2024
- 2024Teaching Human Behavior Improves Content Understanding Abilities Of LLMs2 May 2024
- 2024PoTeC: A German Naturalistic Eye-tracking-while-reading Corpus1 Mar 2024
- 2023Longer Fixations, More Computation: Gaze-Guided Recurrent Neural Networks31 Oct 2023
- 2023Revising with a Backward Glance: Regressions and Skips during Reading as Cognitive Signals for Revision Policies in Incremental Processing27 Oct 2023
- 2023ScanDL: A Diffusion Model for Generating Synthetic Scanpaths on Texts24 Oct 2023
- 2023DocTrack: A Visually-Rich Document Dataset Really Aligned with Human Eye Movement for Machine Reading23 Oct 2023
14 more
- 2023Pre-Trained Language Models Augmented with Synthetic Scanpaths for Natural Language Understanding23 Oct 2023
- 2023Eyettention: An Attention-based Dual-Sequence Model for Predicting Human Scanpaths during Reading21 Apr 2023
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset31 Mar 2023
- 2023GazeReader: Detecting Unknown Word Using Webcam for English as a Second Language (ESL) Learners18 Mar 2023
- 2023Synthesizing Human Gaze Feedback for Improved NLP Performance11 Feb 2023
- 2022Does Attention Mechanism Possess the Feature of Human Reading? A Perspective of Sentiment Classification Task8 Sep 2022
- 2022The Copenhagen Corpus of Eye Tracking Recordings from Natural Reading of Danish Texts28 Apr 2022
- 2021A Survey on Using Gaze Behaviour for Natural Language Processing21 Dec 2021
- 2021Bridging between Cognitive Processing Signals and Linguistic Features via a Unified Attentional Network16 Dec 2021
- 2021Cognition-aware Cognate Detection15 Dec 2021
- 2021CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signals10 Jun 2021
- 2021Multilingual Language Models Predict Human Reading Behavior12 Apr 2021
- 2021Retrieving Event-related Human Brain Dynamics from Natural Sentence Reading29 Mar 2021
- 2021Decoding EEG Brain Activity for Multi-Modal Natural Language Processing17 Feb 2021
- 2021Multilingual Language Models Predict Human Reading Behaviorcited by 29
- 2023Eyettention: An Attention-based Dual-Sequence Model for Predicting Human Scanpaths during Readingcited by 18
- 2021Decoding EEG Brain Activity for Multi-Modal Natural Language Processingcited by 13
- 2021CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signalscited by 11
- 2021A Survey on Using Gaze Behaviour for Natural Language Processingcited by 11
- 2023Pre-Trained Language Models Augmented with Synthetic Scanpaths for Natural Language Understandingcited by 8
- 2022The Copenhagen Corpus of Eye Tracking Recordings from Natural Reading of Danish Textscited by 7
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Datasetcited by 6
- 2024PoTeC: A German Naturalistic Eye-tracking-while-reading Corpuscited by 5
- 2024EMTeC: A Corpus of Eye Movements on Machine-Generated Textscited by 5
- 2021Cognition-aware Cognate Detectioncited by 3
- 2023Longer Fixations, More Computation: Gaze-Guided Recurrent Neural Networkscited by 3
12 most cited of 22 All 22 (JSON)
- 2026Eyettention II: A Dual-Sequence Architecture for Modeling Fixation Location, Within-Word Landing Position, and Fixation Duration in Reading1 Jun 2026
- 2026Eye-Tracking-while-Reading: A Living Survey of Datasets with Open Library Support23 Feb 2026
- 2025Unknown Word Detection for English as a Second Language (ESL) Learners Using Gaze and Pre-trained Language Models14 Feb 2025
- 2024EMTeC: A Corpus of Eye Movements on Machine-Generated Texts8 Aug 2024
- 2024Teaching Human Behavior Improves Content Understanding Abilities Of LLMs2 May 2024
- 2024PoTeC: A German Naturalistic Eye-tracking-while-reading Corpus1 Mar 2024
- 2023Longer Fixations, More Computation: Gaze-Guided Recurrent Neural Networks31 Oct 2023
- 2023Revising with a Backward Glance: Regressions and Skips during Reading as Cognitive Signals for Revision Policies in Incremental Processing27 Oct 2023
- 2023DocTrack: A Visually-Rich Document Dataset Really Aligned with Human Eye Movement for Machine Reading23 Oct 2023
- 2023Pre-Trained Language Models Augmented with Synthetic Scanpaths for Natural Language Understanding23 Oct 2023
- 2023Eyettention: An Attention-based Dual-Sequence Model for Predicting Human Scanpaths during Reading21 Apr 2023
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset31 Mar 2023
12 newest of 22 All 22 (JSON)