Advancing NLP with Cognitive Language Processing Signals
Not on the map. Why?
Abstract (arXiv)
When we read, our brain processes language and generates cognitive processing data such as gaze patterns and brain activity. These signals can be recorded while reading. Cognitive language processing data such as eye-tracking features have shown improvements on single NLP tasks. We analyze whether using such human features can show consistent improvement across tasks and data sources. We present an extensive investigation of the benefits and limitations of using cognitive processing data for NLP. Specifically, we use gaze and EEG features to augment models of named entity recognition, relation classification, and sentiment analysis. These methods significantly outperform the baselines and show the potential and current limitations of employing human language processing data for NLP.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 5; 2023: 4; 2024: 2; 2025: 1; 2026: 2.
18 papers.
Sort:
By area:
- 2022Reasoning with Language Model Prompting: A Surveycited by 251
- 2023Getting aligned on representational alignmentcited by 142
- 2021Multilingual Language Models Predict Human Reading Behaviorcited by 29
- 2023Synthesizing Human Gaze Feedback for Improved NLP Performancecited by 16
- 2021Decoding EEG Brain Activity for Multi-Modal Natural Language Processingcited by 13
- 2022Can Brain Signals Reveal Inner Alignment with Human Languages?cited by 12
- 2021CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signalscited by 11
- 2024Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Modelscited by 11
- 2022Connecting Neural Response measurements & Computational Models of language: a non-comprehensive guidecited by 6
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Datasetcited by 6
- 2025OASST-ETC Dataset: Alignment Signals from Eye-tracking Analysis of LLM Responsescited by 3
- 2022A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Modelscited by 2
6 more
- 2024Teaching Human Behavior Improves Content Understanding Abilities Of LLMscited by 2
- 2026Utilizing Cognitive Signals Generated during Human Reading to Enhance Keyphrase Extraction from Microblogscited by 2
- 2021Leveraging recent advances in Pre-Trained Language Models forEye-Tracking Predictioncited by 0
- 2022Team 'UFAL at CMCL 2022 Shared Task: Figuring out the correct recipe for predicting Eye-Tracking features using Pretrained Language Modelscited by 0
- 2023Can humans help BERT gain "confidence"?cited by 0
- 2026Leveraging Human Reading Behavior for Keyphrase Extraction: A Webcam-based Eye-tracking Corpuscited by 0
- 2026Leveraging Human Reading Behavior for Keyphrase Extraction: A Webcam-based Eye-tracking Corpus11 Aug 2026
- 2026Utilizing Cognitive Signals Generated during Human Reading to Enhance Keyphrase Extraction from Microblogs25 Jun 2026
- 2025OASST-ETC Dataset: Alignment Signals from Eye-tracking Analysis of LLM Responses13 Mar 2025
- 2024Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models2 Oct 2024
- 2024Teaching Human Behavior Improves Content Understanding Abilities Of LLMs2 May 2024
- 2023Getting aligned on representational alignment18 Oct 2023
- 2023Can humans help BERT gain "confidence"?31 Aug 2023
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset31 Mar 2023
- 2023Synthesizing Human Gaze Feedback for Improved NLP Performance11 Feb 2023
- 2022A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Models19 Dec 2022
- 2022Reasoning with Language Model Prompting: A Survey19 Dec 2022
- 2022Can Brain Signals Reveal Inner Alignment with Human Languages?10 Aug 2022
6 more
- 2022Team 'UFAL at CMCL 2022 Shared Task: Figuring out the correct recipe for predicting Eye-Tracking features using Pretrained Language Models11 Apr 2022
- 2022Connecting Neural Response measurements & Computational Models of language: a non-comprehensive guide10 Mar 2022
- 2021Leveraging recent advances in Pre-Trained Language Models forEye-Tracking Prediction9 Oct 2021
- 2021CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signals10 Jun 2021
- 2021Multilingual Language Models Predict Human Reading Behavior12 Apr 2021
- 2021Decoding EEG Brain Activity for Multi-Modal Natural Language Processing17 Feb 2021
- 2022Reasoning with Language Model Prompting: A Surveycited by 251
- 2022Reasoning with Language Model Prompting: A Survey19 Dec 2022
- 2023Getting aligned on representational alignmentcited by 142
- 2021Multilingual Language Models Predict Human Reading Behaviorcited by 29
- 2021Decoding EEG Brain Activity for Multi-Modal Natural Language Processingcited by 13
- 2022Can Brain Signals Reveal Inner Alignment with Human Languages?cited by 12
- 2021CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signalscited by 11
- 2022Connecting Neural Response measurements & Computational Models of language: a non-comprehensive guidecited by 6
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Datasetcited by 6
- 2022A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Modelscited by 2
- 2024Teaching Human Behavior Improves Content Understanding Abilities Of LLMscited by 2
- 2026Utilizing Cognitive Signals Generated during Human Reading to Enhance Keyphrase Extraction from Microblogscited by 2
- 2021Leveraging recent advances in Pre-Trained Language Models forEye-Tracking Predictioncited by 0
- 2022Team 'UFAL at CMCL 2022 Shared Task: Figuring out the correct recipe for predicting Eye-Tracking features using Pretrained Language Modelscited by 0
12 most cited of 14 All 14 (JSON)
- 2026Leveraging Human Reading Behavior for Keyphrase Extraction: A Webcam-based Eye-tracking Corpus11 Aug 2026
- 2026Utilizing Cognitive Signals Generated during Human Reading to Enhance Keyphrase Extraction from Microblogs25 Jun 2026
- 2024Teaching Human Behavior Improves Content Understanding Abilities Of LLMs2 May 2024
- 2023Getting aligned on representational alignment18 Oct 2023
- 2023Can humans help BERT gain "confidence"?31 Aug 2023
- 2023WebQAmGaze: A Multilingual Webcam Eye-Tracking-While-Reading Dataset31 Mar 2023
- 2022A Comparative Study on Textual Saliency of Styles from Eye Tracking, Annotations, and Language Models19 Dec 2022
- 2022Can Brain Signals Reveal Inner Alignment with Human Languages?10 Aug 2022
- 2022Team 'UFAL at CMCL 2022 Shared Task: Figuring out the correct recipe for predicting Eye-Tracking features using Pretrained Language Models11 Apr 2022
- 2022Connecting Neural Response measurements & Computational Models of language: a non-comprehensive guide10 Mar 2022
- 2021Leveraging recent advances in Pre-Trained Language Models forEye-Tracking Prediction9 Oct 2021
- 2021CogAlign: Learning to Align Textual Neural Representations to Cognitive Language Processing Signals10 Jun 2021
12 newest of 14 All 14 (JSON)