mlsanityData to 14 Oct 2026

Assessing Cognitive Effort in L2 Idiomatic Processing: An Eye-Tracking Dataset

arXiv 2605.04857 ↗First posted 6 May 2026cs.CL cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents the development and validation of an eye-tracking dataset designed to investigate how second-language (L2) learners process idiomatic expressions. While native speakers often rely on direct retrieval of figurative meanings, L2 speakers frequently adopt a literal-first approach, which incurs measurable cognitive costs. This resource captures these costs through ocular metrics recorded from Portuguese L1 speakers of English across all CEFR proficiency levels (A1-C2). Although the study uses entry-level 60 Hz hardware (Tobii Pro Spark), we demonstrate that this sampling rate provides sufficient data density to detect macro-cognitive events such as fixations and regressions in reading. Preliminary analysis validates the dataset by revealing a strong inverse correlation between language proficiency and regressive eye movements. Integrated into the MIA (Modeling Idiomaticity in Human and Artificial Language Processing) initiative, this dataset serves as a cognitively grounded benchmark for evaluating both human processing models and the alignment of large language models with human-like figurative understanding.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 16 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

2 of 16 references.

References · 2

  1. 2024A Methodology for Explainable Large Language Models with Integrated Gradients and Linguistic Analysis in Text Classificationcited by 1
  2. 2024Investigating Idiomaticity in Word Representationscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025OASST-ETC Dataset: Alignment Signals from Eye-tracking Analysis of LLM Responses
  2. 2025Integrating Cognitive Processing Signals into Language Models: A Review of Advances, Applications and Future Directions
  3. 2025Memorization or Reasoning? Exploring the Idiom Understanding of LLMs
  4. 2025Beyond Understanding: Evaluating the Pragmatic Gap in LLMs' Cultural Processing of Figurative Language
  5. 2025Large Language Models Are Human-Like Internally
  6. 2026Cross-Lingual Steering for Figurative Language Generation
  7. 2025MCIF: Multimodal Crosslingual Instruction-Following Benchmark from Scientific Talks
  8. 2026Preferences for Idiomatic Language are Acquired Slowly -- and Forgotten Quickly: A Case Study on Swedish