mlsanityData to 7 Oct 2026

Learning to Write Rationally: How Information Is Distributed in Non-Native Speakers' Essays

arXiv 2411.03550 ↗First posted 5 Nov 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

People tend to distribute information evenly in language production for better and clearer communication. In this study, we compared essays written by second language learners with various native language (L1) backgrounds to investigate how they distribute information in their non-native language (L2) production. Analyses of surprisal and constancy of entropy rate indicated that writers with higher L2 proficiency can reduce the expected uncertainty of language production while still conveying informative content. However, the uniformity of information distribution showed less variability among different groups of L2 speakers, suggesting that this feature may be universal in L2 essay writing and less affected by L2 writers' variability in L1 background and L2 proficiency.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 52 references that are in the map. First posted on arXiv 5 Nov 2024.

Builds on

8 of 52 references.

References · 8

  1. 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 864
  2. 2022Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?cited by 111
  3. 2023Testing the Predictions of Surprisal Theory in 11 Languagescited by 75
  4. 2021Revisiting the Uniform Information Density Hypothesiscited by 63
  5. 2023Nationality Bias in Text Generationcited by 50
  6. 2023GPT-who: An Information Density-based Machine-Generated Text Detectorcited by 38
  7. 2021So Cloze yet so Far: N400 Amplitude is Better Predicted by Distributional Information than Human Predictability Judgementscited by 15
  8. 2022Entropy- and Distance-Based Predictors From GPT-2 Attention Patterns Predict Reading Times Over and Above GPT-2 Surprisalcited by 14

Built on by

Not cited yet.