The Harmonic Structure of Information Contours
Not on the map. Why?
Abstract (arXiv)
The uniform information density (UID) hypothesis proposes that speakers aim to distribute information evenly throughout a text, balancing production effort and listener comprehension difficulty. However, language typically does not maintain a strictly uniform information rate; instead, it fluctuates around a global average. These fluctuations are often explained by factors such as syntactic constraints, stylistic choices, or audience design. In this work, we explore an alternative perspective: that these fluctuations may be influenced by an implicit linguistic pressure towards periodicity, where the information rate oscillates at regular intervals, potentially across multiple frequencies simultaneously. We apply harmonic regression and introduce a novel extension called time scaling to detect and test for such periodicity in information contours. Analyzing texts in English, Spanish, German, Dutch, Basque, and Brazilian Portuguese, we find consistent evidence of periodic patterns in information rate. Many dominant frequencies align with discourse structure, suggesting these oscillations reflect meaningful linguistic organization. Beyond highlighting the connection between information rate and discourse structure, our approach offers a general framework for uncovering structural pressures at various levels of linguistic granularity.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 15 of its 83 references that are in the map. First posted on arXiv 4 Jun 2025.
Builds on
15 of 83 references.
References · 15
- 2020On the Predictive Power of Neural Language Models for Human Real-Time Comprehension Behaviorcited by 119
- 2023Testing the Predictions of Surprisal Theory in 11 Languagescited by 77
- 2021Revisiting the Uniform Information Density Hypothesiscited by 68
- 2024Latxa: An Open Language Model and Evaluation Suite for Basquecited by 42
- 2024Segment Any Text: A Universal Approach for Robust, Efficient and Adaptable Sentence Segmentationcited by 41
- 2024From Language Models over Tokens to Language Models over Characterscited by 31
- 2024Detecting Subtle Differences between Human and Model Languages Using Spectrum of Relative Likelihoodcited by 24
- 2024Generalized Measures of Anticipation and Responsivity in Online Language Processingcited by 24
- 2023Information Value: Measuring Utterance Predictability as Distance from Plausible Alternativescited by 23
- 2023Where's the Point? Self-Supervised Multilingual Punctuation-Agnostic Sentence Segmentationcited by 17
- 2024Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discoursecited by 17
- 2024Towards a Similarity-adjusted Surprisal Theorycited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 8.
9 papers.
- 2025Identifying the Periodicity of Information in Natural Languagecited by 4
- 2026Is Information Density Uniform when Utterances are Grounded on Perception and Discourse?cited by 3
- 2026On the Proper Treatment of Units in Surprisal Theorycited by 2
- 2026Surprisal Minimisation over Goal-directed Alternatives Predicts Production Choice in Dialoguecited by 1
- 2026Multimodal QUD: Inquisitive Questions from Scientific Figurescited by 0
- 2026The Dynamics of Human and AI-Generated Language: How Semantics Fluctuates across Different Timescalescited by 0
- 2026Using LMs to Model the Effects of Context and Coreference during Sentence Comprehensioncited by 0
- 2026Modeling the Arrival Time of Information-Bearing Events in Natural Languagecited by 0
- 2026Uniform Information Density-Based Preference Optimizationcited by 0
- 2026Uniform Information Density-Based Preference Optimization10 Oct 2026
- 2026Modeling the Arrival Time of Information-Bearing Events in Natural Language9 Oct 2026
- 2026Using LMs to Model the Effects of Context and Coreference during Sentence Comprehension26 Sep 2026
- 2026The Dynamics of Human and AI-Generated Language: How Semantics Fluctuates across Different Timescales9 Jun 2026
- 2026Surprisal Minimisation over Goal-directed Alternatives Predicts Production Choice in Dialogue1 May 2026
- 2026On the Proper Treatment of Units in Surprisal Theory30 Apr 2026
- 2026Multimodal QUD: Inquisitive Questions from Scientific Figures26 Apr 2026
- 2026Is Information Density Uniform when Utterances are Grounded on Perception and Discourse?16 Feb 2026
- 2025Identifying the Periodicity of Information in Natural Language31 Oct 2025