A Zipf-preserving, long-range correlated surrogate for written language and other symbolic sequences
Not on the map. Why?
Abstract (arXiv)
Symbolic sequences such as written language and genomic DNA display characteristic frequency distributions and long-range correlations extending over many symbols. In language, this takes the form of Zipf's law for word frequencies together with persistent correlations spanning hundreds or thousands of tokens, while in DNA it is reflected in nucleotide composition and long-memory walks under purine-pyrimidine mappings. Existing surrogate models usually preserve either the frequency distribution or the correlation properties, but not both simultaneously. We introduce a surrogate model that retains both constraints: it preserves the empirical symbol frequencies of the original sequence and reproduces its long-range correlation structure, quantified by the detrended fluctuation analysis (DFA) exponent. Our method generates surrogates of symbolic sequences by mapping fractional Gaussian noise (FGN) onto the empirical histogram through a frequency-preserving assignment. The resulting surrogates match the original in first-order statistics and long-range scaling while randomising short-range dependencies. We validate the model on representative texts in English and Latin, and illustrate its broader applicability with genomic DNA, showing that base composition and DFA scaling are reproduced. This approach provides a principled tool for disentangling structural features of symbolic systems and for testing hypotheses on the origin of scaling laws and memory effects across language, DNA, and other symbolic domains.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 6 of its 39 references that are in the map. First posted on arXiv 6 Feb 2026.
Builds on
6 of 39 references.
References · 6
- 2015Statistical laws in linguisticscited by 13
- 2024Complex systems approach to natural languagecited by 12
- 2016In narrative texts punctuation marks obey the same statistics as wordscited by 11
- 2020Heaps' law and Heaps functions in tagged texts: Evidences of their linguistic relevancecited by 8
- 2018Natural Language Statistical Features of LSTM-generated Textscited by 7
- 2025Study of scaling laws in language familiescited by 1
Built on by
Not cited yet.