# Minimal Effective Theory for Phonotactic Memory: Capturing Local Correlations due to Errors in Speech

arXiv: https://arxiv.org/abs/2309.02466 · HTML: https://mlsanity.com/paper/2309.02466/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 5 of its 23 references that are in the map.
- First posted on arXiv 4 Sep 2023.

## Builds on (most cited first, 5 of 5)

- [Learning Relevant Features of Data with Multi-scale Tensor Networks](https://mlsanity.com/paper/1801.00315/) (2017)
- [An Analysis of Neural Language Modeling at Multiple Scales](https://mlsanity.com/paper/1803.08240/) (2018)
- [Phonotactic Complexity and its Trade-offs](https://mlsanity.com/paper/2005.03774/) (2020)
- [Modeling Sequences with Quantum States: A Look Under the Hood](https://mlsanity.com/paper/1910.07425/) (2019)
- [Eigenvector Dreaming](https://mlsanity.com/paper/2308.13445/) (2023)

## Built on by (most cited first, 1 of 1)

- [Hebbian learning the local structure of language](https://mlsanity.com/paper/2503.02057/) (2025)

## Abstract (arXiv)

Spoken language evolves constrained by the economy of speech, which depends on factors such as the structure of the human mouth. This gives rise to local phonetic correlations in spoken words. Here we demonstrate that these local correlations facilitate the learning of spoken words by reducing their information content. We do this by constructing a locally-connected tensor-network model, inspired by similar variational models used for many-body physics, which exploits these local phonetic correlations to facilitate the learning of spoken words. The model is therefore a minimal model of phonetic memory, where "learning to pronounce" and "learning a word" are one and the same. A consequence of which is the learned ability to produce new words which are phonetically reasonable for the target language; as well as providing a hierarchy of the most likely errors that could be produced during the action of speech. We test our model against Latin and Turkish words. (The code is available on GitHub.)