mlsanityData to 14 Oct 2026

Large Language Models as Quasi-crystals: Coherence Without Repetition in Generative Text

arXiv 2504.11986 ↗First posted 16 Apr 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This essay proposes an interpretive analogy between large language models (LLMs) and quasicrystals, systems that exhibit global coherence without periodic repetition, generated through local constraints. While LLMs are typically evaluated in terms of predictive accuracy, factuality, or alignment, this structural perspective suggests that one of their most characteristic behaviors is the production of internally resonant linguistic patterns. Drawing on the history of quasicrystals, which forced a redefinition of structural order in physical systems, the analogy highlights an alternative mode of coherence in generative language: constraint-based organization without repetition or symbolic intent. Rather than viewing LLMs as imperfect agents or stochastic approximators, we suggest understanding them as generators of quasi-structured outputs. This framing complements existing evaluation paradigms by foregrounding formal coherence and pattern as interpretable features of model behavior. While the analogy has limits, it offers a conceptual tool for exploring how coherence might arise and be assessed in systems where meaning is emergent, partial, or inaccessible. In support of this perspective, we draw on philosophy of science and language, including model-based accounts of scientific representation, structural realism, and inferentialist views of meaning. We further propose the notion of structural evaluation: a mode of assessment that examines how well outputs propagate constraint, variation, and order across spans of generated text. This essay aims to reframe the current discussion around large language models, not by rejecting existing methods, but by suggesting an additional axis of interpretation grounded in structure rather than semantics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 6 of its 22 references that are in the map. First posted on arXiv 16 Apr 2025.

Builds on

6 of 22 references.

References · 6

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  5. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
  6. 2018The Description Length of Deep Learning Modelscited by 72

Built on by

Not cited yet.