mlsanityData to 14 Oct 2026

Language as a Wave Phenomenon: Semantic Phase Locking and Interference in Neural Networks

arXiv 2512.01208 ↗First posted 1 Dec 2025cs.LG cs.AI cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

In standard Transformer architectures, semantic importance is often conflated with activation magnitude, obscuring the geometric structure of latent representations. To disentangle these factors, we introduce PRISM, a complex-valued architecture designed to isolate the computational role of phase. By enforcing a strict unit-norm constraint (|z| = 1) and replacing attention with gated harmonic convolutions, the model is encouraged to utilize subtractive interference in the frequency domain to suppress noise, rather than relying on magnitude-based gating. We utilize this constrained regime to study a hybrid architecture -- fusing phase-based routing with standard attention -- which achieves improved parameter efficiency and representation quality compared to baselines in our evaluated settings. Mechanistically, interventional ablations indicate that the model carries substantial task-relevant information in phase: preserving phase largely maintains performance, whereas disrupting phase causes severe degradation. Together, these results suggest that phase-based spectral interference is a usable computational mechanism for neural sequence modeling at the evaluated scale.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 1 Dec 2025.

Builds on

19 of 42 references.

References · 19

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2016Layer Normalizationcited by 5,669
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  6. 2016Pointer Sentinel Mixture Modelscited by 3,096
  7. 2019Root Mean Square Layer Normalizationcited by 1,480
  8. 2022In-context Learning and Induction Headscited by 964
  9. 2023Progress measures for grokking via mechanistic interpretabilitycited by 839
  10. 2021FNet: Mixing Tokens with Fourier Transformscited by 347
  11. 2015Unitary Evolution Recurrent Neural Networkscited by 294
  12. 2017Deep Complex Networkscited by 217
7 more
  1. 2019Transformers without Tears: Improving the Normalization of Self-Attentioncited by 153
  2. 2023The Relational Bottleneck as an Inductive Bias for Efficient Abstractioncited by 27
  3. 2023Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformerscited by 12
  4. 2024Disentangling and Integrating Relational and Sensory Information in Transformer Architecturescited by 5
  5. 2025Holographic Transformers for Complex-Valued Signal Processing: Integrating Phase Interference into Self-Attentioncited by 2
  6. 2024A Lightweight Transformer with Phase-Only Cross-Attention for Illumination-Invariant Biometric Authenticationcited by 1
  7. 2025ComplexFormer: Disruptively Advancing Transformer Inference Ability via Head-Specific Complex Vector Attentioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.