mlsanityData to 14 Oct 2026

HodgePhaseNet: Discrete Hodge Decomposition of Semantic Flows in Transformer Attention

arXiv 2610.14971 ↗First posted 10 Oct 2026cs.LG cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

WavePhaseNet introduced frequency-resolved semantic representations, QuantumPhaseNet introduced gauge-covariant phase connections, and ModularPhaseNet made a finite cyclic phase channel and its cycle holonomy computable in an ordinary Transformer. These constructions are complementary, yet they do not by themselves separate an observed collection of pairwise relations into a globally consistent direction, circulation around local compositions, and circulation that persists around a larger unfilled cycle. HodgePhaseNet addresses this separation by representing semantic transitions as an antisymmetric real-valued 1-cochain on a finite oriented simplicial complex. With vertex-edge incidence matrix B1 and edge-face incidence matrix B2, every such field has a unique orthogonal decomposition Omega = B1TPhi + B2Psi + H, where B1H=0 and B2TH=0. The three component fields are unique even when their potentials are not. We give explicit projectors, a sparse implementation, integrability and gauge results, a verified numerical example, and a redesigned attention interface. The attention bias is defined on allowed ordered query-key pairs, remains consistent under arbitrary choices of edge orientation, and preserves a decoder's causal information boundary by constructing its complex from the visible prefix. Gauge invariance of the attention output is conditional on using invariant or appropriately compensated features. A simple difference of vertex embeddings has no coexact or harmonic component; a genuine relation encoder is therefore indispensable. Local circulation is not automatically contradiction, and harmonic flow is not automatically missing knowledge. These interpretations and any reduction in factual error require controlled empirical evaluation. This paper presents a mathematical and architectural proposal, not external natural-language performance results.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 29 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

20 of 29 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2017On Calibration of Modern Neural Networkscited by 4,960
  4. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  5. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  6. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  7. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
  8. 2019Adversarial NLI: A New Benchmark for Natural Language Understandingcited by 807
  9. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 684
  10. 2021FNet: Mixing Tokens with Fourier Transformscited by 347
  11. 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
  12. 2015Order-Embeddings of Images and Languagecited by 113
8 more
  1. 2020Simplicial Neural Networkscited by 110
  2. 2019Topological Signal Processing over Simplicial Complexescited by 96
  3. 2018Random Walks on Simplicial Complexes and the normalized Hodge 1-Laplaciancited by 86
  4. 2016HyperLex: A Large-Scale Evaluation of Graded Lexical Entailmentcited by 26
  5. 2021Hodgelets: Localized Spectral Representations of Flows on Simplicial Complexescited by 11
  6. 2026WavePhaseNet: A DFT-Based Method for Constructing Semantic Conceptual Hierarchy Structures (SCHS)cited by 3
  7. 2026QuantumPhaseNet: A Gauge-Covariant Geometric and Quantum-Spectral Theory of Semantic Concept Hierarchies with Prototype Validation of a Classical Quantum-Inspired Modelcited by 1
  8. 2026ModularPhaseNet: Finite-Cyclic Phase Geometry for Computable Semantic Hierarchy, Direction, and Context Consistency in Standard Transformerscited by 1

Built on by

Not cited yet.