# Transformer models are gauge invariant: A mathematical connection between AI and particle physics

arXiv: https://arxiv.org/abs/2412.14543 · HTML: https://mlsanity.com/paper/2412.14543/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- First posted on arXiv 19 Dec 2024.

## Abstract (arXiv)

In particle physics, the fundamental forces are subject to symmetries called gauge invariance. It is a redundancy in the mathematical description of any physical system. In this article I will demonstrate that the transformer architecture exhibits the same properties, and show that the default representation of transformers has partially, but not fully removed the gauge invariance.