mlsanityData to 7 Oct 2026

The Order Is The Message

arXiv 2603.25047 ↗First posted 24 Mar 2026cs.LG stat.MLcited by 1

Not on the map. Why?

Abstract (arXiv)

In a controlled experiment on modular arithmetic (p = 9973), varying only example ordering while holding all else constant, two fixed-ordering strategies achieve 99.5% test accuracy by epochs 487 and 659 respectively from a training set comprising 0.3% of the input space, well below established sample complexity lower bounds for this task under IID ordering. The IID baseline achieves 0.30% after 5,000 epochs from identical data. An adversarially structured ordering suppresses learning entirely. The generalizing model reliably constructs a Fourier representation whose fundamental frequency is the Fourier dual of the ordering structure, encoding information present in no individual training example, with the same fundamental emerging across all seeds tested regardless of initialization or training set composition. We discuss implications for training efficiency, the reinterpretation of grokking, and the safety risks of a channel that evades all content-level auditing.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). First posted on arXiv 24 Mar 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.