# PLS in the Mirror of Self-Attention

arXiv: https://arxiv.org/abs/2605.28592 · HTML: https://mlsanity.com/paper/2605.28592/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 2 of its 6 references that are in the map.
- First posted on arXiv 27 May 2026.

## Builds on (most cited first, 2 of 2)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Reformulation of RBM to Unify Linear and Nonlinear Dimensionality Reduction](https://mlsanity.com/paper/1909.08210/) (2019)

## Abstract (arXiv)

This note provides an interesting observation on casting partial least square (PLS) as a linearized self-attention so that PLS may be studied within the neural network paradigm. On the other hand, the dimensionality reduction and selection of predictors in PLS may indicate that self-attention includes certain degree of dimensionality normalization toward improved learning.