cs.LGMay 27, 2026

PLS in the Mirror of Self-Attention

Authors: JiangshengYou

Organizations: Jason

Abstract

This note provides an interesting observation on casting partial least square (PLS) as a linearized self-attention so that PLS may be studied within the neural network paradigm. On the other hand, the dimensionality reduction and selection of predictors in PLS may indicate that self-attention includes certain degree of dimensionality normalization toward improved learning.

Explore similar work

CardsList
  1. Improving Improved Kernel PLS

    Jul 17, 2026Ole-Christian Galbo EngstrømLeast Squares