Mind the Gap: a Spectral Analysis of Rank Collapse and Signal Propagation in Transformers

A. Naderi* , T. Nait Saada* and J. Tanner
Oct 2024
PDF
Type
Preprint
Under review