Mind the Gap: a Spectral Analysis of Rank Collapse and Signal Propagation in Transformers

T. Nait Saada*, A. Naderi* and J. Tanner
Oct 2024
PDF
Type
Preprint
ICML 2025