Publications

Mind the Gap: a Spectral Analysis of Rank Collapse and Signal Propagation in Transformers

A. Naderi*, T. Nait Saada* and J. Tanner

PDF

A simple proof for the almost sure convergence of the largest singular value of a product of Gaussian matrices

T. Nait Saada* and A. Naderi*

PDF

CARMIL: Context-Aware Regularization on Multiple Instance Learning models for Whole Slide Images

T. Nait Saada*, V. Di Proietto*, B. Schmauch, K. Von Loga and L. Fidon

PDF

Beyond IID weights: low-rank and sparse Neural Networks are also Gaussian Processes

T. Nait Saada, A. Naderi, J. Tanner

PDF

On the Initialisation of Wide Low-Rank Feedforward Neural Networks

T. Nait Saada and J. Tanner

PDF