Transformer Block Coupling and its Correlation with Generalization in LLMs
Murdock Aubry
Haoming Meng
Anton Sugolov
Vardan Papyan
Department of Mathematics, University of Toronto
Vector Institute
Coupling Phenomenon

Training Dynamics

