Can I read Neural Collapse and NTK Dynamics Explained on EtoBox?
Neural Collapse and NTK Dynamics Explained by Nataraj Das is a document available to read on EtoBox.
What is Neural Collapse and NTK Dynamics Explained about?
This document explores the relationship between Neural Tangent Kernel (NTK) and Neural Collapse (NC) in deep neural networks (DNNs), proposing a model where the NTK exhibits a block structure aligned with class labels. The authors derive the dynamics of DNNs trained with mean squared error loss, identify conditions for the emergence of NC, and provide numerical experiments to support their findings. This work aims to enhance the theoretical understanding of DNN training dynamics and the mechanisms behind NC
- Author
- Nataraj Das
- Language
- EN