Can I read Week 7 BetterActivationFunctions on EtoBox?
Week 7 BetterActivationFunctions by K K SAHU is a document available to read on EtoBox.
What is Week 7 BetterActivationFunctions about?
The document discusses various aspects of training deep neural networks, including greedy layerwise pre-training, better activation functions, weight initialization, and batch normalization. It highlights the importance of gradients in training and the challenges faced with deep networks, particularly before 2006, when unsupervised pre-training techniques were introduced. The lecture also emphasizes the evolution of deep learning through improved optimization algorithms and regularization methods since then
- Author
- K K SAHU
- Language
- EN