Can I read Activation Functions 1 on EtoBox?
Activation Functions 1 by chinta.lakshmirajesh is a document available to read on EtoBox.
What is Activation Functions 1 about?
The document discusses three activation functions used in deep learning: Sigmoid, ReLU, and Tanh. Sigmoid is suitable for binary classification but suffers from vanishing gradients and is computationally heavy. ReLU is preferred for hidden layers due to its efficiency and avoidance of vanishing gradients, while Tanh is zero-centered and ideal for RNNs, though it can also face saturation issues.
- Author
- chinta.lakshmirajesh
- Language
- EN