Can I read Activation Functions & Xavier Initialization on EtoBox?

Activation Functions & Xavier Initialization by emailpython6 is a document available to read on EtoBox.

What is Activation Functions & Xavier Initialization about?

This document surveys activation functions used in artificial neural networks and their relationship to Xavier and He normal initialization methods. It discusses important properties of activation functions, commonly used functions like sigmoid and ReLU, and problems they can face. The survey also explores the connection between activation functions and the two initialization methods.

Author

emailpython6

Language

EN