Can I read Visualizing the Loss Landscape of Winning Lottery Tickets on EtoBox?

Visualizing the Loss Landscape of Winning Lottery Tickets by Bain, Robert is a scholarly article available to read on EtoBox.

What is Visualizing the Loss Landscape of Winning Lottery Tickets about?

The underlying loss landscapes of deep neural networks have a great impact on their training, but they have mainly been studied theoretically due to computational constraints. This work vastly reduces the time required to compute such loss landscapes, and uses them to study winning lottery tickets found via iterative magnitude pruning. We also share results that contradict previously claimed correlations between certain loss landscape projection methods and model trainability and generalization error.

Author

Bain, Robert

Published

2021

Language

EN