Can I read Layer-Level Activation Mechanism for Noise Robustness on EtoBox?
Layer-Level Activation Mechanism for Noise Robustness by nightsnackc is a document available to read on EtoBox.
What is Layer-Level Activation Mechanism for Noise Robustness about?
This document introduces a novel layer-level activation mechanism, termed LayerAct, which aims to enhance noise-robustness in neural networks by reducing fluctuations in activation outputs. The proposed LayerAct functions, LA-SiLU and LA-HardSiLU, demonstrate superior performance in handling noisy datasets compared to traditional element-level activation functions, achieving a zero-like mean activation without restricting the output space. Experimental results indicate that LayerAct functions excel in vario
- Author
- nightsnackc
- Language
- EN