IEEE/ICACT20230240 Slide.08        [Big Slide]       Oral Presentation
The third one is ELU (Exponential Linear Unit) function. In contrast to ReLUs, ELUs have negative values which allows them to push mean unit activations closer to zero like batch normalization but with lower computational complexity. ELUs performs not only to faster learning, but also to significantly better than ReLUs and LReLUs on networks having more than 5 layers. The ELU function is expressed in the equation 3.

[Go to Next Slide]
Select Voice: