| Virual Oral Presentation Slide by Slide |
IEEE/ICACT20230240 Slide.07
[Big Slide]
| Oral Presentation |
|
|
The second one is Leaky ReLU (LReLU), The properties of the LReLU are continuous and not-bounded. The computation using LReLU is cheap and having a zero-centered activation function. The LReLU function allows a small part of negative units instead of pushing them to zero like the ReLU function does. The equation 2 shows the definition of the LReLU. | |
| [Go to Next Slide] |