IEEE/ICACT20230240 Slide.06        [Big Slide]       Oral Presentation
The first one is ReLU function. This function proposed by Vinod Nair and Geoffrey E. Hinton and widely use in deep learning models. The properties of ReLU function are continuous, not-bounded and not zero-centered. The ReLU function is presented in the equation 1.

[Go to Next Slide]
Select Voice: