|
In this paper, we make a brief survey about the main activation functions used for deep learning up to date. The activation function plays an important role in model based on neural network, especially, deep learning. The experimentation results obtained show that each activation function contribute different impact for CNN model. In the future, the new activation function needs to be further studied. When we deal with real applications, the use of different kinds of activation functions should be tried and choosing the best one.
|