A Review of Activation Function for Artificial Neural Network
Andrinandrasana David Rasamoelina, Fouzia Adjailia, Peter Sinčák
Abstract
The activation function plays an important role in the training and the performance of an Artificial Neural Network. They provide the necessary non-linear properties to any Artificial Neural Network. In this work, we provide a review of the most common and recent activation functions used in the hidden layer of an artificial Neural Network.
Topics & Concepts
Activation functionArtificial neural networkComputer scienceArtificial intelligencePhysical neural networkNervous system network modelsTime delay neural networkTypes of artificial neural networksStochastic neural networkFunction (biology)BiologyEvolutionary biologyNeural Networks and ApplicationsMachine Learning and ELMFace and Expression Recognition