Litcius/Paper detail

Successfully and efficiently training deep multi-layer perceptrons with logistic activation function simply requires initializing the weights with an appropriate negative mean

Ahmet Yılmaz, Riccardo Poli

2022Neural Networks22 citationsDOIOpen Access PDF

Topics & Concepts

Sigmoid functionInitializationActivation functionArtificial neural networkLogistic functionPerceptronComputer scienceBackpropagationGradient descentFunction (biology)Artificial intelligenceObstacleTraining (meteorology)AlgorithmLayer (electronics)Multilayer perceptronMathematicsApplied mathematicsMachine learningPhysicsLawChemistryOrganic chemistryEvolutionary biologyProgramming languageMeteorologyBiologyPolitical scienceNeural Networks and ApplicationsMachine Learning and ELMDomain Adaptation and Few-Shot Learning
Successfully and efficiently training deep multi-layer perceptrons with logistic activation function simply requires initializing the weights with an appropriate negative mean | Litcius