Optimized injection of noise in activation functions to improve generalization of neural networks
Fabing Duan, François Chapeau‐Blondeau, Derek Abbott
Topics & Concepts
Differentiable functionArtificial neural networkActivation functionGeneralizationNoise (video)Gradient descentProbabilistic logicComputer scienceStochastic resonanceStochastic gradient descentNorm (philosophy)Artificial intelligenceMathematicsMathematical analysisLawImage (mathematics)Political sciencestochastic dynamics and bifurcationNeural Networks and ApplicationsNeural dynamics and brain function