Convex and concave envelopes of artificial neural network activation functions for deterministic global optimization
Matthew E. Wilhelm, Chenyu Wang, Matthew D. Stuber
Topics & Concepts
Sigmoid functionActivation functionMathematicsArtificial neural networkConcave functionRectifier (neural networks)Mathematical optimizationConvex optimizationRegular polygonGlobal optimizationPiecewise linear functionOptimization problemConvex functionReduction (mathematics)Computer scienceRecurrent neural networkStochastic neural networkArtificial intelligenceMathematical analysisGeometryAdvanced Optimization Algorithms ResearchNeural Networks and ApplicationsMetaheuristic Optimization Algorithms Research