Loss landscapes and optimization in over-parameterized non-linear systems and neural networks
Chaoyue Liu, Libin Zhu, Mikhail Belkin
Topics & Concepts
Parameterized complexityMathematicsConvexityArtificial neural networkMathematical optimizationApplied mathematicsRelaxation (psychology)Stochastic gradient descentOptimization problemKernel (algebra)Convergence (economics)Computer scienceAlgorithmArtificial intelligenceDiscrete mathematicsPsychologySocial psychologyEconomicsFinancial economicsEconomic growthSparse and Compressive Sensing TechniquesModel Reduction and Neural NetworksStochastic Gradient Optimization Techniques