Optimization Methods For Large-Scale Machine Learning

Yuan Gao, Jianping Li, Yue Zhou, Fei Xiao, He Liu

20212021 18th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP)21 citationsDOI

Abstract

This paper mainly completes the binary classification of RCV1 text data set by logistic regression. Based on the established logistic regression model, the performance and characteristics of three numerical optimization algorithms–random gradient descent, Mini-Batch random gradient and L-BFGS are studied.

Topics & Concepts

Broyden–Fletcher–Goldfarb–Shanno algorithmLogistic regressionComputer scienceGradient descentScale (ratio)Stochastic gradient descentBinary classificationSet (abstract data type)Binary numberArtificial intelligenceMachine learningMathematicsSupport vector machineArtificial neural networkAsynchronous communicationQuantum mechanicsComputer networkPhysicsProgramming languageArithmeticStochastic Gradient Optimization TechniquesFace and Expression RecognitionSparse and Compressive Sensing Techniques