Practical guidelines for resolving the loss divergence caused by the root-mean-squared propagation optimizer
Yuan-Long Peng, Wei‐Po Lee
Topics & Concepts
Divergence (linguistics)Computer scienceConvergence (economics)Artificial intelligenceMoment (physics)Machine learningMean squared errorArtificial neural networkStatisticsMathematicsPhilosophyEconomic growthClassical mechanicsPhysicsEconomicsLinguisticsSpeech and Audio ProcessingMusic and Audio ProcessingSpeech Recognition and Synthesis