AdaTerm: Adaptive T-distribution estimated robust moments for Noise-Robust stochastic gradient optimization
Wendyam Eric Lionel Ilboudo, Taisuke Kobayashi, Takamitsu Matsubara
Topics & Concepts
Robustness (evolution)Computer scienceHyperparameterStochastic gradient descentGradient descentNoise (video)Robust optimizationStochastic optimizationMathematical optimizationAdaptabilityMoment (physics)Artificial intelligenceAlgorithmMathematicsArtificial neural networkClassical mechanicsPhysicsImage (mathematics)BiochemistryGeneBiologyEcologyChemistryStochastic Gradient Optimization TechniquesAdvanced Neural Network ApplicationsSparse and Compressive Sensing Techniques