Gradient descent for deep matrix factorization: Dynamics and implicit bias towards low rank
Hung-Hsu Chou, Carsten Gieshoff, Johannes Maly, Holger Rauhut
Topics & Concepts
InitializationGradient descentRank (graph theory)MathematicsStochastic gradient descentConvergence (economics)Matrix (chemical analysis)Iterated functionComputer scienceAlgorithmApplied mathematicsMathematical optimizationArtificial intelligenceArtificial neural networkMathematical analysisComposite materialProgramming languageEconomicsMaterials scienceCombinatoricsEconomic growthSparse and Compressive Sensing TechniquesGaussian Processes and Bayesian InferenceBlind Source Separation Techniques