Batch normalization provably avoids ranks collapse for randomly initialised deep networks
Hadi Daneshmand, Jonas Köhler, Francis Bach, Thomas Hofmann, Aurélien Lucchi
2020Neural Information Processing Systems18 citations
Topics & Concepts
Normalization (sociology)Computer scienceAlgorithmSociologyAnthropologyMachine Learning and ELMStochastic Gradient Optimization TechniquesNeural Networks and Applications