Activity–weight duality in feed-forward neural networks reveals two co-determinants for generalization
Yu Feng, Wei Zhang, Yuhai Tu
Topics & Concepts
GeneralizationArtificial neural networkComputer scienceRegularization (linguistics)Norm (philosophy)Deep learningEarly stoppingDuality (order theory)Artificial intelligenceKey (lock)AlgorithmMathematicsDiscrete mathematicsComputer securityMathematical analysisLawPolitical scienceNeural Networks and ApplicationsMachine Learning in Materials ScienceDomain Adaptation and Few-Shot Learning