Comparative Analysis of the Linear Regions in ReLU and LeakyReLU Networks
Xuan Qi, Yi Wei, Xue Mei, Ryad Chellali, Shipin Yang
Topics & Concepts
Piecewise linear functionComputer sciencePartition (number theory)Metric (unit)Activation functionNetwork analysisLinear modelLinear relationshipTopology (electrical circuits)AlgorithmTheoretical computer scienceArtificial intelligenceMathematicsArtificial neural networkMachine learningCombinatoricsStatisticsPhysicsQuantum mechanicsOperations managementGeometryEconomicsAdvanced Memory and Neural ComputingNeural Networks and ApplicationsNeural dynamics and brain function