Litcius/Paper detail

Generalized robust training scheme using genetic algorithm for optical neural networks with imprecise components

Rui Shao, Gong Zhang, Xiao Gong

2022Photonics Research47 citationsDOI

Abstract

One of the pressing issues for optical neural networks (ONNs) is the performance degradation introduced by parameter uncertainties in practical optical components. Hereby, we propose a novel two-step ex situ training scheme to configure phase shifts in a Mach–Zehnder-interferometer-based feedforward ONN, where a stochastic gradient descent algorithm followed by a genetic algorithm considering four types of practical imprecisions is employed. By doing so, the learning process features fast convergence and high computational efficiency, and the trained ONN is robust to varying degrees and types of imprecisions. We investigate the effectiveness of our scheme by using practical machine learning tasks including Iris and MNIST classifications, showing more than 23% accuracy improvement after training and accuracy (90.8% in an imprecise ONN with three hidden layers and 224 tunable thermal-optic phase shifters) comparable to the ideal one (92.0%).

Topics & Concepts

MNIST databaseComputer scienceArtificial neural networkConvergence (economics)Gradient descentAlgorithmStochastic gradient descentInterferometryRobustness (evolution)Feed forwardArtificial intelligenceEngineeringOpticsPhysicsChemistryGeneEconomic growthEconomicsBiochemistryControl engineeringNeural Networks and Reservoir ComputingOptical Network TechnologiesPhotonic and Optical Devices
Generalized robust training scheme using genetic algorithm for optical neural networks with imprecise components | Litcius