Optimization Algorithm to Reduce Training Time for Deep Learning Computer Vision Algorithms Using Large Image Datasets With Tiny Objects
Sergio Bemposta Rosende, Javier Fernández Andrés, Javier Sánchez-Soriano
Abstract
The optimization of convolutional neural networks (CNN) generally refers to the improvement of the inference process, making this as fast and precise as possible. While inference time is an essential factor in using these networks in real time, the training of CNNs using very large datasets can be very costly in terms of time and computing power. This paper proposes a technique to reduce training time by an average of 75% without altering the results of CNN training with an algorithm which partitions the dataset and discards superfluous objects (targets). This algorithm is a tool that pre-processes the original dataset, generating a smaller and more condensed dataset to be used for network training. The effectiveness of this tool depends on the type of dataset used for training the CNN and is particularly effective with sequential images (video), large images and images with tiny targets generally from drones or traffic surveillance cameras (but applicable to any other type of image which meets the requirements). The tool can be parameterized to meet the characteristics of the initial dataset.