Combining deep learning with chemometrics when it is really needed: A case of real time object detection and spectral model application for spectral image processing
Jun‐Li Xu, Puneet Mishra
Abstract
Deep learning (DL) being popularly used in computer vision applications is still in its early stage in chemometric domain for spectral image processing. Often the challenge is that there are too few samples from analytical laboratory experiments to preform DL. In this study, we present a novel combination of DL and chemometrics to process spectral images even with as few as < 100 spectral images. We divided the image processing part such as object detection and recognition as the DL task and prediction of chemical property as the chemometric task based on latent space modelling. For image processing tasks of object detection and recognition, transfer learning was performed on the pretrained YOLOv4 object detection network weights to adapt the model to work well on spectral images captured in laboratory settings. Once the object is identified with DL, a background query is performed for the pre-built chemometric models to select the model for predicting the properties for specific object. The obtained results showed good potential of using DL and chemometric approaches in conjunction to reap the best of both scientific domains. This approach is of high interest to whoever involved in spectral imaging and dealing with object detection and physicochemical properties prediction of the samples with chemometric approaches.