Litcius/Paper detail

Musical Instrument Identification Using Deep Learning Approach

Maciej Blaszke, Bożena Kostek

2022Sensors42 citationsDOIOpen Access PDF

Abstract

The work aims to propose a novel approach for automatically identifying all instruments present in an audio excerpt using sets of individual convolutional neural networks (CNNs) per tested instrument. The paper starts with a review of tasks related to musical instrument identification. It focuses on tasks performed, input type, algorithms employed, and metrics used. The paper starts with the background presentation, i.e., metadata description and a review of related works. This is followed by showing the dataset prepared for the experiment and its division into subsets: training, validation, and evaluation. Then, the analyzed architecture of the neural network model is presented. Based on the described model, training is performed, and several quality metrics are determined for the training and validation sets. The results of the evaluation of the trained network on a separate set are shown. Detailed values for precision, recall, and the number of true and false positive and negative detections are presented. The model efficiency is high, with the metric values ranging from 0.86 for the guitar to 0.99 for drums. Finally, a discussion and a summary of the results obtained follows.

Topics & Concepts

Computer scienceIdentification (biology)Metric (unit)Precision and recallConvolutional neural networkArtificial intelligenceSet (abstract data type)MetadataArtificial neural networkGuitarMusical instrumentMachine learningDeep learningData miningEngineeringPhysicsProgramming languageOperating systemManagementOperations managementBotanyEconomicsBiologyAcousticsMusic and Audio ProcessingSpeech and Audio ProcessingMusic Technology and Sound Studies