Litcius/Paper detail

Automatic Synthesis Technology of Music Teaching Melodies Based on Recurrent Neural Network

Yingxue Zhang, Zhe Li

2021Scientific Programming18 citationsDOIOpen Access PDF

Abstract

Computer music creation boasts broad application prospects. It generally relies on artificial intelligence (AI) and machine learning (ML) to generate the music score that matches the original mono-symbol score model or memorize/recognize the rhythms and beats of the music. However, there are very few music melody synthesis models based on artificial neural networks (ANNs). Some ANN-based models cannot adapt to the transposition invariance of original rhythm training set. To overcome the defect, this paper tries to develop an automatic synthesis technology of music teaching melodies based on recurrent neural network (RNN). Firstly, a strategy was proposed to extract the acoustic features from music melody. Next, the sequence-sequence model was adopted to synthetize general music melodies. After that, an RNN was established to synthetize music melody with singing melody, such as to find the suitable singing segments for the music melody in teaching scenario. The RNN can synthetize music melody with a short delay solely based on static acoustic features, eliminating the need for dynamic features. The proposed model was proved valid through experiments.

Topics & Concepts

MelodyComputer scienceSingingRecurrent neural networkSpeech recognitionRhythmArtificial neural networkSequence (biology)Artificial intelligenceSet (abstract data type)MusicalAcousticsBiologyArtGeneticsVisual artsProgramming languagePhysicsMusic and Audio ProcessingMusic Technology and Sound StudiesNeuroscience and Music Perception
Automatic Synthesis Technology of Music Teaching Melodies Based on Recurrent Neural Network | Litcius