Litcius/Paper detail

End-to-end optical music recognition for pianoform sheet music

Antonio Ríos-Vila, David Rizo, José M. Iñesta, Jorge Calvo-Zaragoza

2023International Journal on Document Analysis and Recognition (IJDAR)21 citationsDOIOpen Access PDF

Abstract

Abstract End-to-end solutions have brought about significant advances in the field of Optical Music Recognition. These approaches directly provide the symbolic representation of a given image of a musical score. Despite this, several documents, such as pianoform musical scores, cannot yet benefit from these solutions since their structural complexity does not allow their effective transcription. This paper presents a neural method whose objective is to transcribe these musical scores in an end-to-end fashion. We also introduce the GrandStaff dataset, which contains 53,882 single-system piano scores in common western modern notation. The sources are encoded in both a standard digital music representation and its adaptation for current transcription technologies. The method proposed in this paper is trained and evaluated using this dataset. The results show that the approach presented is, for the first time, able to effectively transcribe pianoform notation in an end-to-end manner.

Topics & Concepts

Musical notationNotationPianoComputer scienceTranscription (linguistics)MusicalRepresentation (politics)End-to-end principleSpeech recognitionMusical compositionArtificial intelligenceArithmeticArtMathematicsLinguisticsVisual artsPoliticsLawArt historyPhilosophyPolitical scienceMusic and Audio ProcessingDigital Media Forensic Detection
End-to-end optical music recognition for pianoform sheet music | Litcius