COSMIC: A Conversational Interface for Human-AI Music Co-Creation
Yixiao Zhang, Gus Xia, M. Lévy, Simon Dixon
Abstract
In this paper, we propose COSMIC, a COnverSational Interface for Human-AI MusIc Co-Creation. It is a chatbot with a two-fold design philosophy: to understand human creative intent and to help humans in their creation. The core Natural Language Processing (NLP) module is responsible for three functions: 1) understanding human needs in chat, 2) cross-modal interaction between natural language understanding and music generation models, and 3) mixing and coordinating multiple algorithms to complete the composition.
Topics & Concepts
ChatbotComputer scienceInterface (matter)Human–computer interactionNatural (archaeology)Natural language user interfaceNatural languageNatural language processingParallel computingArchaeologyHistoryMaximum bubble pressure methodBubbleMusic and Audio ProcessingMusic Technology and Sound StudiesTopic Modeling