Rapsai: Accelerating Machine Learning Prototyping of Multimedia Applications through Visual Programming
Ruofei Du, Na Li, Jing Jin, Michelle Mohr Carney, Scott Miles, Maria Kleiner, Xiuxiu Yuan, Yinda Zhang, Anuva Kulkarni, Xingyu Liu, Ahmed Sabie, Sergio Orts‐Escolano, Abhishek Kar, Ping Yu, Ram Iyengar, Adarsh Kowdle, Alex Olwal
Abstract
In recent years, there has been a proliferation of multimedia applications that leverage machine learning (ML) for interactive experiences. Prototyping ML-based applications is, however, still challenging, given complex workflows that are not ideal for design and experimentation. To better understand these challenges, we conducted a formative study with seven ML practitioners to gather insights about common ML evaluation workflows.
Topics & Concepts
Computer scienceWorkflowLeverage (statistics)Formative assessmentMultimediaRapid prototypingVisual programming languageSoftware engineeringHuman–computer interactionArtificial intelligenceProgramming languageEngineeringDatabaseStatisticsMechanical engineeringMathematicsData Visualization and AnalyticsEducational Games and GamificationExplainable Artificial Intelligence (XAI)