Litcius/Paper detail

AIive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

Zhuoyue Lyu, Jiannan Li, Bryan Wang

202118 citationsDOIOpen Access PDF

Abstract

Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present AIive, an interactive visualization of AI in Virtual Reality (VR) that brings AI “alive”. AIive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, AIive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.

Topics & Concepts

SonificationVisualizationComputer scienceVirtual realityHuman–computer interactionRepresentation (politics)Artificial neural networkArtificial intelligenceRange (aeronautics)Auditory displayData visualizationHyperparameterMultimediaEngineeringLawAerospace engineeringPoliticsPolitical scienceExplainable Artificial Intelligence (XAI)Data Visualization and AnalyticsCell Image Analysis Techniques