Litcius/Paper detail

Modeling Feedback in Interaction With Conversational Agents—A Review

Agnes Axelsson, Hendrik Buschmeier, Gabriel Skantze

2022Frontiers in Computer Science28 citationsDOIOpen Access PDF

Abstract

Intelligent agents interacting with humans through conversation (such as a robot, embodied conversational agent, or chatbot) need to receive feedback from the human to make sure that its communicative acts have the intended consequences. At the same time, the human interacting with the agent will also seek feedback, in order to ensure that her communicative acts have the intended consequences. In this review article, we give an overview of past and current research on how intelligent agents should be able to both give meaningful feedback toward humans, as well as understanding feedback given by the users. The review covers feedback across different modalities (e.g., speech, head gestures, gaze, and facial expression), different forms of feedback (e.g., backchannels, clarification requests), and models for allowing the agent to assess the user's level of understanding and adapt its behavior accordingly. Finally, we analyse some shortcomings of current approaches to modeling feedback, and identify important directions for future research.

Topics & Concepts

Embodied agentConversationHuman–computer interactionGazeComputer scienceEmbodied cognitionDialog systemChatbotGestureModalitiesFacial expressionDialog boxArtificial intelligencePsychologyCommunicationWorld Wide WebSocial scienceSociologySpeech and dialogue systemsSocial Robot Interaction and HRIAI in Service Interactions