Human and Large Language Model Intent Detection in Image-Based Self-Expression of People with Intellectual Disability
Alieh Hajizadeh Saffar, Laurianne Sitbon, Maria Hoogstrate, Ahmed Abbas, Sirinthip Roomkham, Dimity Miller
Abstract
Non-verbal communication is essential for the social inclusion of individuals with an intellectual disability, affecting interactions with others as well as technological systems. This study focuses on non-symbolic communication of people with intellectual disability through generic images without specific or detailed subject matter. A key challenge in this medium is discerning the underlying intentions behind images selected as visual prompts for conversation.
Topics & Concepts
ConversationIntellectual disabilityKey (lock)Expression (computer science)Computer scienceInclusion (mineral)Subject matterPsychologyHuman–computer interactionInternet privacyArtificial intelligenceCognitive scienceNatural language processingMultimediaSocial psychologyCommunicationComputer securityPedagogyProgramming languageCurriculumPsychiatryMultimodal Machine Learning ApplicationsSubtitles and Audiovisual MediaSpeech and dialogue systems