Litcius/Paper detail

A Multi-Modal Array of Interpretable Features to Evaluate Language and Speech Patterns in Different Neurological Disorders

Anna Favaro, Chelsie Motley, Tianyu Cao, Miguel Iglesias, Ankur Butala, Esther S. Oh, Robert D. Stevens, Jesús Villalba, Najim Dehak, Laureano Moro-Velázquez

20232022 IEEE Spoken Language Technology Workshop (SLT)14 citationsDOI

Abstract

Speech-based automatic approaches for evaluating neurological disorders (NDs) depend on feature extraction before the classification pipeline. It is preferable for these features to be interpretable to facilitate their development as diagnostic tools. This study focuses on the analysis of interpretable features obtained from the spoken responses of 88 subjects with NDs and controls (CN). Subjects with NDs have Alzheimer's disease (AD), Parkinson's disease (PD), or Parkinson's disease mimics (PDM). We configured three complementary sets of features related to cognition, speech, and language, and conducted a statistical analysis to examine which features differed between NDs and CN. Results suggested that features capturing response informativeness, reaction times, vocabulary richness, and syntactic complexity provided separability between AD and CN. Similarly, fundamental frequency variability helped differentiate PD from CN, while the number of salient informational units PDM from CN.

Topics & Concepts

Computer scienceSalientFeature (linguistics)VocabularyNatural language processingFeature extractionPipeline (software)Artificial intelligenceCognitionSpeech recognitionDementiaPattern recognition (psychology)DiseasePsychologyLinguisticsNeuroscienceMedicinePhilosophyProgramming languagePathologyNatural Language Processing TechniquesVoice and Speech DisordersSpeech Recognition and Synthesis