Designing Ground Truth and the Social Life of Labels
Michael Müller, Christine T. Wolf, Josh Andrés, Michael Desmond, Narendra Nath Joshi, Zahra Ashktorab, Aabhas Sharma, Kristina Brimijoin, Qian Pan, Evelyn Duesterwald, Casey Dugan
Abstract
Ground-truth labeling is an important activity in machine learning. Many studies have examined how crowdworkers apply labels to records in machine learning datasets. However, there have been few studies that have examined the work of domain experts when their knowledge and expertise are needed to apply labels.
Topics & Concepts
Ground truthComputer scienceCommon groundArtificial intelligenceDomain (mathematical analysis)Data scienceNatural language processingMachine learningInformation retrievalMathematicsSociologyCommunicationMathematical analysisMobile Crowdsensing and CrowdsourcingData Stream Mining TechniquesEthics and Social Impacts of AI