Litcius/Paper detail

The use of process data in large-scale assessments: a literature review

Ella Anghel, Lale Khorramdel, Matthias von Davier

2024Large-scale Assessments in Education18 citationsDOIOpen Access PDF

Abstract

Abstract As the use of process data in large-scale educational assessments is becoming more common, it is clear that data on examinees’ test-taking behaviors can illuminate their performance, and can have crucial ramifications concerning assessments’ validity. A thorough review of the literature in the field may inform researchers and practitioners of common findings as well as existing gaps. This literature review used topic modeling to identify themes in 221 empirical studies using process data in large-scale assessments. We identified six recurring topics: response time models, response time-general, aberrant test-taking behavior, action sequences, complex problem-solving, and digital writing. We also discuss the prominent theories used by studies in each category. Based on these findings, we suggest directions for future research applying process data from large-scale assessments.

Topics & Concepts

Process (computing)Scale (ratio)Computer scienceData scienceProcess managementBusinessGeographyCartographyProgramming languageOnline Learning and AnalyticsPsychometric Methodologies and TestingInnovative Teaching and Learning Methods
The use of process data in large-scale assessments: a literature review | Litcius