Interdisciplinary frontiers: computer-based process data analysis in educational measurement

In recent years, the collection and analysis of technology-based process data in the educational measurement realm has steadily increased. Process data are usually generated automatically while a student is working on a computer-based task or exercise, and contain all relevant pieces of information on how the student interacts with this task. Such information includes but is not limited to task duration, number of clicks, and task performance. Given the informational richness of computer-based process data, its analysis is of great interest to educational stakeholders and researchers alike. Notably, scientific results obtained from process data analysis have been used to adapt assessment techniques and institutional curricula, and have uncovered areas for intervention to foster integral skills that provide an educational benefit to students. This article presents a thorough overview of historical and contemporary applications of technology-based process data analysis in the educational field. Specifically, it provides in-depth coverage of the role of process data analysis with respect to psychometrical considerations, formative and summative assessment. Moreover, we describe process data analysis for large-scale educational assessments such as PISA and PIAAC, as well as publicly available process data repositories. Additionally, process data analysis in educational measurement is showcased using the example of complex problem solving, a skill that has proven to be relevant for students' educational success and beyond. Finally, this article addresses several current challenges to consider when engaging in computer-based process data analysis for educational purposes, before concluding with an outlook on potential future developments in the field.