Assessing User Experience of a Secure Mobile Exam Application using UEQ+
Bayu Setiaji, Mardhiya Hayaty, Arief Setyanto, Krisnawati, Harry Budi Santoso
Abstract
Online examination gains popularity during the COVID-19 pandemic due to the massive adoption of online learning. In the online examination, human proctoring activity is hardly possible, and therefore an alternative way to keep academic integrity is needed. Currently, camera, microphone, and gyro sensors have been standard embedded sensors in smartphones. This research utilizes those sensors to detect the possibility of cheating in the online examination. A mobile application with two main functions was developed to record the user activity during the exam as the background and carry out the examination function on the foreground task. Consequently, users may feel uncomfortable due to activity recording requirements. This research reveals many aspects of user convenience during the examination of varied user locations, available bandwidth, and gadgets. A user experience questionnaire plus (UEQ+) was used to understand user feelings while engaging with the application. Our analysis shows no strong correlation between key performance indicator achievement and the smartphone specification. According to the questionnaire analysis, the user considered that the secure exam application achieves 1.61 points in a range of -3 to 3. It is indicated that the users, in general, have a positive experience with the mobile exam application.